integrating distributed ledgers into...
TRANSCRIPT
&
in collaboration with
Integrating Distributed Ledgers
into Modern Analytics Platforms
An AML/KYC use case
US & UK Qlik partner with Blockchain development teamSpun out from Deutsche Bank (London) in 2013
Analytics firm focusing on rapid time to value on Big data and advanced analytics use cases
Enterprise Machine learning platform enabling citizen data scientists & making real data scientists more efficient
Leading Hadoop distribution with unparalleled performance, with security and governance built in
Qlik best in class in-memory aggregation engine with an open architecture
BARDESS ANALYTICS VALUE CHAIN
Incr
eas
ing
Business
Val
ue
A systematic approach to conceptually visualize the
strategic journey to insightful
business analytics.
z2h Stack®Modernize your architecture to take advantage of a “schema on read” data-lake approach to data storage and massively parallel processing of Hadoop.
Democratize your data further by empowering business users to prep their data for analysis. Enable DaaS with governance.
Identify patterns, relationships and outliers in vast amounts of data in visually compelling ways.
Apply, Artificial Intelligence (AI), Machine Learning (ML), predictive, prescriptive and geospatial capabilities to further leverage your data assets.
Solution Provider of the year 2016
Innovation Provider of the year 2017
Storage &Processing
VisualAnalytics
AdvancedAnalytics
DataPreparation
Cloudera Platform
Batch or Real-
time Data
Streams
When all your data is stored on a single platform, you have a single place to secure and govern
across all analytic workloads
THE 4 WORKLOADS FOR HADOOP
DATAENGINEERING
ANALYTICS& REPORTING
DATASCIENCE
OPERATIONALPROCESSING
Place holder – Screen shots from our cluster- navigator
Place holder – Screen shots from our cluster- navigator
Place holder – Screen shots from our cluster- navigator
Place holder – Screen shots from our cluster- lineage
Sentry Architecture
Impala HiveServer2
Impala Hive Future
Policy Engine
Policy Provider
File Database
Local FS/HDFS
Binding Layer
Authorization Provider
Interface
Evaluation, Validation
Parsing
Interface
One Modern Platform for Machine Learning and Analytics
Handle real-time
data ingest from
diverse sources
Governance and
Security
Deployment Flexibility
Machine
Learning
Capabilities
Diverse Analytical
Options
Scale easily &
Cost effectively
Data Sources
Data SourcesData Storage &
Processing
Reporting, Analytics &
AuditingData Ingest
Other
Data Governance (Data Lineage, Data Protection)
Data workflows and policies
Data Preparation
Batch or Real- time
Data Streams
Data Volume
Cost of Compute
The Emergence of Machine Learning
Data Scientists are Rare
Obligatory Data Scientist Definition Slide
Coding
Skills
Maths &
Stats
Domain
Knowledge
Data
Science
● Foundational statistics
● Internals of algorithms
● Practical knowledge &
experience● Programming
Get data
Manipulate data
Explore data
Build models
Implement models
● Understand the business
problem
● Understand the data
● Explain the results
Turn Business Analysts Into Data Scientists
Coding
Skills
Math
&
Stats
Domain
Expertise
Business Analyst
provides the domain
knowledge
DataRobot takes
care of the math
and code+
What is Blockchain?
Use Case #1 – Repricing – FO Product X
BBG / Reuters
E-Mail OtherCall
Use Case #2 – Insurance – Specialized Assets
Owner
Management
Servicing
Insurance
Maintenance
Broker
Underwriter
Valuation
Legal
Regulatory
Claims
Conveyance
Tracking
Estate Planning
What is Ripple?
Use case – AML @ POMBAR bank –getting a complete picture across all transactions –traditional systems and the blockchain
The Blockchain -
Ripple Transactions
Core Banking Systems
+
Use case – AML @ POMBAR bank –getting a complete picture across all transactions –traditional systems and the blockchain
Enterprise Data Hub
- Single place for all data
- Secure
- Governed
- Managed
The Blockchain -
Ripple Transactions
Core Banking Systems
+
Use case – AML @ POMBAR bank –getting a complete picture across all transactions –traditional systems and the blockchain
Enterprise Data Hub
- Single place for all data
- Secure
- Governed
- Managed
The Blockchain -
Ripple Transactions
Core Banking Systems
+
Use case – AML @ POMBAR bank –getting a complete picture across all transactions –traditional systems and the blockchain
Enterprise Data Hub
- Single place for all data
- Secure
- Governed
- Managed
The Blockchain -
Ripple Transactions
Core Banking Systems
+
Analysis - Insight
Use case – AML @ POMBAR bank –getting a complete picture across all transactions –traditional systems and the blockchain
INSIGHT ACTIONDATADATAENGINEERING
ANALYTICS& REPORTING
DATASCIENCE
OPERATIONALPROCESSING
Data Analysis Life Cycle - INFINITY LOOP
Demo & what to look for:
DataRobot Demo• Citizen data scientist can build anomaly detection Algorithms• Real-time scoring in Hadoop.
Qlik Demo• Single pane of glass – providing wholistic KYC data at the transaction
& customer level