webinar - the 360-degree approach to managing a data lake
TRANSCRIPT
Webinar: The 360-Degree Approach to Managing a Data Lake
August 31, 2016
Zaloni Confidential and Proprietary - Provided under NDA
• Award-winning provider of enterprise data lake management solutions:
Integrated data lake management platform
Self-service data preparation
• Data Lake Design and Implementation Services: POC, Pilot, Production, Operations, Training
• Data Science Professional Services
Delivering on the business of big data
Financed by top-tier technology investors:
Zaloni Confidential and Proprietary - Provided under NDA
Meet today’s speakers
Adam Diaz, Director of Field Engineering, Zaloni
Adam is a long time technologist working in the software industry for roughly twenty years. He manages the day to day operations of the Zaloni Field Engineering team responsible for product technical support of sales, marketing and partnership activities.
Kelly Hopkins Schupp, VP, Data-driven Marketing, Zaloni
Kelly has 20 years of experience in the enterprise software and technology industry. She serves as Zaloni’s brand steward and is deeply passionate about the impact of data-driven marketing on businesses today.
Zaloni Confidential and Proprietary - Provided under NDA
Increased Agility
New Insights
Improved Scalability
Data lakes are central to the modern data architecture
Zaloni Confidential and Proprietary - Provided under NDA
Data lake – the challenges and the solution
• Ingestion
• Lack of Visibility
• Privacy and Compliance
• Quality Issues
• Reliance on IT
• Reusability
• Rate of Change
• Skills Gap
• Complexity
Managing: Delivering:
Govern the data in the lake
• Cleanse• Secure
• Operationalize
Enable the data lake • Ingest
• Organize• Catalog
Building:
Engage the business• Discover
• Enrich• Provision
Zaloni Confidential and Proprietary - Provided under NDA
• Leverage the full power of a scale-out architecture with an actionable, scalable data lake
Data Lake 360 ° : Zaloni’s holistic approach to actionable big data
1. Enable the lake
2. Govern the data
• Improve data visibility, reliability and quality to reduce time-to-insight
3. Engage the business
• Safeguard sensitive data and enable regulatory compliance
• Foster a data-driven business through self-service data discovery and preparation
Zaloni Confidential and Proprietary - Provided under NDA
Data lake reference architectureConsumptio
n ZoneSource System
File Data
DB Data
ETL Extracts
Streaming
TransientLoading
Zone
Raw Data Refined Data
Trusted Data
DiscoverySandbox
Original unaltered
data attributes
Tokenized Data
APIs
Reference Data Master Data
Data WranglingData DiscoveryExploratory Analytics
Metadata Data Quality Data Catalog Security
Data Lake
Integrate to common formatData ValidationData CleansingAggregationsOLTP or ODS
Enterprise Data
Warehouse
Logs(or other unstructured
data)
Cloud Services
Business AnalystsResearchersData Scientists
Zaloni Confidential and Proprietary - Provided under NDA
Ingest Organize Enrich Engage
• Managed ingestion• Metadata
management• Data lineage
• Data quality
• Data privacy and security
• Data lifecycle management
• Data catalog• Self-service
data preparation
Manage the complete data pipeline
Zaloni Confidential and Proprietary - Provided under NDA
Multiple cluster management with Bedrock
Single management console for Ground and
Cloud Hadoop management
Bedrock Workflow Executors
Bedrock Data Collectors
Persistent Cluster Metadata Data Quality
Data Catalo
gSecurity
Files Streams
9
Object Stores
Bedrock Data Management
Transient Cluster
Zaloni Confidential and Proprietary - Provided under NDA
Demo
Zaloni Confidential and Proprietary
Challenge: To develop a multi-vendor loyalty program required gathering information from a wide variety of sources, bring it all into a unified platform, and give marketers access to the data for customer targeting.Solution: Zaloni built a data lake to house all customer data, as well as an interactive visualization platform that enabled marketers to profile customers on selection (based on demographics, geography, etc.) for analysis.
Zaloni Enables 360˚ Customer View For Effective Loyalty Program
GLOBAL CREDIT CARD ISSUER Industry: Financial ServicesCompany Description: Global credit card issuerTechnical Use Case: Data Lake 360˚ - Agile AnalyticsBusiness Use Case: Customer 360˚ - Behavioral Analytics and Customer Segmentation Big Data Technologies: Zaloni Professional Services, MapR, ElasticsearchDeployment: On premises
Zaloni Confidential and Proprietary - Provided under NDA
At a Glance
1Mcustomer sign-ups 22Musers
collecting data from 1M+hits/day
on the customer
Results
in 3 weeks system
Zaloni Underpins Data Platform for News and Entertainment Network
MEDIA & ENTERTAINMENT COMPANYIndustry: Media and
EntertainmentCompany Description: News and Entertainment Network Technical Use Case: Data Lake 360˚: Agile Analytics, Data Discovery PortalBusiness Use Case: Improve Customer Experience, Drive Dynamic Ad PricingBig Data Technologies: Bedrock, Mica, Pivotal, Spark, Hive, MapReduceDeployment: On premises
Zaloni Confidential and Proprietary - Provided under NDA
At a Glance
Challenge: The company needed a data platform for advertising analytics and audience measurement in order to drive dynamic pricing and various other use cases during key sporting event-based entertainment broadcasting.Solution: Zaloni Bedrock and Mica were used to create an enterprise-wide data lake for managed ingestion of multiple data sources, standardization and consumption using a scale out Hadoop platform.
310%MORE DATAPROCESSED
220%IMPROVEMENT
in performance
Results
0 DAYSDATA DELIVERY
MISSED
9.5BAD CLICKRECORDS
processed in 17 days
Zaloni Confidential and Proprietary - Provided under NDA
Wherever you are in your journey, we can help….
Products & Solutions: Data Lake 360°
White Paper Bedrock Overview Mica Overview
To Learn More:
[email protected] Contact Us Form 919-323-4050 x7085
Custom & Packaged Services: Readiness
Assessments Quick Starts Custom
implementations