building and maintaining bulletproof systems with datastax
TRANSCRIPT
Tim Vincent Solution Engineering Team LeadWelcome and Introduction to DSEBuilding and Maintaining Bullet Proof Systems
© DataStax, All Rights Reserved. 3
Feedback
• Please use the Event App to give us your feedback• Everyone who submits feedback will be entered in the prize draw for a UE BOOM 2 by
Ultimate Ears Bluetooth Waterproof Portable Speaker• Winner will be notified via email
© 2015 DataStax, All Rights Reserved.
4
MDM: Customer 360, Product CatalogPersonalization and RecommendationInternet of Things and Time SeriesFraud DetectionList ManagementMessagingInventory ManagementAuthentication
DataStax Use Cases
© DataStax, All Rights Reserved. 5
EpicScale
RealTimeValue
© DataStax, All Rights Reserved. 6
Numerous Endpoints Geographically DistributedContinuous AvailabilityInstantaneously ResponsiveImmediately DecisivePredictably Scalable
Cloud Applications
© 2015 DataStax, All Rights Reserved.
7
Architecture of a Cloud Application
Web App Queue Ingest Operational
Database
© 2015 DataStax, All Rights Reserved.
8
Architecture of a Cloud Application
Web App Queue Ingest Operational
Database
Solr
9
Architecture of a Cloud Application
© 2015 DataStax, All Rights Reserved.
Web App Queue Ingest Operational
Database
Hadoop
Solr
Queue
Hive
Search
Batch Processing
10
Architecture of a Cloud Application
© 2015 DataStax, All Rights Reserved.
Web App Queue Ingest
Spark Streaming
Operational
Database
Hadoop
Solr
Queue
Hive
Search
Batch Processing
© 2015 DataStax, All Rights Reserved.
11
IBM Real-time Analytics Reference Architecture
Source: Explore the advanced analytics platform (http://ibm.co/1PLAneB)
Oracle Real-time Analytics Reference Architecture
Source: Big Data in Financial Services and Banking (http://bit.ly/1GP8mmE)
© 2015 DataStax, All Rights Reserved.
13
Hadoop Real-time Analytics Reference Architecture
Source: Designing Fraud-Detection Architecture That Works Like Your Brain Does (http://bit.ly/1OeAnDb)
© 2015 DataStax, All Rights Reserved.
14
“70% of Hadoop deployments will not meet cost savings and
revenue generation objectives due to skills and integration
challenges.”
Source: Hadoop promises not yet paying off (http://tek.io/1MrHtSx)
© 2015 DataStax, All Rights Reserved.
15
© 2015 DataStax, All Rights Reserved.
16
DSE Real-time Analytics Reference Architecture
HTTP Application Message Queue
Streaming
Analytics
BatchAnalytics
Real-time
• Distributed NoSQL Database• Google Big Table• Amazon Dynamo
• Continuous Availability• Disaster Avoidance
• Linear Scale Performance• Add nodes to scale
• Runs on Commodity Hardware• Cloud or on Premise
San Francisco
New York
London
Under Pinned by Apache Cassandra
18
BatchAnalytics
Indexing& Search
StreamingAnalytics
Graph
DSE Integrated Multi-Model Platform
© 2015 DataStax, All Rights Reserved.
© DataStax, All Rights Reserved. 19
DataStax Enterprise Added Value
© 2015 DataStax, All Rights Reserved.
20
OpsCenterDrag picture to placeholder or click icon to add• Monitoring
• Provisioning• Management Services
• Backup/Restore• Capacity Planning• Performance • Best Practices
21
Netflix Ensures Constant Uptime with DataStax EnterpriseWorld’s leading streaming media provider with digital revenue $1.5BN+95% of all Netflix data stored in DSEIntroduction of ‘Profiles’ drove throughput to over 10M transactions per secondDoes 1 trillion transactions/day with DSEReplaced Oracle in six data centers, worldwide, 100% in the cloud
© DataStax, All Rights Reserved. 23
EpicScale
RealTimeValue
© 2015 DataStax, All Rights Reserved. 24
Build Real Time Value Live Search and Indexing Streaming and Batch Analytics Advanced Replication
© 2015 DataStax, All Rights Reserved. 25
Operate at Scale OpsCenter Security and Auditing Services and Best Practices
© DataStax, All Rights Reserved. 26
DataStax Enterprise is the database for cloud applications.