optimising ecommerce with machine learning & game theory — cassandra, elasticsearch and spark
TRANSCRIPT
![Page 1: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/1.jpg)
Optimising ExperiencesMachine learning, Cassandra,
Elasticsearch and Spark
Joe Chittenden-VealJamie Turner
![Page 2: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/2.jpg)
You won’t have heard of us but you will have used us!
5.5bn, 1500tps, 15m
![Page 3: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/3.jpg)
ExperienceUltimate differentiator
Hard to scaleHard to maintain
Expensive
![Page 4: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/4.jpg)
Tin v SkinCost
CapacityConsistency
ContextCoverageCompassion
![Page 5: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/5.jpg)
TriggarInternal projectTraditional stack
Small dataExternal potential
![Page 6: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/6.jpg)
Sensors
![Page 7: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/7.jpg)
Games
![Page 8: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/8.jpg)
Interventions
![Page 9: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/9.jpg)
Problem
Volume Velocity Variety
![Page 10: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/10.jpg)
Options
CouchDB, Riak, Redis, Hbase, CouchBase, Neo4j, Dynamo, XAP, Aerospike, BigTable,
Keyspace, LevelDB, Accumulo…
MySQLMongoDBCassandra
![Page 11: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/11.jpg)
Research.NET friendly?Test Test TestAsk Ask Ask
![Page 12: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/12.jpg)
We help organisations become more data driven through data science and the adoption of new generation big data
technologies rapidly and at low risk.
Discover, Develop, Deliver, Train, Support
![Page 13: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/13.jpg)
PotentialWhy build the
games manually when we can use
ML?
Why not blend Cassandra’s speed with Elasticsearch?
Why not use Spark and Spark
Streaming over Hadoop?
![Page 14: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/14.jpg)
SolutionCassandra
ElasticsearchSpark.NET
![Page 15: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/15.jpg)
![Page 16: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/16.jpg)
Final thoughtsWe’ve been spoilt
Real engineering choicesBig impact
![Page 17: Optimising eCommerce with Machine Learning & Game Theory — Cassandra, Elasticsearch and Spark](https://reader031.vdocuments.site/reader031/viewer/2022030317/586f76741a28ab10258b645b/html5/thumbnails/17.jpg)
Thanks for listening!