Upload File

predicting behaviour with machine learning

16
Predicting Behaviour Elasticsearch, Cassandra, Machine learning, and Spark Jamie Turner @pcajamie

Upload: pca-predict-formerly-postcode-anywhere

Post on 15-Feb-2017

492 views

Category:

Technology


7 download

Report

TRANSCRIPT

Page 1: Predicting behaviour with Machine Learning

Predicting BehaviourElasticsearch, Cassandra,

Machine learning, and Spark

Jamie Turner@pcajamie

Page 2: Predicting behaviour with Machine Learning

You won’t have heard of us but you will have used us!

5.5bn, 1500tps, 15m

Page 3: Predicting behaviour with Machine Learning

Search + ServiceHard to scale

Hard to maintainExpensive

Page 4: Predicting behaviour with Machine Learning

Tin v SkinCost

CapacityConsistency

ContextCoverageConscious

Page 5: Predicting behaviour with Machine Learning

TriggarInternal

Traditional stackSmall data

#scale #fail

Page 6: Predicting behaviour with Machine Learning

Sensors Analyse

Page 7: Predicting behaviour with Machine Learning

Games Predict

Page 8: Predicting behaviour with Machine Learning

Interventions Improve

Page 9: Predicting behaviour with Machine Learning

Problem

Volume Velocity Variety

Page 10: Predicting behaviour with Machine Learning

Research.NET friendly?

FlexibleDurable, Scalable, Reliable

Page 11: Predicting behaviour with Machine Learning

Options

CouchDB, Riak, Redis, Hbase, CouchBase, Neo4j, Dynamo, XAP, Aerospike, BigTable,

Keyspace, LevelDB, Accumulo…

MySQLMongoDBCassandra

Page 12: Predicting behaviour with Machine Learning

SolutionElasticsearch

CassandraSpark.NET

Page 13: Predicting behaviour with Machine Learning
Page 14: Predicting behaviour with Machine Learning
Page 15: Predicting behaviour with Machine Learning

Elasticsearch – what we loveIt works!

Super ExpressiveNESTAggs

Page 16: Predicting behaviour with Machine Learning

Thanks for listening!


Machine learning methods for predicting progression from

Sensing and predicting human behaviour - Ordem dos Engenheiros · Suzy Moat Data Science Lab Warwick Business School Sensing and predicting human behaviour using online data @suzymoat

An Analytical Model for Predicting the Behaviour of ... · Abstract An Analytical Model for Predicting the Behaviour of Laterally Restrained Reinforced Concrete Beams Rami G. Mansour

PREDICTING THE BEHAVIOUR OF EXTENDED END PLATE …civil.utm.my/ethesis/files/MASTERS/DSM/S09/Predicting-The-Behaviour-Of...PREDICTING THE BEHAVIOUR OF EXTENDED END PLATE CONNECTIONS

Predicting farmer decision behaviour, taking a planning new

Machine learning models predicting multidrug resistant

An approach for predicting the internal behaviour of ball

Predicting Consumer Behaviour via Hadoop

Predicting the behaviour of water distribution networks ... - Predicting... · to use machine learning to meta-model a water distribution, eliminating the need to use a simulation

ML-Based Feature Importance Estimation for Predicting Unethical Behaviour … · 2019. 8. 13. · ML-Based Feature Importance Estimation for Predicting Unethical Behaviour under Pressure

Machine learning for predicting thermal power consumption

Predicting Boiler Trips with Machine Learning

PREDICTING SAND BEHAVIOUR USING A STATE PARAMETER …

PREDICTING BANKRUPTCY USING MACHINE LEARNING ALGORITHMS

Measuring and predicting human behaviour …cfe.columbia.edu/.../TobiasPreis_Columbia_Mar2015.pdfMeasuring and predicting human behaviour using online data The big data explosion A

#5 Predicting Machine Translation Quality

Predicting Smoking Behaviour Among Pregnant Smokers Using

Predicting Answering Behaviour in Online Question Answering Communities

Predicting customer behaviour · 2019-07-17 · Predicting customer behaviour Customer Engagement Transformation 2019. The relationship between loyalty and evangelism Predicting customer

Predicting online user behaviour using deep learning algorithms

Lawson, Glyn (2011) Predicting human behaviour in ...eprints.nottingham.ac.uk/12027/1/G_Lawson.pdf · PREDICTING HUMAN BEHAVIOUR IN EMERGENCIES GLYN LAWSON, BSc(Hons) MSc MIEHF AHEA

Predicting and simulating complex software systems behaviour

Predicting collective behaviour at the Hajj: place, space ... · Predicting collective behaviour at the Hajj: place, space and the process of cooperation ... Around 2 million pilgrims

Socci Trading: Predicting Stock Market Behaviour using ...ziyadmir.com/socci.pdf · Socci Trading: Predicting Stock Market Behaviour using Twitter Sentiment Systems Design Engineering

Predicting VIX with Adaptive Machine Learning

Predicting Switching Behaviour of e-Service Users toward m

Understanding Rating Behaviour and Predicting Ratings by … · 2015. 11. 29. · Understanding Rating Behaviour and Predicting Ratings by Identifying Representative Users Rahul Kamath

Predicting The Performance Of Virtual Machine Migration

Machine learning algorithms for predicting the amplitude ... · Machine learning algorithms for predicting the amplitude of chaotic laser pulses Machine learning algorithms for predicting

Predicting the Highway Costs Index with Machine …cnas.tamu.edu/Index/Predicting the Highway Costs Index...Predicting the Highway Costs Index with Machine Learning Samir Huseynov

Man vs. Machine in Predicting Successful Entrepreneursdocuments.worldbank.org/curated/en/968231513116778571/pdf/WPS8271.pdfMan vs. Machine in Predicting Successful Entrepreneurs

Machine Learning for Predicting Properties of Silicon

Eulerian and Lagrangian approaches for predicting the behaviour

Predicting Performance and Scaling Behaviour in a Data

Predicting the dynamic behaviour of hydrobushingsdownloads.hindawi.com/journals/sv/2005/748498.pdf · 2019-08-01 · 94 N. Gil-Negrete et al. / Predicting the dynamic behaviour of