data analytics: multidisciplinary by design
Post on 09-Jul-2015
137 Views
Preview:
DESCRIPTION
TRANSCRIPT
Nick Clarke
Data analytics:
Multidisciplinary
by Design
October 2014
Translating solutions from other industries
Amsterdam is a city of many bridges
Cross industry analytics technology transfer
Increasing volume and complexity of data
New ways forward can be found in unexpected places
Outside Oil and Gas
Bridging the communication barrier
man to dog
dog to man dog to dog
But when communication is established …
Communication in the workplace
I have a practical problem. Can you
guys help me with it?
I tackle problems in the language of
mathematics. Please translate your problem.
analyst IT
I tackle them in the architectural language of data & information. Please translate your
problem. Both of them.
I just want my problem solved
Analytics is inherently multidisciplinary
Data Handling
Skills
Math & Statistics
Knowledge
Domain Knowledge
Machine Learning
Drew Conway
Data Science
Multidisciplinary structures can work …
chemistry
physics materials engineering
chemistry
physics numerical
computation at scale
nanotechnology quantum chemistry
… but these examples are quite academic
chemistry
physics materials engineering
chemistry
physics numerical
computation at scale
nanotechnology quantum chemistry
Not famous for great communication
chemistry
physics numerical
computation at scale
quantum chemistry
1 Dirac = 1 word per hour
"I was taught at school never to start a
sentence without knowing the end of it."
Chris Toumazou
Institute of
biomedical engineering
electronics engineering
mechanical engineering medicine
Chris Toumazou
Institute of
biomedical engineering
cochlear implants
Chris Toumazou
Institute of
biomedical engineering
artificial pancreas
Chris Toumazou
Institute of
biomedical engineering
digital band-aid heart monitor
Chris Toumazou
Institute of
biomedical engineering
DNA mutation detection on a stick
Chris Toumazou
Institute of
biomedical engineering
DNA mutation detection on a stick
Medicine Digital Pathology
Security Feature Recognition
Consumer Animal Coat Condition
Oil & Gas Drill Bit Condition Assessment?
Camera data: Automated image analysis
Sensor data: detection, tracking, prediction
Type 45 destroyer Sampson radar
Military radar has come a long way
highly irectional
Military radar has come a long way
highly irectional
Military radar has come a long way
noisy data
multiple targets simultaneously
highly directional
Rapid hypothesis testing
• Is it real?
• Is it friendly?
• What direction is it going in?
• What’s the risk?
Our really clever 3-stage iterative process
Target extraction
– Bayesian filtering
– De-clutter data
– Type classification
Target tracking
– Optimal association
– Maximum likelihood
Target extrapolation
– Kalman filters
– Optimal fusion of
empirical data with
predictive model
Our really clever 3-stage iterative process
Target extraction
– Bayesian filtering
– De-clutter data
– Type classification
Target tracking
– Optimal association
– Maximum likelihood
Target extrapolation
– Kalman filters
– Optimal fusion of
empirical data with
predictive model
What does all that mean to me?
Target extraction
– Bayesian filtering
– De-clutter data
– Type classification
Target tracking
– Optimal association
– Maximum likelihood
Target extrapolation
– Kalman filters
– Optimal fusion of
empirical data with
predictive model
We can identify hard to find features, in messy data typical of real world problems
Once found we keep hold of those features, even in a fast changing environment
We combine multiple sources of information turn current knowledge into the best possible future predictions
What does all that mean to me?
Target extraction
– Bayesian filtering
– De-clutter data
– Type classification
Target tracking
– Optimal association
– Maximum likelihood
Target extrapolation
– Kalman filters
– Optimal fusion of
empirical data with
predictive model
We can identify hard to find features, in messy data typical of real world problems
Once found we keep hold of those features, even in a fast changing environment
We combine multiple sources of information turn current knowledge into the best possible future predictions
Radar threat identification and tracking Nerve pain signal transmission
Automated assessment of hair regrowth
Analytics transfer in action
Novel seismic data reduction techniques?
Gear Changes Audio Analytics
Video image Analytics
Circuit Topology
Data fusion of audio and video
LWD and MWD rig telemetry data • Noise reduction • Filter out and track key features of interest • Predict and test for future operational states
Data fusion of logging data?
Data Handling
Skills
Analytics: Multidisciplinary by design
Domain Knowledge
Math & Statistics
Knowledge
Machine Learning
Data Science
Making the bridges invisible
top related