planet os: indexing the real world (a lecture at the stanford engineering school)
TRANSCRIPT
Rainer Sternfeld, CE September 2014
Indexing the real world
March 2, 2015
Stanford School of Engineering Rainer Sternfeld, CEO of Planet OS
@planet_os@rsternfeld
2 March 2015
Sensor Data Discovery EngineOcean Data Management
From a small buoy to Big Data
Data BuoysMarket: $2 billion
Competitors: 100+ producers Scalability: poor to limited
2008 2012 2014
Market: $5 billion Competitors: 25+
Scalability: good but slow
Market: $100+ billion Competitors: 15+
Scalability: very scalable and fast
3 March 2015
Sensor Data Discovery EngineOcean Data Management
From a small buoy to Big Data
Market: $2 billion Competitors: 100+ producers
Scalability: poor to limited
2008 2012 2014
Market: $5 billion Competitors: 25+
Scalability: good but slow
Market: $100+ billion Competitors: 15+
Scalability: very scalable and fast
80% 80% time wasted on arbitrary tasks
expansion of economic activity
growth of sensor data volumes
time wasted on arbitrary tasks
spatio-temporal data is complex
real-time becoming the expected
sensor data too big to move
NOW
data-driven economies
sensor data outgrowing social
vs
4D
Data Buoys
4 March 2015
Have you ever thought: When did weather forecasting
become unreliable?
6 March 2015
And when did it start to be awesome?
7 March 2015
Surfline Hyperlocal surf weather forecasting
8 March 2015
Forecast.io (Dark Sky) Hyperlocal weather forecasting
9 March 2015
Weather Underground Crowdsourced data collection
10 March 2015
Have you ever thought: What is the operational root cause of oil spills?
11 March 2015
12 March 2015
Sensor data will outgrow
social data in 2 yearsSensor data is
too big to moveData Management
will not scale as we know it
Oil & Gas is swimming in sensors, drowning in data
13 March 2015
• Contextual data streams across sources • SCADA • Weather and environmental data • Drones and other robotic measurement platforms • Satellite imagery
• 3D Common Operating Picture • Full software integration for centralized access to data • Event notifications
USE CASES
More data needs powerful tools. Increase the data fluency of your operations.
14 March 2015
Hewlett Packard: “By 2020, 40% of all data
ever collected by human kind will be generated by sensors.”
15 March 2015
Case #1: NOAA Real-time weather and climate data + forecasts
They are working hard on a challenge presented by:
• Tens of thousands of devices deployed in the ocean, on land, and space
• Tens of terabytes coming in every day
• 700 scattered “web services” (FTPs, flat files, Threads servers, no APIs)
• Breaking connections (all.the.time.)
• 25,000 employees
• Critical data for the government, the industry, and citizens
What if all this data would be easily discoverable and machine-readable?
16 March 2015
Example to case #1: Marinexplore.org 40,000+ data streams from 33 organizations of open data
Advanced Data Discovery Raster data / heat map overlays Access with third party applications
Raster data / quiver plots Graph Monitor Build custom datasets
17 March 2015
Example to Case #2: Bravante Helping to deliver offshore data reports 80% faster
Problems and challenges:
• How to disseminate information to 5 end-customers onshore in parallel?
• How to engage specialists and mangers with the same tool?
• How not to change anything in the equipment on the vessel?
• How to improve speed and quality of the environmental baseline
surveys?
What if all this data would be available in the cloud?
18 March 2015
R/V Jean Charcot
Interactive reporting
Case #2: Bravante Helping to deliver offshore data reports 80% faster
19 March 2015
Consolidate dataflows, organize and make sense of your data
Access your data with 3rd party tools and systems
One interface to search and discover your local and remote data
Securely exchange, acquire or sell datasets
Build advanced domain specific solutions without hassle
Industrial IoT Platform for Real-World Sensor Networks designed for ocean, land, air and space data
20 March 2015
Map of all devices on the Internet
August 2, 2014
21 March 2015
Robotic ocean-borne sensor platforms
increase productivity
LIQUID ROBOTICS WAVE GLIDER
22 March 2015
A decade of growth in marine acoustics sensor data
summer year-round
2004 2014
2K 400Kn < 10 n > 10002D 4D6 weeks 6 months
sample rate# of sensorsdimensionstime spanactivity
PGS SURVEY VESSEL, 12KM STREAMERS
23 March 2015
Satellites are getting smaller and cheaper.
150 launched since 2011 (3x of the market estimate)
SPIRE, A SAN FRANCISCO STARTUP BUILDING NON-IMAGING LOW-ORBIT NANOSATELLITES USING RF SENSORS
24 March 2015
Unmanned vehicles are estimated to grow 10x in 10 years
Image Credit: Northrop Grumman
25 March 2015
Precision Agriculture is a $3.7 trillion market
Image Credit: http://iphonedroneimagery.com/
26 March 2015
Traditional Data Value Chain is Missing Data Exchange
SATELLITES DRONES CARS BUOYS OIL PLATFORMS SHIPS TRACTORS LIGHTING
PHYSICAL CHEMICAL BIOLOGICAL OPTICAL NON-OPTICAL (RF)
TIME-SERIES RASTER ARRAYS VECTORS SEISMIC VIDEO ACOUSTIC
QA/QA OUTLIER DETECTION MODELING DATA FUSION DATA LOGISTICS VISUALIZATION ENHANCEMENT DERIVATIVES
HARDWARE SENSORS RAW DATA SOFTWARE ANALYTICS
CUSTOMER APPLICATIONS
ENERGY WEATHER AGRICULTURE TRANSPORTATION INSURANCE TELECOMMS LIGHTING HEALTHCARE
DATA EXCHANGE LIVES HERE
27
Index the real world