advanced analytics for the internet of things. restocking rental bike stations

36
Copyright © 2015 KNIME.com AG Advanced Analytics for the Internet of Things Rosaria Silipo, Phil Winters, Aaron Hart KNIME.com AG [email protected]

Upload: knimeslides

Post on 09-Jan-2017

320 views

Category:

Data & Analytics


2 download

TRANSCRIPT

Page 1: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Advanced Analytics forthe Internet of ThingsRosaria Silipo, Phil Winters, Aaron HartKNIME.com AG

[email protected]

Page 2: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

IoT

2

Household

Energy

Wearables

Health

City

Industry

Page 3: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

The Challenges

• Handling very large amounts of data created over time

• Forcing sensor-equipped objects (house or city) to learn, and therefore to become smarter

Page 4: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

IoT

Illustration by CRISTINA BYVIK

Use Public Data Please….

Energy Consumption PredictionEnergy Profiling

Restocking StrategiesGeo-localizationTraffic Predictions

Anomaly Detection

Page 5: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 6: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

This Use Case

Capital Bikeshare in Washington DC

Page 7: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 8: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Sensors!

Page 9: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

The Business Challenge:

Page 10: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Even MORE of a Business Challenge

• Any Station without bikes for 1 hour:

$XXXX Per Violation

• Any Station with no free slots for 1 hour:

$XXXX Per Violation

Page 11: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AGhttp://bikeportland.org/2013/03/10/behind-the-scenes-of-capital-bikeshare-84006

Capital Bikeshare Response

Over 3 years

307 Stations2963 Bikes19.4% Casual Bikers5.9m Bike Moves

Page 12: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Advanced Analytics for the Internet of Things

Pre-processing Data VisualizationPredictiveAnalytics

Page 13: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 14: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

The KNIME Platform: Open for Innovation

Powerful: Legacy Future Tools

Collaborative: Scientists Analysts

Integrative: Legacy Future Data

Transparent: Existing Future Expertise

Agile: Internal External Wisdom

14

Page 15: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

The KNIME Analytics Platform

15

Page 16: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

From Access to Visualization and Deployment

Page 17: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 18: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Reading all Sensor Data

Page 19: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Topology / Elevations

Weather

Holiday Schedules

Commuters

Enrich

Page 20: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Elevation from Google API

Connecting to Google API and other REST services available on the Web

Page 21: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Expand/Transform

Page 22: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 23: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Station and Bike Facts

Over 3 years

307 Stations2963 Bikes19.4% Casual Bikers

5.9m Bike Moves

Page 24: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Stations: deficits and surpluses

Page 25: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Top 250 Routes

Page 26: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Total Bikers Number per Hour

• Registered (blue) vs. Casual (red) Bikers

Page 27: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Page 28: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

The Goal

• Restocking alert signal

• 1 hour warning! Lag(flag-1)

Page 29: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Input Features

• Weather related features

• Number of registered and casual people showing up

• Station infos (name and max. number of docks)

• Calendar infos (working day, holiday, date)

• Past infos

• Number of bikes added and removed at each hour

• Adjusted cumulative sum = number of bikes available at the station at a given hour

• Bike ratio = adjusted cumulative sum/total docks available

Page 30: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Restocking Alert System

Train

Apply Evaluate

Partition

78% accuracy

Page 31: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Feature Elimination Loop

Two options:

1. Use all the input features (no thinking required, just a powerful machine)

2. Select the most useful input features via the “Feature Elimination” loop

At each step, one input feature is removed - i.e. the input feature whose removal produces the smallest error increase.

Page 32: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Input Attribute Impact

Page 33: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Lean Restocking Alert System

The input feature subset with the smallest error (81% accuracy):

• Hour of the day

• Working day (Y/N)

• Current Bike Ratio

• Terminal (station code)

Past of bike ratio and weather infos do not seem to be relevant!

Is this because most bikers are registered members?

Page 34: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Lessons Learned

• Enrich / Expand

– KNIME Transformations

– REST calls to external sources

• Explore

– Visualization with Open Street Map integration

– Network Analysis (Graph Visualization)

• Prediction

– (Lean) Restocking Alert System

– Weather influence does not seem to be important!

Page 35: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Resources

• KNIME (www.knime.org)• BLOG for news, tips and tricks(www.knime.org/blog)

• FORUM for questions and answers (tech.knime.org/forum)

• EXAMPLE SERVER for example workflows

• LEARNING HUB (www.knime.org/learning-hub)

• KNIME TV channel on

• KNIME on @KNIME

• KNIME on

https://www.facebook.com/KNIMEanalytics

36

Page 36: Advanced analytics for the Internet of Things. Restocking Rental Bike Stations

Copyright © 2015 KNIME.com AG

Where can I find all this?

Slides: http://www.knime.org/files/bicycle_final.pdf

White paper, Workflows, and Data is available on the KNIME web site: http://www.knime.com/white-papers