USING BIG DATA AND OPEN SOURCE FOR SMART CITY PLANNINGGUY HADASH, PAULA TA-SHMA

BIG DATA-IOT

The IoT market will grow to $1.7 trillion in 2020 (IDC)

Sens

ors

(Inter

net o

f Thin

gs)

VoIPSocial Media

(video, audio and text)

Enterprise Data

By 2020 the number of networked devices will be 30 billion (IDC), more than 4 times the entire global population

2005 2012 2017

WE DON’T KNOW HOW TO USE IT

So much data, that we don’t know how to make sense of it• We archive as much data as we can• In order to get value from that data we need to process it• Not as easy as it seems

Cultivate Resilient Smart Objects for Sustainable City Applications

EU funded project for developing smart-city infrastructure

USE CASE – MADRID TRANSPORTATION

Many sensors, a lot of data

MONITORING TRAFFIC IN MADRID TODAY

Uses only current datain the old-fashioned way

WHAT WE DIDWe analysed data from 300 sensors on a specific highway.

We developed a POC for Madrid Council in order to show how to learn from the historical data, in order to optimize the way it handles online data.

We created dashboard which handles some of the sensors.

It monitors the traffic speed and intensity (vehicles per hour).

Using results of an ML algorithm applied to the historical data, the system decides if anything is wrong and reports it using the dashboard.

OUR SOLUTION

HOW WE DID IT

SWIFTMLLib & SQL

Secor

SwiftObject Store

Freeboard DashboardSeco

rMQTT Broker

Data Sources

Apache Spark

Node-RED

SecorCEP

CEP

Message Bus

Data Storage

Data Transformati

onData

AnalyticsData

Visualization

Freeboard Dashboard

Object Storage

Message Hub

10THE FLOW & BLUEMIX

POSSIBLE FUTURE PLANS• Calculate “bottle necks” using historical data, and use that data when

planning new roads• Predict the correlation of traffic with other data sources (such as weather

data)• Help Madrid Council make the processed historical data available through

an external API• Re-route public transportation automatically when special events

happens• Etc…