snap4city platform: from cloud to data analytics as …...smart city solutions dialogue, stuttgart,...

30
Snap4City, Antwerp, 21st August 2019 1 LIVING LAB Snap4City platform: from cloud to data analytics as a Living Lab for city stakeholders Nicola Mitolo, Snap4City – DISIT Lab

Upload: others

Post on 20-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, Antwerp, 21st August 2019 1

LIVING LAB

Snap4City platform: from cloud to data analytics as a Living Lab for city stakeholders

Nicola Mitolo, Snap4City – DISIT Lab

Page 2: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, Antwerp, 21st August 2019 2

Title

Nicola Mitolo, [email protected]://www.Km4City.org ‐ https://www.disit.org

https://www.snap4City.orgPowered by

Snap4City platform:From cloud to data analytics as a Living Lab for city stakeholders

Page 3: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Living Lab Flexibility• Multiple modalities to perform the same activities

• Tuned for Beginners and Skilled people• Visual interface and programming tools• Resources and artefacts sharing for learn acceleration and co‐working

• Open Living and co‐working Portal: https://www.Snap4City.org

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3

Snap4City Satisfies all Requirements  of ENOLLSelect4Cities and EIP‐SCC

Page 4: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, Antwerp, 21st August 2019 4

architettura

BIG DATA ANALYTICS: AI, MACHINE  LEARNING

Page 5: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Standards and Interoperability

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 5

Compliant with: AMQP, COAP, MQTT, OneM2M, HTTP, HTTPS, Rest Call, SMTP, TCP, UDP, NGSI, LoraWan, TheThingsNetwork, SigFOX, DATEX II, SOAP, WSDL, Twitter, FaceBook, Telegram, SMS, OLAP, MySQL, Mongo, HBASE, SOLR, SPARQL, EMAIL, FTP, FTPS, WebSocket, WebSocket Secure, ModBUS, OPC, RS485, WFS, WMS, ODBC, JDBC, Elastic Search, Phoenix, XML, JSON, GeoJSON, Enfuser FMI, Android, Raspberry Pi, Local File System, ESP32, Libelium, IBIMET, OBD2, etc.

Page 6: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 6

Knowledge baseSemantic reasoners

Data SourcesPULL Data

Data Sources, Brokers, External ServicesData 

Driven, Real Time

Data Ingestion, aggregation, regularization, 

reconcile

ETL, NIFI, DISCES

Big Data ClusterHDFS, Hbase, Phoenix Search and 

Query, Smart City APIFacet, semantic 

search Indexing and aggregatingElastic search

Data AnalyticsR, Tensor Flow, Python, MapReduce, …

Visual AnalyticsSpecial dash/tools

RenderingActing, Widgets, MicroApps

User interface,Interactive Dashboard,Drill down, 

maps,heatmaps

Inform, announce, Act!, warning, alarms, What‐IF, ..

IOT ApplicationsNode‐RED + Snap4City MicroSrvs

The Lambda Architecture for Smart Cities

Page 7: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 7

Sentient SolutionsDashboards with IOT Applications for enforcing data driven smart and intelligence

Dashboards and AppsIOT and City data World IOT Applications

My IOT Devices Big Data Analytics, Artificial Intelligence

Page 8: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

City Dashboard + IOT AppControl Room OperatorWould like to:‐ Monitor traffic flow, 

Environment, Car parking, Cycling, First aid, temp., …

‐ Act and monitor Dynamic Plates

‐ Act and monitor red lights

Driver, PolicemanWould like to:‐ Monitor traffic, Parking, 

env., speed limit, …‐ Act and monitor red lights

Page 9: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 9

Integrated Urban Platform• Produce value from data supporting Living lab

– Stimulate virtuous behavior, influence City Users!– Put in action CITY Strategies

• Data Exploitation performing– predictions, reasoning, business intelligence, ..– users behavior analysis, decision support system, ..– Control Room, Real Time Monitoring tools, ….

• Aggregate & integrate data – Multiple protocols from urban operators, ....– open data, IOT, sensors, internet of everything, cloud, mobile devices, Wi‐Fi, social media, ...

Page 10: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, February 2019 10

DASHBOARDS: FROM CITY DASHBOARD

TO APPLICATIONS

Page 11: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Dashboards List

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 11

Page 12: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

12SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MjE5MA==#

Page 13: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, Antwerp, 21st August 2019 13SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTQwNg==

Page 14: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, Antwerp, 21st August 2019 14SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTQwNw==

Page 15: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City, February 2019 15

FORGING & MANAGINGFLEXIBLE MOBILE APPS, Web Apps and MicroApplications

Page 16: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 16

Page 17: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Mobile App Features• Discovery POI/services• Search: POI, streets, suggestions• Mobility and transport: Pub/priv, routing, car position, 

time table, park, sharing, tickets, etc.• Environment and Weather: values, sensors, heatmaps, 

notifications• Assistant, Forum, Developer Assistant• Goal Experiences (Engagement)• Personal data, activities, POI, tracking, IOT App, 

Dashboards, etc.• Events: entertainment, critical• Sharing position and trajectories with friends• Monitoring city and personal Dashboards• Personalized for Operators and Developers full control of 

their applications on cloud

Snap4City (C), June 2019 17

Page 18: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

DATA ANALYTICS,Big Data Science

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 18

Page 19: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 19

City official 

ICT official 

Developer 

Citizen, tourist, visitor

Business owner

City officials

City officials Domain experts

City officials City developers

Third party developers

Citizen

Citizens with respiratory problems

Tourists

Business owners

Mobile

MIcroApplication

Tool, via Portal (ICT Developers)

Dashboards

Main Data Sources

Discovery near to me X X X X X X X X X X X X X X X POI, OSMDiscovery along a path X X X X X X X X X X X X POI, OSMDiscovery in an area, shape X X X X x X X X X X X X x X X POI, OSMbrowsing Public Transport X X X X x X X X X X X X x X X OSM, GTFSFull Text search X X X X X X X X X X X X X X POI, OSMRouting: pedestrian X x X X X X X x X X OSMRouting: pedestrian quite X x X X X X X x X X OSMRouting: private vehicles X X X X X X X X X X X OSMRouting: Multimodal Public Transport X X X X X X X X OSM, GTFSheatmaps: weather (Temp, Humidity) X X X X X X X X X X X X X Sensors data, OSMheatmaps: environmental variables, PM10, PM2.5, NO2, EAQI X X X X X X X X X X X X X Sensors data, OSMheatmaps: environmental variables, Noise X X X X X X X X X Sensors data, OSMheatmaps: safe on bike (Antwerp) X X X X X X Spec. Portalheatmaps: Enfuser prediction, PM10, PM2.5, AQI X X X X X X X X X Enfuser dataheatmaps piking values any place X X X X X X X X X Computed Heatmpsheatmaps: GRAL prediction, PM10 X X X X X X X X X OSM, Traffic, WeatherComparsison: Enfuser, Gral, Real Time X X X Enfuser, Sensors, GRALSensors Data Time Trends, & drill down X X X X X X X X X X Sensors data, OSMWeather Forecast X X X X X X X X X X X X X Forecast ServiceOrigin Destination Matrices X X X X X X X X X X Snap4City Mobile AppTypical trajectories X X X X X X X X X X X X Snap4City Mobile AppHot Area in the city X X X X X X X X X X X X X X X X Snap4City Mobile AppHot Places in Smart Zone X X X X X X X X Snap4City PAXcountersServices Suggestions on mobiles X X X X X X Snap4City Mobile AppAlerts on critical cases: several variables X X X X X X X X X Sensors data, OSMThe most used services X X X X X X X X X Snap4City Mobile AppTwitter Trends Daily X X X X X X X X X X X Twitter VigilanceThe auditing of user and living lab X X X X Snap4City PortalSelf assessment X X X X X X X X X X X X X X Snap4City Portal

Antwerp Helsinki Where

Page 20: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

PredictingModels for Administrators & City Users

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

• Aiming at improving – quality of service, distributing workload – early warning

• Data Analytics: Machine Learning, Natural Language Processing, Sentiment Analysis, …

• Parking Prediction: Short (next 15 min, 30 Min) and Mid Term (1 week) Predicting at EXPO2015

Early Warning Water Bomb

Early Warning Hot in Tuscany

Predicting City Users on Areas

20

12 parking areas in Florence

Page 21: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

User Behaviour Analysis

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019

• Monitoring movements by traffic flow sensors– Spires and virtual spires (cameras)

• Monitoring movements from Mobile Cells– Unsuitable for precise tracking and OD production

• Monitoring movements from Wi‐Fi• Monitoring movements and much more from mobile Apps

21

Page 22: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 22

https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTc2MQ==https://www.snap4city.org/dashboardSmartCity/view/index.php?iddasboard=MTc2MQ==

Page 23: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 23

http://firenzetraffic.km4city.org/newSensors.html

real time

Page 24: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019

Prediction and Identification of Anomalies

Cluster confidence

AP average and confidence

Actual AP trend for today

AP prediction for the next time slot in the day on the basis of past weeks

Guessing number of users of Wi‐Fi Access Points

24

Predictive precision of the 95%

Page 25: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 25

Data Analytics: Heatmaps• Over the Gaussian Heatmaps• Calibrated heatmaps on the basis of Interpolated data for:– From 200x200 to 4x4 mt– PM10, PM2.5, SO2, NO2, Noise, NO, O3, Enfuser, GRAL,….– Any programmed Color map– Animations over H24– Picking values in any place, values on their position.– On Web and Mobile App

Page 26: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 26

Environmental Data Predictions: GRAL• GRAL predictions: PM10, NOX, ….

– Comparison wrt real time values in actual value of Sensors

– Graz Lagrangian Model. • GRAL model takes into account: 

– pollution sources (for example the vehicles, their distribution on the streets, the about of pollution they produce according to their distribution over time and space, etc.), 

– structure of the city (streets and shape 3D of the buildings), 

– weather forecast (wind intensity and direction), etc. 

• GRAL can be applied on NOX, PM10, PM2.5, … or any other particles

Page 27: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SNAP4CITY LIVING LABFOR COLLABORATIVE WORK

Snap4City (C), June 2019 27

Page 28: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 28

Your Level

SLIDES

NewsFlyer

Exercises

Full Search

All Tools

Personalized Suggestions

Page 29: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 29

Main Projects/Pilots, 2019• Sii‐Mobility mobility and transport• REPLICATE  Control Room: ICT, Energy, IOT• RESOLUTE  Resilience, ICT, Big Data• GHOST  strategies, smart city• TRAFAIR  environment & transport• MOSAIC mobility and transport• WEEE Life  waste, environment• Smart Garda Lake  Smart city, environment• 5G  Industry 4.0 vs SmartCity, water management• Green Impact  Industry 4.0, chemical plant• PISA Agreement  data aggregation, smart city• Lonato City  data aggregator, smart reasoning• SmartBed health monitoring

Green Impact

Page 30: Snap4City platform: from cloud to data analytics as …...SMART CITY SOLUTIONS DIALOGUE, Stuttgart, 18 September 2019 3 Snap4City Satisfies all Requirements of ENOLL Select4Cities

Snap4City (C), June 2019 30

Be smart in a SNAP!

Nicola Mitolo, [email protected]://www.Km4City.org ‐ https://www.disit.org