available data sources & real-time data collection

25
Available data sources & Real-time data collection Jari Silander & Teemu Näykki & Sami Korhonen & Jari Koskiaho & Harri Lauri Arvola & Timo Vesala, HY (10 min talk) Pekko Ilvessalo, FMI Myllyniemi, SYKE Mauno Rönkkö, UEF Timo Toivanen, VTT Hanna Huitu, LUKE Ympäristötiedosta palveluihin –seminaari Vaisala 23.09.2015

Upload: cleenltd

Post on 08-Jan-2017

528 views

Category:

Environment


4 download

TRANSCRIPT

Page 1: Available data sources & Real-time data collection

Available data sources&

Real-time data collectionJari Silander & Teemu Näykki & Sami Korhonen & Jari Koskiaho & Harri

Lauri Arvola & Timo Vesala, HY (10 min talk)Pekko Ilvessalo, FMI

Myllyniemi, SYKEMauno Rönkkö, UEFTimo Toivanen, VTTHanna Huitu, LUKE

Ympäristötiedosta palveluihin –seminaariVaisala 23.09.2015

Page 2: Available data sources & Real-time data collection

MMEA Testbed (19.8.2010)

Page 3: Available data sources & Real-time data collection

Content1. Available data sources

– Participatory sensing– Remote sensing– Automatic station– Forecasts

Use cases

2. Real time data collection– Sensors– Quality control– Data service

Use cases (real time data in use: data, usages,availabilitiy)

3. Conclusion

Page 4: Available data sources & Real-time data collection

Available data sources

• Global http://index.okfn.org/• EU http://open-data.europa.eu/en/data/• USA https://www.data.gov/open-gov/• Worldbank http://data.worldbank.org/• Suomi www.avoindata.fi

Page 5: Available data sources & Real-time data collection

Use case 1: In-situ data in action(MMEA with SYKE Rapa-project(YM), MMEA team effort

Available data sources

Page 6: Available data sources & Real-time data collection

Use case: Hi, what is nutrientloading rigth now?

Real time data collection

Page 7: Available data sources & Real-time data collection

Use case:Hello: What is nutrientloading now? – data system

Page 8: Available data sources & Real-time data collection

Example Environmentof OData• What is Odata?• Why to use Odata?• What formats?• What resources are availble?• What was MMEA role in this?• How to use it?• What is the best practice?

Available data sources

Page 9: Available data sources & Real-time data collection

AVOIN DATA ESIMERKKI SUOMESTA – MISTÄ APUA?Suomi www.avoindata.fi - Suomen ympäristökeskus

http://pivetodatademo.appspot.com/gv3/

Page 10: Available data sources & Real-time data collection

2011 2013 2015

ROADMAP DIY-SENSORDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory

Page 11: Available data sources & Real-time data collection

QUALITY CONTROLDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory

Page 12: Available data sources & Real-time data collection

Use case 2:Lauri Arvola, HY

Available data sources

Page 13: Available data sources & Real-time data collection

The catchment of Vanaja (2700 km2)Met stationAWQM stationHydr stationEDDY stationChemMon station

City ofHämeenlinna

Lammi BiologicalStation,Univ. of Helsinki

Page 14: Available data sources & Real-time data collection

EMMI - System for Environmental MonitoringPowered by Masinotek Ltd

Page 15: Available data sources & Real-time data collection

”Real time data collection”

• In-situ (automatic stations)• Satellite• Radar• Forecasts• Participatory sensing

Page 16: Available data sources & Real-time data collection

Use case 3: Air Quality(Pekko Ilvessalo, FMI)

Available data sources

Page 17: Available data sources & Real-time data collection

Use case 1: Air quality in Helsinki metropolitan areais worsened in the morning. Should people bewarned?

• Air quality observations from Helsinki monitoring stations (open data interface available in beta.fmi.fi:• http://beta.fmi.fi/wfs?request=getFeature&storedQuery_id=urban::observations::airquality::hourly::mu

ltipointcoverage&place=Helsinki)• are showing that nitrogen dioxide concentrations have been raised in the morning. (Observations

coming to open data October 2015).

• Observed temperature and wind profile from mast data in Espoo Kivenlahti available in open data• (http://data.fmi.fi/fmi-apikey/insert-your-apikey-

here/wfs?request=GetFeature&storedquery_id=fmi::observations::weather::mast::multipointcoverage&place=Helsinki&parameters=TA,ws) are monitored in real-time every 10 minutes and atmosphericstability (Richardson number) is calculated.

• Atmosphere is at first very stabile and ground surface inversion seems to be the reason forweakened air quality. Next observations however show that inversion is weakening and air quality isexpected to get better. Warning won’t be given.

Real time data collection

Page 18: Available data sources & Real-time data collection

ECMWF,ECHAM

HIRLAMRCR 0.068

HARMONIE0.022o

AROME,LAPS

Weather predictionmodels

Dispersion models -long-range, regional

Dispersion and effectsmodels – urban, local

FLUENT, CFD code

SILAM LRT,meso, radioactivity

Modelling system - FMI

OSPM (NERI), streetcanyon

UDM-FMI, urban

CAR-FMI, roadside

HILATARLRT, meso

Aerosol process models:UHMA (U Helsinki, FMI)

MONO32 (U Helsinki, Stadia)

MPP-FMI, Meteorologicalpre-processing model

ESCAPE, chemicalaccidents

BUOYANT, fires

EXPAND (FMI, YTV)population exposure

Meteorologicalmeasurements

Page 19: Available data sources & Real-time data collection

Use case: Satellite data, MMEA-teamwork

Available data sources

Page 20: Available data sources & Real-time data collection

Satellite Data Centre, developed e.g. underCleen/MMEA

SYKE will adapt its snow mapping method to new satellite sensors andwill operate the service via direct connection to the Satellite Data Centrecomputing facilities. The data delivery through Standard Data interfacecontinues, to enable different web&desktop GIS-applications.

OPEN DATA• OGC standards compliant interfaces• Web Coverage Service (WCS)• Web Map Service (WMS)• Data is browsable using APOLLO www-client• Metadata descriptions are made available through APOLLO

Today you can use uncertainty of snow maps (develop in MMEA)

S FSC , t =(FSC)

(FSC) S +(FSC)

t S +(FSC)

S

+(FSC)

S +(FSC)

S

Page 21: Available data sources & Real-time data collection

• Web maps services induce the Private sector• For example, SYKE’s web map service was tested in piloting the

services of Spatineo Ltd.

21

Monitoring and quality-controlling of the Web map service utilizingthe standard data interfaces

Page 22: Available data sources & Real-time data collection

CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality

focus on open standardsuse more open source tools and SDKs

OKFN.ORG & AVOINDATA.FI

• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-

time and estimate pollutant concentration levels in very near future.

FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)

• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally

More information: http://www.syke.fi/hankkeet/monitor2020

Page 23: Available data sources & Real-time data collection

CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality

focus on open standardsuse more open source tools and SDKs

OKFN.ORG & AVOINDATA.FI

• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-

time and estimate pollutant concentration levels in very near future.

FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)

• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally

More information: http://www.syke.fi/hankkeet/monitor2020

Page 24: Available data sources & Real-time data collection

TIEDON ARVO SYNTYY KÄYTÖSTÄ:LUOTETTAVAA INFORMAATIOTA JA PÄÄTÖKSIÄ 2020Ympäristötiedon tuotanto

Ympäristötiedon tuotannon tiekartta osoittaa seurannan kehittymisen suunnanlähitulevaisuudessa.

2015 2016 2017 2018 2020

Hyö

dynn

että

vän

tiedo

nm

äärä

kasv

aa

Yhteiset,läpinäkyvät &mitattavattavoitteet.- 20 % seurannankarsiminen

Maastotyön ulkoistaminen

Uusien toimintamallien kehittäminen1. Uudet menetelmät2. Toimintamallit

Velvoitetarkkailun uudistuu

Uusien toimintamallien juurruttaminen:1. Uusia menetelmiä testataan säännöllisesti2. Velvoitetarkkailu uusiutuu3. Seuranta sähköistyy

Tiedon yksikkökustannus pienenee ->Informaation vaikuttavuus kasvaa ->

Velvoitteiden keventäminen lait,asetutkset direktiivitEU-vaikuttaminen

Satelliittikeskus 2017vedenlaatutuotteitasisävesille

Data fuusio

Optimization

Page 25: Available data sources & Real-time data collection

CHANGES IN FIELD WORK

23.9.2015 MONITOR202025

2020

2013

YRITYKSET

KANSALAISETJULKINENSEKTORI

KANSALAISET

Uudet toiminnotLABORATORIO

KENTTÄTYÖ

VARASTOINTI

KÄYTTÖALKU-KÄSITTELY