available data sources & real-time data collection
TRANSCRIPT
Available data sources&
Real-time data collectionJari Silander & Teemu Näykki & Sami Korhonen & Jari Koskiaho & Harri
Lauri Arvola & Timo Vesala, HY (10 min talk)Pekko Ilvessalo, FMI
Myllyniemi, SYKEMauno Rönkkö, UEFTimo Toivanen, VTTHanna Huitu, LUKE
Ympäristötiedosta palveluihin –seminaariVaisala 23.09.2015
MMEA Testbed (19.8.2010)
Content1. Available data sources
– Participatory sensing– Remote sensing– Automatic station– Forecasts
Use cases
2. Real time data collection– Sensors– Quality control– Data service
Use cases (real time data in use: data, usages,availabilitiy)
3. Conclusion
Available data sources
• Global http://index.okfn.org/• EU http://open-data.europa.eu/en/data/• USA https://www.data.gov/open-gov/• Worldbank http://data.worldbank.org/• Suomi www.avoindata.fi
Use case 1: In-situ data in action(MMEA with SYKE Rapa-project(YM), MMEA team effort
Available data sources
Use case: Hi, what is nutrientloading rigth now?
Real time data collection
Use case:Hello: What is nutrientloading now? – data system
Example Environmentof OData• What is Odata?• Why to use Odata?• What formats?• What resources are availble?• What was MMEA role in this?• How to use it?• What is the best practice?
Available data sources
AVOIN DATA ESIMERKKI SUOMESTA – MISTÄ APUA?Suomi www.avoindata.fi - Suomen ympäristökeskus
http://pivetodatademo.appspot.com/gv3/
2011 2013 2015
ROADMAP DIY-SENSORDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory
QUALITY CONTROLDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory
Use case 2:Lauri Arvola, HY
Available data sources
The catchment of Vanaja (2700 km2)Met stationAWQM stationHydr stationEDDY stationChemMon station
City ofHämeenlinna
Lammi BiologicalStation,Univ. of Helsinki
EMMI - System for Environmental MonitoringPowered by Masinotek Ltd
”Real time data collection”
• In-situ (automatic stations)• Satellite• Radar• Forecasts• Participatory sensing
Use case 3: Air Quality(Pekko Ilvessalo, FMI)
Available data sources
Use case 1: Air quality in Helsinki metropolitan areais worsened in the morning. Should people bewarned?
• Air quality observations from Helsinki monitoring stations (open data interface available in beta.fmi.fi:• http://beta.fmi.fi/wfs?request=getFeature&storedQuery_id=urban::observations::airquality::hourly::mu
ltipointcoverage&place=Helsinki)• are showing that nitrogen dioxide concentrations have been raised in the morning. (Observations
coming to open data October 2015).
• Observed temperature and wind profile from mast data in Espoo Kivenlahti available in open data• (http://data.fmi.fi/fmi-apikey/insert-your-apikey-
here/wfs?request=GetFeature&storedquery_id=fmi::observations::weather::mast::multipointcoverage&place=Helsinki¶meters=TA,ws) are monitored in real-time every 10 minutes and atmosphericstability (Richardson number) is calculated.
• Atmosphere is at first very stabile and ground surface inversion seems to be the reason forweakened air quality. Next observations however show that inversion is weakening and air quality isexpected to get better. Warning won’t be given.
Real time data collection
ECMWF,ECHAM
HIRLAMRCR 0.068
HARMONIE0.022o
AROME,LAPS
Weather predictionmodels
Dispersion models -long-range, regional
Dispersion and effectsmodels – urban, local
FLUENT, CFD code
SILAM LRT,meso, radioactivity
Modelling system - FMI
OSPM (NERI), streetcanyon
UDM-FMI, urban
CAR-FMI, roadside
HILATARLRT, meso
Aerosol process models:UHMA (U Helsinki, FMI)
MONO32 (U Helsinki, Stadia)
MPP-FMI, Meteorologicalpre-processing model
ESCAPE, chemicalaccidents
BUOYANT, fires
EXPAND (FMI, YTV)population exposure
Meteorologicalmeasurements
Use case: Satellite data, MMEA-teamwork
Available data sources
Satellite Data Centre, developed e.g. underCleen/MMEA
SYKE will adapt its snow mapping method to new satellite sensors andwill operate the service via direct connection to the Satellite Data Centrecomputing facilities. The data delivery through Standard Data interfacecontinues, to enable different web&desktop GIS-applications.
OPEN DATA• OGC standards compliant interfaces• Web Coverage Service (WCS)• Web Map Service (WMS)• Data is browsable using APOLLO www-client• Metadata descriptions are made available through APOLLO
Today you can use uncertainty of snow maps (develop in MMEA)
S FSC , t =(FSC)
(FSC) S +(FSC)
t S +(FSC)
S
+(FSC)
S +(FSC)
S
• Web maps services induce the Private sector• For example, SYKE’s web map service was tested in piloting the
services of Spatineo Ltd.
21
Monitoring and quality-controlling of the Web map service utilizingthe standard data interfaces
CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality
focus on open standardsuse more open source tools and SDKs
OKFN.ORG & AVOINDATA.FI
• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-
time and estimate pollutant concentration levels in very near future.
FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)
• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally
More information: http://www.syke.fi/hankkeet/monitor2020
CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality
focus on open standardsuse more open source tools and SDKs
OKFN.ORG & AVOINDATA.FI
• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-
time and estimate pollutant concentration levels in very near future.
FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)
• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally
More information: http://www.syke.fi/hankkeet/monitor2020
TIEDON ARVO SYNTYY KÄYTÖSTÄ:LUOTETTAVAA INFORMAATIOTA JA PÄÄTÖKSIÄ 2020Ympäristötiedon tuotanto
Ympäristötiedon tuotannon tiekartta osoittaa seurannan kehittymisen suunnanlähitulevaisuudessa.
2015 2016 2017 2018 2020
Hyö
dynn
että
vän
tiedo
nm
äärä
kasv
aa
Yhteiset,läpinäkyvät &mitattavattavoitteet.- 20 % seurannankarsiminen
Maastotyön ulkoistaminen
Uusien toimintamallien kehittäminen1. Uudet menetelmät2. Toimintamallit
Velvoitetarkkailun uudistuu
Uusien toimintamallien juurruttaminen:1. Uusia menetelmiä testataan säännöllisesti2. Velvoitetarkkailu uusiutuu3. Seuranta sähköistyy
Tiedon yksikkökustannus pienenee ->Informaation vaikuttavuus kasvaa ->
Velvoitteiden keventäminen lait,asetutkset direktiivitEU-vaikuttaminen
Satelliittikeskus 2017vedenlaatutuotteitasisävesille
Data fuusio
Optimization
CHANGES IN FIELD WORK
23.9.2015 MONITOR202025
2020
2013
YRITYKSET
KANSALAISETJULKINENSEKTORI
KANSALAISET
Uudet toiminnotLABORATORIO
KENTTÄTYÖ
VARASTOINTI
KÄYTTÖALKU-KÄSITTELY