use of wps for earth observation 4 th geoss science and technology stakeholder workshop 25 march...
TRANSCRIPT
Use of WPS for Earth Observation
4th GEOSS Science and Technology Stakeholder Workshop
25 March 2015
Sheraton Norfolk Waterside Hotel
Agenda
• Intro WPS– Basic usage– Chaining
• Use of WPS in the Architecture Implementation Pilot Phase 8– Use of chained WPS for Data Quality Assurance
• (Mike Jackson, Didier G. Leibovici, Sam Meek - COBWEB)• Big Data Analysis
– WPS and HADOOP
Intro WPS
• Principle– Similar to Unix filter
• stdin > processing > stdout• f(x) = y
• WPS is like a “Unix filter” on the Web
Intro WPS
• Behaves like the other OGC Web Services (WMS, WFS, WCS, CSW, …)
Diagram by 52North
GetCapabilities
Diagram by Geo-Solutions.it
DescribeProcess
Diagram by Geo-Solutions.it
Execute
Diagram by Geo-Solutions.it
WPS Chaining
• Remember the Unix filter from slide 3?– Connect stdout to stdin using |
• ls -l | grep ”Mar”• ls -l | grep ”Mar" | sort +4n | more
• WPS’s can also be chained!– So you can run more complex analysis (model)
Using WPS
• Use of WPS in the Architecture Implementation Pilot Phase 8 (AIP-8)– Use of chained WPS for Data Quality Assurance
• (Mike Jackson, Didier G. Leibovici, Sam Meek – COBWEB)
SBA Technical
Organisation He Cl We Dm Ag Wa Bd En Other AuthProces
sing LD CloudWS in
GCISensor Portal App CB & BP
JAXA X X X XConnectingGEO X X X XCloudSigma ? X X X XSDI4Apps X X X XEU BON X X X XFOODIE X X X X XSmartOpenData X X X XGEOSS Water Services X X X X X X X X
Chile X X X X XFSU-Jena X X X X X X XNATO STO-CMRE X X Ocean X X X X XCIESIN X X X X XCOBWEB X X X X X XCNR X X X X X X X XStormCenter X X X X X X X X X X X X XNASA X X X X X XBen Burford X X ? XGMU X X X X X X XINCOSE X ? X XCITI-SENSE X AirQ X X X X X
AIP Participants using WPS
Example
• Use of chained WPS for Data Quality Assurance– (Mike Jackson, Didier G. Leibovici, Sam Meek – COBWEB)
• Context:– VGI – Citizen Science– Citizens Observing in Biospheres
Quality assuring data through atomic tests – 7 Pillars
System Architecture
User interface
Example workflow: Ash Dieback risk inthe Dyfi Biosphere
Reversal
• f(x) = y• We download the Earth (x) to many times a day– Data lives happily in the cloud– Bandwidth and Processing power is infinite in the cloud(s)
(almost, sort of)
• Upload f() to x, and download y!– F() is relatively small and y is expected to be small
• WPS-Transactional!– Upload the f() to the Web Service
Big Data Analysis
• WPS with HADOOP, SPARK, …• http://www.opengeospatial.org/blog/1866
• Further investigated in OGC TestBeds and AIP-8
