hydrologic information system for the nation
Post on 23-Feb-2016
23 Views
Preview:
DESCRIPTION
TRANSCRIPT
Hydrologic Information System
for the NationIlya Zaslavsky
Spatial Information Systems LabSan Diego Supercomputer Center
UCSD
UCSD Seminar, February 23, 2009
http://his.cuahsi.orghttp://hiscentral.cuahsi.orghttp://hydroseek.nethttp://river.sdsc.edu/ucsddashhttp://wron.net.au/DemosII/Modules/ODMKMLGatway.aspxhttp://maxim.ucsd.edu/mattsmaps/storet.aspx
SDSC Spatial Information Systems LabResearch and system development• Services-based spatial information
integration infrastructure, CI projects• Mediation services for spatial data, query
processing, map assembly services• Long-term spatial data preservation• Spatial data standards and technologies for
online GIS (SVG, WMS/WFS)• Support of spatial data projects at SDSC
and beyond
Mediator
LegendGenerator
MapAssembler
Ontology
…
GRID SERVICESFOR MAP INTEGRATION
Mediator
LegendGenerator
MapAssembler
Ontology
…
GRID SERVICESFOR MAP INTEGRATION
services
In Geosciences (GEON, CUAHSI, CBEO,…)
Spatial web services
FederalAgencies
Figure 1.26 The Geography Network.
ESRICounty spatial data and toxicant information
Telesis, other localNon-profits
CA state
WSDL
WSWSDL
WSWSDL
WSWSDL
WSWSDL
WSWSDL
WS
Student projects
The CHI ME Model
In regional development (NIEHS SBRP, CRN…)
In Neurosciences (BIRN, CCDB)
http://spatial.sdsc.edu/lab/
Contact: zaslavsk@sdsc.edu
Consortium of Universities for the Advancement of Hydrologic Science, Inc.
An organization representing more than one hundred United States universities, receives support from the
National Science Foundation to develop infrastructure and services for the advancement of hydrologic
science and education in the U.S. http://www.cuahsi.org/
122 US Universities as
of July 2008
CUAHSI HIS: NSF support through 2012 (GEO)
Partners:Academic: 11 NSF hydrologic observatories, CEO:P projects,
LTER…Government: USGS, EPA,
NCDC, NWS, state and localCommercial: Microsoft, ESRI,
KistersInternational: Australia, UK
Standardization: OGC, WMO (Hydrology Domain WG, CHy);
adopted by USGS, NCDC
An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard water data service protocols;
software for data publication, discovery, access and integration.
What is the CUAHSI HIS?
Observation Stations
Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System
USGS National Water Information System NOAA Climate Reference Network
Map for the US
Build a common window on water data using web services
Water Data Web Sites
NWISWeb site output# agency_cd Agency Code# site_no USGS station number# dv_dt date of daily mean streamflow# dv_va daily mean streamflow value, in cubic-feet per-second# dv_cd daily mean streamflow value qualification code## Sites in this file include:# USGS 02087500 NEUSE RIVER NEAR CLAYTON, NC#agency_cd site_no dv_dt dv_va dv_cdUSGS 02087500 2003-09-01 1190USGS 02087500 2003-09-02 649USGS 02087500 2003-09-03 525USGS 02087500 2003-09-04 486USGS 02087500 2003-09-05 733USGS 02087500 2003-09-06 585USGS 02087500 2003-09-07 485USGS 02087500 2003-09-08 463USGS 02087500 2003-09-09 673USGS 02087500 2003-09-10 517USGS 02087500 2003-09-11 454
Time series of streamflow at a gaging station
http://his.cuahsi.org/odmdatabases.html
CUAHSI Observations Data Model
Information communication
• Water web pages• Water web services
HyperText Markup Language (HTML)
Water Markup Language (WaterML)
Water Data Services• Set of query
functions• Returns data in WaterML
NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites)
Test bed HISServers
Central HIS servers
ArcGIS
Matlab
IDL, R
MapWindow
Excel
Programming (C#, VB..)
Desktop clients
Customizable web interface
(DASH)
HTML - XMLW
SDL - SO
AP
Modeling (OpenMI)
Global search (Hydroseek)
Water Data Web Services, WaterML
Con
trolle
d vo
cabu
larie
s
Met
adat
aca
talo
gs
Ont
olog
y
ETL
serv
ices
HIS LiteServers
External data providers
Deployment to test beds
Other popular online clients
ODM DataLoader
Streaming Data Loading
Ontology tagging (Hydrotagger)
WSDL and ODM registration
Data publishing
ODMTools
Server config tools
HIS CentralRegistry & Harvester
Hydrologic Information System Service Oriented Architecture
HIS
Des
ktop
Central HIS Data
Services
Catalog
Semantic Tagging of Harvested Variables
Hydroseekhttp://www.hydroseek.net
Supports search by location and type of data across multiple observation networks including NWIS, Storet, and academic data
How we work with agencies on web service access to observational data
1. Establish an agreement with the agency on joint development of water data services, identify agency partners (ideally, with time to support joint work)
2. Identify the scope of the service, databases to be exposed, and access control, assign network and vocabulary codes
3. Map semantics of the service to WaterML semantics, and verify with the agency
4. Include discussion of agency data and interoperability issues in the context of OGC Hydrology Domain WG (if needed)
5. Develop a first draft of the web service6. Unit testing, over a series of validation cases developed jointly with the agency7. Harvest an observations metadata catalog for agency data, to be housed
either at SDSC or at the agency8. Develop a procedure for catalog updates9. Register the water data service at HISCentral (including mapping of variables
to ontology terms), and test it using HydroSeek and HydroExcel. Document the service
10. Review and test the service together with the agency, for possible approval as “operational”
Against the NIH Syndrome2006:► CUAHSI HIS web services are discussed on the BASINS mailing list as a
new way to access hydrologic data. The list is mostly used by hydrologists and developers outside academia;
► NCDC develops ASOS web services following WaterML2007: ► MOU with USGS; USGS is developing WaterML-compliant GetValues
service;► GLEON uses an early version of ODM to develop their own schema
(VEGA);► Phoenix LTER is developing ODM (in MySQL) and WaterML services (in
Java);► A Google Earth-based client for CUAHSI web services is developed at
CSIRO, Australia;► Deployment to 11 hydrologic observatory test beds, + CBEO (CEOP
project)2008: ► KISTERS develops WaterML-compliant web services over their database,
for a client;► MapWindow open source GIS develops WaterOneFlow parsers;► Florida, Texas and Idaho use ODM and WaterOneFlow web services to
provide access to state data repositories; New Jersey is considering the same;
► Another CEOP project, at UC-Davis, is implementing ODM (in Postgres) and web services (in Java);
► Stroud Water Research Center; WRON; AWI… many that we don’t know…
► Now SBRP: data from UCSD, UA, more?
Visualization and Analysis of Large Datasets► Tiled wall (Falko Kuester)
► OLAP cubes for repositories (via Excel and online GIS)► Google Earth client
Coming soon…► All Hands Meeting of CUAHSI HIS at SDSC; April 6-7
2009► Meetings at BOM, CSIRO, global water initiative
(second half of March)► Collaboration with World Meteorological Organization
(joint charter between WMO’s CHy and OGC’s Hydrology DWG)
► Open Geospatial Consortium: Hydrology Domain Working Group, focus on WaterML 2.0
► Automated facilities for uploading/hosting observations data, CZO
► HIS capacity building workshop in Kuala Lumpur (plus a few workshops in the US)
► Integration with real-time (via DataTurbine), with hydrologic models (via OpenMI, CSDMS), animations, spatio-temporal interpolation
► Desktop HIS (this year)
Summary• Generic method for managing and publishing observational
data– Supports many types of point observational data– Overcomes syntactic and semantic heterogeneity using a standard
data model and controlled vocabularies– Supports a national network of observatory test beds but can grow!
• WaterML is a standard language for consistently communicating water observations data from academic and government sources using web services
• National Water Metadata Catalog is the most comprehensive index of the nation’s water observations presently existing
Join the Water Data Federation!
top related