Web Gridded Document Web Gridded Document Service (WGDS)Service (WGDS)

The Air Transportation Information Exchange The Air Transportation Information Exchange Conference (Featuring AIXM, WXXM, and FIXM)Conference (Featuring AIXM, WXXM, and FIXM)

Paul HershbergPaul HershbergMeteorological Development LaboratoryMeteorological Development Laboratory

Office of Science and TechnologyOffice of Science and TechnologyNOAA’s National Weather ServiceNOAA’s National Weather Service

August 28-30, 2012August 28-30, 2012

Materials from this Materials from this presentation will be available presentation will be available

atat

http://www.mdl.nws.noaa.gov/~WGDS

until September 30, 2012.until September 30, 2012.

User-Generated User-Generated ProductsProducts

National Digital Forecast DatabaseNational Digital Forecast Database

– Detailed– Interactive– Collaborative

NWS Automated NWS Automated ProductsProducts

TextText

GraphicGraphic

DigitalDigital

VoiceVoice

National Digital National Digital ForecastForecast

Database Database

Local Digital Local Digital ForecastForecast

Database Database

Field Field OfficesOffices

National National CentersCentersCollaborateCollaborate

Data and Science FocusData and Science Focus

National National CentersCenters Model Model

GuidanceGuidanceGridsGrids

TODAY...RAIN LIKELY.

SNOW LIKELY ABOVE

2500 FEET. SNOW

ACCUMULATION BY

LATE AFTERNOON 1

TO 2 INCHES ABOVE

2500 FEET. COLDER

WITH HIGHS 35 TO 40.

SOUTHEAST WIND 5

TO 10 MPH SHIFTING

TO THE

SOUTHWESTEARLY

THIS AFTERNOON.

CHANCE OF

PRECIPITATION 70%.

TODAY...RAIN LIKELY.

SNOW LIKELY ABOVE

2500 FEET. SNOW

ACCUMULATION BY

LATE AFTERNOON 1

TO 2 INCHES ABOVE

2500 FEET. COLDER

WITH HIGHS 35 TO 40.

SOUTHEAST WIND 5

TO 10 MPH SHIFTING

TO THE

SOUTHWESTEARLY

THIS AFTERNOON.

CHANCE OF

PRECIPITATION 70%.

– Created in 2004– Sensible Wx

44

Legacy NDFD Web Feature Legacy NDFD Web Feature Services Data Flow –> Services Data Flow –> Grids to DocumentsGrids to Documents

-- User selects between two types of products, time constraints, unit, and up to 57 forecast weather elements.

Response: NDFD XML

Document encoded in

DWML

Data Request

Data

** ~ 12 Million Hits a Day **

DWML Example Current DWML Example Current Service: Summary (12 hr)Service: Summary (12 hr)

<data> !! Note the lack of OGC prefixes<data> !! Note the lack of OGC prefixes

<location> <location> <location-key>point1</location-key> <location-key>point1</location-key> <<pointpoint latitude="48.22" longitude="-106.62" latitude="48.22" longitude="-106.62"/> /> </location> </location>

<moreWeatherInformation <moreWeatherInformation applicable-applicable- location="point1">location="point1">http://forecast.weather.gov/MapClick.php?textField1=48.22&amp;textField2=-http://forecast.weather.gov/MapClick.php?textField1=48.22&amp;textField2=-106.62106.62

</moreWeatherInformation> </moreWeatherInformation>

<time-layout <time-layout time-coordinate="local" summarization=time-coordinate="local" summarization="12hourly"> "12hourly"> <layout-key>k-p24h-n7-1</layout-key> <layout-key>k-p24h-n7-1</layout-key> <start-valid-time <start-valid-time period-name="Today"period-name="Today">2008-12-05T06:00:00-07:00</start-valid->2008-12-05T06:00:00-07:00</start-valid-

time> time> <end-valid-time>2008-12-05T18:00:00-07:00</end-valid-time><end-valid-time>2008-12-05T18:00:00-07:00</end-valid-time> </time-layout> </time-layout>

<weather <weather time-layout="k-p12h-n14-3"> time-layout="k-p12h-n14-3"> <name>Weather Type, Coverage, and Intensity</name> <name>Weather Type, Coverage, and Intensity</name> <weather-conditions <weather-conditions weather-summary="Slight Chance Snow"weather-summary="Slight Chance Snow">> <value coverage="slight chance" intensity="light" weather-type="snow" <value coverage="slight chance" intensity="light" weather-type="snow"

qualifier="none"/> qualifier="none"/> </weather-conditions></weather-conditions> </weather></weather>

</data></data>

DWML Example Current Service: Meteogram

<temperature <temperature type="maximum" units="Fahrenheit" time-layout="k-p24h-n7-1"> type="maximum" units="Fahrenheit" time-layout="k-p24h-n7-1"> <name><name>Daily Maximum TemperatureDaily Maximum Temperature</name></name> <value><value>3636</value></value> <value><value>2929</value></value> <value><value>3333</value></value> <value><value>2020</value> </value> <value><value>3737</value> </value> <value><value>1818</value> </value> <value><value>1414</value></value>

</temperature> </temperature>

<severe-component <severe-component type="tornadoes" units="percent" time-layout="k-p24h-n1-11"> type="tornadoes" units="percent" time-layout="k-p24h-n1-11">

<name><name>Probability of TornadoesProbability of Tornadoes</name></name>

<value><value>00</value> </value>

</severe-component></severe-component>

<climate-anomaly><climate-anomaly> <seasonal type="average temperature above normal" units="percent" time-layout="k-p3m-<seasonal type="average temperature above normal" units="percent" time-layout="k-p3m-

n3-2">n3-2"> <name><name>Probability of Three-Month Average Temperature Above Probability of Three-Month Average Temperature Above NormalNormal</name></name>

<value><value>4242</value> </value> <value><value>4444</value> </value> <value><value>3838</value> </value>

</seasonal> </seasonal> </climate-anomaly></climate-anomaly>

Sample NDFD UsesSample NDFD Uses

Legacy NDFD Web Service Legacy NDFD Web Service LimitationsLimitations

• NotNot OGC compliant OGC compliant

• Service paradigm does not fit established Service paradigm does not fit established service models (WCS, WFS, WMS)service models (WCS, WFS, WMS)

NDFD XML Document

Data Request

Data

A New Service Paradigm:A New Service Paradigm:Web Gridded Document Web Gridded Document

ServiceService

• Exploring a new type of web serviceExploring a new type of web service

• Will be patterned after a Web Coverage Service Will be patterned after a Web Coverage Service (WCS)(WCS)

• Will respond to WCS operations similar to Will respond to WCS operations similar to getCapabilitiesgetCapabilities, , describeCoveragedescribeCoverage, and , and getCoveragegetCoverage

• Will continue to use a nearest neighbor Will continue to use a nearest neighbor technique for querying points from gridstechnique for querying points from grids

• Responses to a Responses to a getWGDSCoveragegetWGDSCoverage operation will operation will be XML documents encoded in be XML documents encoded in WXXMWXXM or DWML, or DWML, marking the marking the firstfirst time NOAA gridded data will be time NOAA gridded data will be encoded in WXXMencoded in WXXM

Top Level WGDS DepictionTop Level WGDS Depiction

1010

WSDL

BackingStore of Gridded

Data

WCS

getCapabilities

describeCoverage

getCoverage

NetCDF

SOAP

WGDS

getWGDSCapabilities

describeWGDSCoverage

getWGDSCoverageWXXM Doc

NetCDFSOAP

SOAP

SOAP

SOAP

SOAP

SOAP

SOAP

WGDS

SOAP

describeCoverage

SOAPWCS

WGDS describeWGDSCoverage

describeCoverage

getCoverage

SOAPSOAP

NetCDF

Input •Service Name (WGDS)

Outputs •Version•Products (4)

Inputs •Product•Lat/Lon Point(s)

Outputs •Wx Element(s)•Time Constraints•Choice Doc Format (WXXM/DWML)

Inputs •Wx Element(s)•Time Constraints•Doc Format (WXXM/DWML)

Output

•Link to XML Doc (WXXM/DWML)

BackingStore of Gridded

Data

SOAP

NetCDF

Rationale For The New Web Rationale For The New Web ServiceService

• Popularity of current service Popularity of current service demonstrates the need for XML demonstrates the need for XML documents queried from grids. Recent documents queried from grids. Recent 10-fold increase in hit count underscores 10-fold increase in hit count underscores this usagethis usage

• The request-response paradigm deviates The request-response paradigm deviates significantly from existing SOAP significantly from existing SOAP functionality due to the type of datasetsfunctionality due to the type of datasets

• Customers value NWS post-processed Customers value NWS post-processed data (summarized/interpreted) of current data (summarized/interpreted) of current serviceservice

NEW WGDS Doc in WXXM: NEW WGDS Doc in WXXM: Summary (12 hr) ExampleSummary (12 hr) Example

<wx:FeatureCollection gml:id=“id0“> NOTE OGC prefixes <wx:featureMember> <wx:Forecast gml:id=“id1”> <om:samplingTime/> <om:procedure xlink:href="urn:fdc:mdl-nextgen.nws.noaa.gov:Dataset:NDFD"/> <om:observedProperty xlink:href="wxont:weather"/> <om:featureOfInterest/> <om:result>

<wx:WxFeatureCollection gml:id="id5">

<wx:WxfeatureMember> <wx:PointTimeSeriesCoverage gml:id="id6"> <wx:domainSet> <wx:PointTimeSeriesDomain gml:id="id41"> <wx:TimePeriod gml:id="id42">

<gml:beginPosition>2007-11-06T22:00:00Z</gml:beginPosition>

<gml:endPosition>2007-11-07T10:00:00Z</gml:endPosition> <gml:duration>PT12H</gml:duration> </wx:TimePeriod> <wx:location>45.20 -77.02</wx:location> </wx:PointTimeSeriesDomain> </wx:domainSet>

NEW WGDS Doc in WXXM: 12-hr NEW WGDS Doc in WXXM: 12-hr Summary Example (cont’d)Summary Example (cont’d)

<wx:rangeSetNDFD>

<nawx:Weather_NDFD

<nawx:weather-conditions weather-summaryweather-summary==""Thunderstorms Likely"> <nawx:value coveragecoverage=="likely" intensityintensity=="none" weather-typeweather-type=="thunderstorms" qualifierqualifier=="none"/> <nawx:value coveragecoverage=="likely" intensityintensity=="light" additiveadditive=="and" weather-typeweather-type=="rain showers" qualifierqualifier=="none"/> </nawx:weather-conditions></wx:rangeSetNDFD> ---------------------------------------------------------------------------------------------------------------- <wx:rangeSetNDFD> <nawx:Hazards_NDFD> <nawx:hazard-conditions> <nawx:hazard hazardCodehazardCode="HT.Y" phenomenaphenomena="Heat" significancesignificance="Advisory" hazardTypehazardType==""long duration"> <nawx:hazardTextURL>http://forecast.weather.gov/wwamap/wwatxtget.php?cwa=usa&wwa=Heat%20Advisory</nawx:hazardTextURL> </nawx:hazard> </nawx:hazard-conditions> </nawx:Hazards_NDFD></wx:rangeSetNDFD>

NEW WGDS Doc in WXXM: MAXT Meteogram Example

<om:result><om:result> <wx:WxFeatureCollection gml:id="id5"> <wx:WxfeatureMember> <wx:PointTimeSeriesCoverage gml:id="id6"> <wx:domainSet> <wx:PointTimeSeriesDomain gml:id="id7"> <wx:TimePeriod <wx:TimePeriod gml:id="id8">

<gml:beginPosition>2007-11-07T10:00:00Z</gml:beginPosition> <gml:endPosition>2007-11-07T22:00:00Z</gml:endPosition> <gml:duration>PT12H</gml:duration> </wx:TimePeriod>

<wx:location>45.20, -77.02</wx:location> </wx:PointTimeSeriesDomain> </wx:domainSet> <wx:rangeSetNDFD> <nawx:Temperature_NDFD<nawx:Temperature_NDFD type="maximum" units="degF">

<nawx:value>83</nawx:value> </nawx:Temperature_NDFD></nawx:Temperature_NDFD> </wx:rangeSetNDFD> </wx:PointTimeSeriesCoverage> </wx:WxfeatureMember> </wx:WxFeatureCollection>

</om:result></om:result>

POP12Hr WXXM Schema POP12Hr WXXM Schema Example (snippet)Example (snippet)

<!-- NDFD PROBABILITY OF PRECIPITATION DECLARATIONS --> <element name="ProbabilityOfPrecipitation_NDFD" <element name="ProbabilityOfPrecipitation_NDFD" type="nawx:ProbabilityOfPrecipitation_NDFDType"/>type="nawx:ProbabilityOfPrecipitation_NDFDType"/> <complexType name="ProbabilityOfPrecipitation_NDFDType"><complexType name="ProbabilityOfPrecipitation_NDFDType"> <choice><choice> <element name="value" type="nawx:percentageValType" minOccurs="0" <element name="value" type="nawx:percentageValType" minOccurs="0" maxOccurs="unbounded"maxOccurs="unbounded" nillable="true"/>nillable="true"/> <element name="valueList" type="nawx:valueListType" minOccurs="0" <element name="valueList" type="nawx:valueListType" minOccurs="0" maxOccurs="unbounded"maxOccurs="unbounded" nillable="true"/>nillable="true"/> </choice></choice> <attribute name="name" type="xsd:string" use="optional"/><attribute name="name" type="xsd:string" use="optional"/> <attribute name="period" type="xsd:duration" use="optional"/><attribute name="period" type="xsd:duration" use="optional"/> <attribute name="type" use="required"><attribute name="type" use="required"> <simpleType><simpleType> <restriction base="xsd:string"><restriction base="xsd:string"> <enumeration value="12 hour"/><enumeration value="12 hour"/> <enumeration value="floating"/><enumeration value="floating"/> <enumeration value="ekdmos-6 hour"/><enumeration value="ekdmos-6 hour"/> </restriction></restriction> </simpleType></simpleType> </attribute></attribute> <attribute name="units" type="xsd:string" fixed="percent"/><attribute name="units" type="xsd:string" fixed="percent"/> <attribute name="likelihoodUnits" type="nawx:likelihoodUnitsTypes" use="optional"/><attribute name="likelihoodUnits" type="nawx:likelihoodUnitsTypes" use="optional"/> <attribute name="categorical-table" type="xsd:string" use="optional"/><attribute name="categorical-table" type="xsd:string" use="optional"/> <attribute name="conversion-table" type="xsd:string" use="optional"/><attribute name="conversion-table" type="xsd:string" use="optional"/> <attribute name="applicable-categories" type="xsd:string" use="optional"/><attribute name="applicable-categories" type="xsd:string" use="optional"/> <attribute name="probability-type" type="nawx:probability-typeType" use="optional"/><attribute name="probability-type" type="nawx:probability-typeType" use="optional"/> </complexType></complexType>

SummarySummary

• New Web Service (Web Gridded Document Service; New Web Service (Web Gridded Document Service; WGDS) proposedWGDS) proposed

• NOAA’s first attempt at creating WXXM documents NOAA’s first attempt at creating WXXM documents from gridded datafrom gridded data

• Intend to prototype it within OWS-9 for feedbackIntend to prototype it within OWS-9 for feedback

• Someday, possible adoption by OGCSomeday, possible adoption by OGC

http://www.mdl.nws.noaa.gov/~WGDS