Integrated Ocean Observing SystemIntegrated Ocean Observing SystemData Management and CommunicationsData Management and Communications

March 2004

The US Integrated Ocean The US Integrated Ocean Observing System (IOOS)Observing System (IOOS)

Plan forPlan forData Management and Data Management and

Communications (DMAC)Communications (DMAC)

Presented to:Presented to:

IOOS Industry Workshop IOOS Industry Workshop By:By:

IOOS DMAC Steering CommitteeIOOS DMAC Steering Committee

Landry Bernard – NDBC/USMLandry Bernard – NDBC/USM

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

IOOS: One system….seven IOOS: One system….seven goalsgoals

– Detect and Predict Change Detect and Predict Change – Mitigate natural hazardsMitigate natural hazards– Improve safety and efficiency of marine Improve safety and efficiency of marine

opsops– Ensure national securityEnsure national security– Reduce public health risksReduce public health risks– Protect and restore marine ecosystemsProtect and restore marine ecosystems– Sustain marine resourcesSustain marine resources

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

DMAC Standards and

Protocols

IOOS Data Management and Communications Subsystem

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

The DMAC PlanThe DMAC Plan• An evolutionary pathAn evolutionary path

– Rapid start-up, continual improvementRapid start-up, continual improvement– A software engineering strategyA software engineering strategy– An international outlookAn international outlook

• Technical ComponentsTechnical Components– Data discovery (metadata)Data discovery (metadata)– Data transportData transport– ArchivalArchival– Product generationProduct generation– Feedback and fault correctionFeedback and fault correction

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

The DMAC PlanThe DMAC Plan• Data Discovery (metadata)Data Discovery (metadata)

– Build upon partnerships -- many Build upon partnerships -- many metadata repositories exist today, metadata repositories exist today, Regional & National Regional & National

– Focus on FGDC (& future ISO)Focus on FGDC (& future ISO)– Metadata WG to design the strategy for Metadata WG to design the strategy for

distributed searchdistributed search– A Web Portal at which users can searchA Web Portal at which users can search

•Embed in members’ Web pagesEmbed in members’ Web pages•Machine-to-machine accessibleMachine-to-machine accessible

– Seamless segue to DMAC Data TransportSeamless segue to DMAC Data Transport

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

The DMAC PlanThe DMAC Plan• Data Transport (access)Data Transport (access)

– ““Web Services” Web Services” gateways to gateways to standardizationstandardization

– Adopt current successesAdopt current successes•OPeNDAP (a.k.a. “DODS”)OPeNDAP (a.k.a. “DODS”)

•High interoperability with GIS network protocolsHigh interoperability with GIS network protocols

– Supply data to a broad range of “clients”Supply data to a broad range of “clients”– WG must define comprehensive semantic WG must define comprehensive semantic

data model(s)data model(s)

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

OPeNDAP: distributed OPeNDAP: distributed access to data and access to data and metadatametadata

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

The DMAC PlanThe DMAC Plan• ArchivalArchival

– Build upon partnership of National and Build upon partnership of National and Regional archive centersRegional archive centers

– Utilize DMAC Metadata and Transport Utilize DMAC Metadata and Transport standardsstandards

– Archive WG to be formed -- ensure that all Archive WG to be formed -- ensure that all data is archiveddata is archived

– Operational data with QC to be archivedOperational data with QC to be archived (coordinated with data assembly centers (coordinated with data assembly centers such as US GODAE server (Model Data) or such as US GODAE server (Model Data) or NDBC (Real-Time Data))NDBC (Real-Time Data))

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

The DMAC PlanThe DMAC Plan• ProductsProducts

– On-line Browse (part of DMAC infrastructure)On-line Browse (part of DMAC infrastructure)• Uniform access to all IOOS data from Web browsersUniform access to all IOOS data from Web browsers

– GIS maps & basic scientific graphicsGIS maps & basic scientific graphics– Readable tablesReadable tables

– Data productsData products(*)(*) (IOOS modeling subsystem) (IOOS modeling subsystem)• State estimationState estimation

• ForecastsForecasts

– Information productsInformation products(*)(*)

• Value-added products for user groups provided by Value-added products for user groups provided by the private sector, academe, governmentthe private sector, academe, government

* Not included in DMAC Plan* Not included in DMAC Plan

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Publish DMAC Plan

DMAC Implementation Timeline

June

fy03 ‘04 ‘05 ‘06 ‘07

Interim activities

• DMAC Steering Committee

• Regional Obs. Systems

• Metadata standards WG

•“Data model” WG

• IOOS Standards Process

Five year plan

:

‘08 ‘09 ‘10

• ManagementManagement• ArchivalArchival

• TransportTransport• DiscoveryDiscovery

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Concrete actions to contribute data Concrete actions to contribute data into the IOOS/DMAC framework todayinto the IOOS/DMAC framework today

• Data discoveryData discovery1.1. Produce FGDC metadataProduce FGDC metadata

2.2. Submit it to national search sitesSubmit it to national search sites(NASA/GCMD, NOAA/NCDDC & (NASA/GCMD, NOAA/NCDDC & CSC)CSC)

3.3. Create a home page and a search Create a home page and a search portal to your data holdingsportal to your data holdings

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Concrete actions …Concrete actions …

• Interoperable data accessInteroperable data access1.1. Gridded data: Gridded data:

– Install OPeNDAPInstall OPeNDAP(*)(*) servers servers

2.2. In-situIn-situ data: data:– Use RDBMS or standard formatsUse RDBMS or standard formats– Contribute to development of pilot Contribute to development of pilot

IOOS/DMAC components IOOS/DMAC components – Partner with NDBC (**) to QA/QC and Partner with NDBC (**) to QA/QC and

distribute Real-Time Marine Observation to distribute Real-Time Marine Observation to WMO WMO

(*) (*) http://www.unidata.ucar.edu/packages/dods/http://www.unidata.ucar.edu/packages/dods/(**) (**) MarineObs@noaa.govMarineObs@noaa.gov – Ask for “MODEM” – Ask for “MODEM”

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Concrete actions …Concrete actions …

• On-line browseOn-line browse1.1. Install Live Access ServerInstall Live Access Server(*)(*)

utilizing DMAC/OPeNDAP data utilizing DMAC/OPeNDAP data transporttransport

2.2. Create custom Web sites that Create custom Web sites that demonstrate regional data demonstrate regional data integrationintegration

(*) http://www.ferret.noaa.gov/LAS/(*) http://www.ferret.noaa.gov/LAS/

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Marine Observation Network▪ Buoy Locations

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Marine Observation Network▪ C-MAN Locations

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

Marine Observation Network▪ Special Support Stations

Integrated Ocean Observing SystemIntegrated Ocean Observing SystemData Management and CommunicationsData Management and Communications

March 2004 Gulf of Mexico Station LocationsGulf of Mexico Station Locations

Marine Observation Network▪ Gulf of Mexico Locations

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

RegionalObservatories

Public

ftp*

* Via MODEM Kit - request from MarineObs@noaa.gov

NDBCDODSNDBCDODS

NDBC MODEM Kit(Meteorological and Oceanographic Data Exchange Module)

March 2004March 2004 Integrated Ocean Observing SystemIntegrated Ocean Observing System

Data Management and CommunicationsData Management and Communications

IOOS INDUSTRY IOOS INDUSTRY WORKSHOPWORKSHOP

NATIONAL DATA BUOY CENTERNATIONAL DATA BUOY CENTER

www.ndbc.noaa.govwww.ndbc.noaa.gov

Landry.Bernard@noaa.govLandry.Bernard@noaa.gov

(228) 688-3394 ph(228) 688-3394 ph

(228) 688-1364 fax(228) 688-1364 fax