kevin gomes and john graybeal, mbari mbari’s ssds ooi cyberinfrastructure: san diego june 30, 2008
TRANSCRIPT
Kevin Gomes and John Graybeal, MBARI
MBARI’s SSDS
OOI Cyberinfrastructure:San Diego
June 30, 2008
OOI-CYBERINFRASTRUCTURE
MBARI’s Shore Side Data System (SSDS)
• Requirements (very quick) and Architecture Overview
• Data and Metadata Model• Ingest, Processing and Provenance
OOI-CYBERINFRASTRUCTURE
High-Level Requirements
• Capture observatory and instrument lifecycle data
• Return instrument data in its native (“raw”) format
• Simple analysis tools for viewing data• Support queries for data• Support merging with other data• Retain (and return) all associated metadata
and history with data• Return data in different formats
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
ID: XParent: YData: [0110..]
<Metadata>
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
QuickTime™ and a decompressor
are needed to see this picture.
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
RawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS SIAMPortal
Inst
PU
CK Service
SIAM
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
SIAMPortal
SSDS
Metadata NetApp
HTTP
WebApp
Adapter
Adapter
Adapter
Adapter
ESB
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
Strategy
Proxy
Strategy
Proxy
Strategy
Proxy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
RawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS SIAMPortal
Inst
PU
CK Service
SIAM
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
SIAMPortal
SSDS
Metadata NetApp
HTTP
WebApp
Adapter
Adapter
Adapter
Adapter
ESB
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
Strategy
Proxy
Strategy
Proxy
Strategy
Proxy
<?xml version="1.0" encoding="UTF-8" standalone="yes"?><SensorML xmlns="http://www.opengis.net/sensorML/1.0.1" xmlns:ns2="http://www.opengis.net/gml" xmlns:ns3="http://www.w3.org/1999/xlink" xmlns:ns4="urn:us:gov:ic:ism:v2" xmlns:ns5="http://www.opengis.net/swe/1.0.1" xmlns:ns6="http://www.w3.org/2001/SMIL20/" xmlns:ns7="http://www.w3.org/2001/SMIL20/Language" version="1.0.1"> <member ns3:type="simple"> <System ns2:id="9b1ed7d4-d95c-11db-a6d9-fff1427a99d4"> <ns2:description ns3:type="simple">UW-Seahurst installation of Wetlabs ECO-BB2F</ns2:description> <keywords ns3:type="simple"> <KeywordList> <keyword>ALOHA</keyword> <keyword>ALOHA-ECO</keyword> </KeywordList> </keywords> <identification ns3:type="simple"> <IdentifierList> <identifier name="Device UUID"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:uuid"> <value>9b1ed7d4-d95c-11db-a6d9-fff1427a99d4</value> </Term> </identifier> <identifier name="Device ID"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:ID"> <value>1608</value> </Term> </identifier> <identifier name="Device Name"> <Term definition="urn:www.mbari.org:moos:ssds:metadata:device:name"> <value>Wetlabs ECO-BB2F Fluorometer</value> </Term> </identifier>
<?xml version="1.0" encoding="UTF-8" standalone="yes"?><ns3:Observation xmlns:ns1="http://www.opengis.net/gml" xmlns:ns2="http://www.w3.org/1999/xlink" xmlns:ns3="http://www.opengis.net/om/1.0" xmlns:ns4="http://www.opengis.net/swe/1.0.1" xmlns:ns5="http://www.opengis.net/sensorML/1.0.1" xmlns:ns6="urn:us:gov:ic:ism:v2" xmlns:ns7="http://www.w3.org/2001/SMIL20/" xmlns:ns8="http://www.w3.org/2001/SMIL20/Language"> <ns3:result xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="ns4:RecordType"> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >539</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >1273</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >15:23:12</ns4:Item> </ns4:field> <ns4:field> <ns4:Item xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:string" >527</ns4:Item> </ns4:field>
OOI-CYBERINFRASTRUCTURE
Inst
PUCK
NetCDFOceanSites
JMSHTTP
OGCServices
WebServices
API
THREDDS
StrategyRawData
OPeNDAP
Inst
Rover
OASISTelemetry
ALOHA
(MARS/Seahurst)
Client
OASIS2 SSDSDriver
OASIS
Service
SIAM
MOOS
Proxy
SIAMPortal
Inst
PU
CK Service
SIAM
Strategy
Proxy
Inst
PUCK
Service
SIAM
FOCE
AUV
RoverPortal
AUVPortal
Strategy
Proxy
SIAMPortal
SSDS
Metadata NetApp
Adapter
Adapter
Adapter
Adapter
ESB
HTTP
WebApp
Adapter
Connector
ESB
Inst
Proxy
Adapter
Strategy
Questions?