observing system monitoring center (osmc)
DESCRIPTION
Observing System Monitoring Center (OSMC). Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI). … to provide a system view of global ocean climate observations. A partnership …. PMEL User interface logic & tools NDBC Data assembly & operations - PowerPoint PPT PresentationTRANSCRIPT
Observing System Observing System Monitoring Center (OSMC)Monitoring Center (OSMC)
Status UpdateStatus UpdateApril 2005April 2005
Steve Hankin – PMEL (co-PI)Steve Hankin – PMEL (co-PI)Kevin Kern – NDBC (co-PI)Kevin Kern – NDBC (co-PI)
… … to provide a system view of to provide a system view of global ocean climate observationsglobal ocean climate observations
A partnership …A partnership …
• PMELPMELUser interface logic & toolsUser interface logic & tools
• NDBCNDBCData assembly & operationsData assembly & operations
& assistance from Todd Pearce (OCO)& assistance from Todd Pearce (OCO)User interface layoutUser interface layout
OSMC (meta)databaseOSMC (meta)database
What is the “climate data record”?What is the “climate data record”?
•Current (meta)data Current (meta)data (“realtime”)(“realtime”)
– GTS -- primary sourceGTS -- primary source
•Historical (meta)dataHistorical (meta)data– poorly integratedpoorly integrated– need “DMAC” integrationneed “DMAC” integration– for now … use a GTS archivefor now … use a GTS archive
(misses e.g. NOAA research cruises)(misses e.g. NOAA research cruises)
OSMC (meta)database at NDBCOSMC (meta)database at NDBC
• Met and Ocean surface data are Met and Ocean surface data are updated daily with GODAE “T-files”updated daily with GODAE “T-files”(06, 12, 18, 24) from the previous day (06, 12, 18, 24) from the previous day ~350 MB of data per day~350 MB of data per dayURL=URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Zhttp://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z
• Updates applied to NDBC-hosted time Updates applied to NDBC-hosted time series metadata from NDBC systemseries metadata from NDBC system
• Ship call sign info from the WMO Pub Ship call sign info from the WMO Pub 4747
OSMC (meta)database at NDBCOSMC (meta)database at NDBC
• Profiling float data from US GODAE Profiling float data from US GODAE ServerServer
• Float updates from JCOMMOPSFloat updates from JCOMMOPSURL = URL = ftp://ftp.jcommops.org/Argo/Status/status.txtftp://ftp.jcommops.org/Argo/Status/status.txt
• Country information is assigned Country information is assigned based on WMO allocation tablebased on WMO allocation tableURL = URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htmhttp://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm
OSMC (meta)database at NDBCOSMC (meta)database at NDBC
• Met and surface ocean database back to June Met and surface ocean database back to June ‘04‘04• Profile data back to January ‘04Profile data back to January ‘04
Platform TypePlatform Type # # ObservationsObservations
ARGO FLOAT 5,4326
CMAN 794,262
DRIFTING BUOY
4,447,127
MOORED BUOY
2,066,686
SHIP 682,757
NOT DEFINED 934,451
Platform_ID Last_Report Type Description Organization URL Country XML
OSMC_Platform
ID Name Abbrev
OCMC_Country
ID Name Country URL Contact_Name Contact_Email
OSMC_Organization
Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML
OSMC_Observation
OS
MC
Data
base –
En
tity
D
iag
ram
Country is based on ISO 3166, which defines unique 2-character identifiers for each country
Organization identifies an agency, institute, university, or private company that owns or operates a reporting platform
Platform identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data
Observation records the instance of a marine observation for a reporting date and time.
OSMC Database OSMC Database EnvironmentEnvironment
• Dell PowerEdge 2650Dell PowerEdge 2650– Dual Processor 3.06 GHz/1MB CacheDual Processor 3.06 GHz/1MB Cache– Five 146 GB HarddriveFive 146 GB Harddrive– Red Hat Enterprise Linux ES v3Red Hat Enterprise Linux ES v3
• Oracle DatabaseOracle Database
OSMC (meta)databaseOSMC (meta)database
• Gridded filesGridded filesObservation metadata are Observation metadata are summarized into 1X1 degree gridded summarized into 1X1 degree gridded files (netCDF) to support evaluation files (netCDF) to support evaluation operationsoperations
OSMC must provide:OSMC must provide:
•Overview (where are the obs?)Overview (where are the obs?)
•Drill-down (what are the obs?)Drill-down (what are the obs?)
•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)
Reports in Time frame
Reports in Time frame
Average of obs
Average of obs
Percentage of Adequate Sampling
Percentage of Adequate Sampling
countrycountry
platformplatform
Parametervalue
Parametervalue
Time sinceLast report
Time sinceLast report
STD deviationfrom
Climatology (future)
STD deviationfrom
Climatology (future)
Observing System Monitoring Center
DOMAIN
Selectglobal, oneocean, orpoint and
drag aregion.
PLATFORMS
Select oneor a set
ALL
SHIPS OFOPPORTUNITY
TROPICALMOORINGS
DRIFTERS
TIDE GAUGES
ARGO
REFERENCESTATIONS
COASTALMOORINGS
GLOBAL
ATLANTICOCEAN
PARAMETERS
Select oneor a set
SST
SEA SURFACEPRESSURE
SEA SURFACEWIND
UPPER OCEANTEMPERATURE
SURFACECURRENTS
SUBSURFACECURRENTS
SEA LEVEL
PRECIPITATION
RADIATION
AIRTEMPERATURE
PCO2
OCEAN CARBON
TOTAL DEPTHTEMPERATURE
SEA SURFACESALINITY
SALINITY ATDEPTH
SAVE
BASE MAPMenu bar across top.
Color/symbol key acrossbottom.
UTC clock at upper right.
Any screen orwindow.
PACIFIC OCEAN
INDIAN OCEAN
SELECT AREGION
High-to-low(hot-to-cool)color scale.
CLOCK
UTC
DATA POINTSIf IPRC, filled circle. Ifnot, open circle from
Monterey. If not, crossfrom telemetry.
RESEARCHVESSELS
TRANSPORTARRAYS
UTILITIES
LOCAL TIME INSELECT CITIES
BASE MAPAPPEARANCE
DATA POINTAPPEARANCE
TEXT
DRAW
Zoom
Web toMonterey,
IPRC
Hard Wire toTelemetry
Time FrameTime Frame
Select OneSelect One
ArbitraryRange
ArbitraryRangeConvenience
choices
Convenience choices
TodayToday
yesterdayyesterday
2 days ago2 days ago
This weekThis week
Last weekLast week
This quarterThis quarter
Last quarterLast quarter
othersothers
Data SourceData Source
Select one orboth
Select one orboth
IndividualObs
IndividualObs
Gridded Field
Gridded Field
Color byColor by
otherother
Select OneSelect One Select OneSelect One
1x1 degree1x1 degree
3x3 degree3x3 degree
5x5 degree5x5 degree
10x10 degree10x10 degree
Levitusvariability
(via NVODS)
Levitusvariability
(via NVODS)
Levitus meanValue
(via NVODS)
Levitus meanValue
(via NVODS)
1Major ocean Basins
(N. Atlantic, Trop.
Atlantic,etc.)
1Major ocean Basins
(N. Atlantic, Trop.
Atlantic,etc.)
1Whole globe
1Whole globe
Drill DownDrill Down
Grid cell
Grid cell
Single Observation
Single Observation
Select oneSelect one
Select OneSelect One
Metadata report
Metadata report
Instrument history
Trace map
Instrument history
Trace map
InstrumentMeasurementTime series
InstrumentMeasurementTime series
Plot of profileValues (future)
Plot of profileValues (future)
Select OneSelect One
StatisticsSummary of Obs in grid
Cell
StatisticsSummary of Obs in grid
Cell
Clickable listOf
Individual Reports
Clickable listOf
Individual Reports
1.Gridded fields shown with graticuleoverlay. Click on grid cells for drill down
KEY: Blue = Completed Red = FY05 Work Green = System Navigation Note: Data accumulation will occur over time. Currently the database has data
from 1 June 2004, however, it will be back filled to 1 January 2004
User interface & User interface & tools for tools for
evaluationevaluation
Web-accessible to the Web-accessible to the communitycommunity
Visualization & evaluationVisualization & evaluationOverviewOverview
all platforms reporting today
Visualization & evaluationVisualization & evaluationOverviewOverview
all platforms reporting air temp. today
all platforms reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
all platforms reporting SST today colored by age
Visualization & evaluationVisualization & evaluationOverviewOverview
Drifters reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. drifters reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. drifters reporting SST this week
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. Pacific drifters reporting SST this week
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. Pacific drifters reporting SST this month
mouse click for metadata summary
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
mouse click to view data
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
mouse click to view plot
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
User interface & tools for User interface & tools for evaluationevaluation
•Overview (where are the obs?)Overview (where are the obs?)
•Drill-down (what are the obs?)Drill-down (what are the obs?)
EvaluationEvaluation(adequacy of the observations)(adequacy of the observations)
Number of platforms per 1x1 degree box reporting SST today
Visualization & evaluationVisualization & evaluation
Number of platforms per 1x1 degree box reporting SST this week
Visualization & evaluationVisualization & evaluation
Number of platforms per 1x1 degree box reporting SST this month
Visualization & evaluationVisualization & evaluation
Number of platforms per 5x5 degree box reporting SST this month
Visualization & evaluationVisualization & evaluation
5x5 degree boxes this month that had one or more SST obs every day
Visualization & evaluationVisualization & evaluation
Percentage of days when a 5x5 degree box had at least 5 SST obs
Visualization & evaluationVisualization & evaluation
Click for time series record of SST obs in a single 5x5 grid cell
Visualization & evaluationVisualization & evaluation
Click for time series record of SST obs in of an ocean basin
Visualization & evaluationVisualization & evaluation
Click for global time series of SST obs
Visualization & evaluationVisualization & evaluation
OSMC LAS
The OSMC doesn’t look like a Live Access Server …but it is
(Shown is the more traditional LAS user interface)
“Adopt-a-Drifter”is another specialized user interface to the same OSMC server
Ready for integration into NVODS, DMAC, and IOOS
Ocean CO2 data access with LAS
Next stepsNext steps• Wire it together robustlyWire it together robustly
(It is not as mature as it appears)(It is not as mature as it appears)
• Improve performanceImprove performance
• User interface make-overUser interface make-over(w/Todd Pearce(w/Todd Pearce))
• Full support for profile dataFull support for profile data
• Bring NGDC/NOSA GIS efforts into Bring NGDC/NOSA GIS efforts into the partnershipthe partnership
Next steps (database)Next steps (database)
• Improve Meta-data quantity and qualityImprove Meta-data quantity and quality– Eliminate “Not Defined” platformsEliminate “Not Defined” platforms
•Further coordinate with JCOMM OPSFurther coordinate with JCOMM OPS– Add organization URLsAdd organization URLs
• Expand data sourcesExpand data sources – Carbon Data Carbon Data – NOAA High Resolution Ship Data (FSU)NOAA High Resolution Ship Data (FSU)– Repeat Lines, Ocean Reference Stations, …Repeat Lines, Ocean Reference Stations, …
and after that …and after that …
• Other types of dataOther types of data(biochem, fisheries, …)(biochem, fisheries, …)
• IOOS/DMAC integrationIOOS/DMAC integration(satellites, models, GIS, …)(satellites, models, GIS, …)
• Quality control metadataQuality control metadata
• Expanded evaluation metricsExpanded evaluation metrics
to be guided by community input …to be guided by community input …
Suggestions? Questions?Suggestions? Questions?