MAMA Workshop MAMA Workshop on Marine Data & Information Managementon Marine Data & Information Management

Malta, 28Malta, 28thth January 2004 January 2004

Recent experiences and future plans in oceanographic data management

of the Mediterranean and Black Sea

Several data management actions have been made in a global international context

1996-1999 MTPII-MATERwww.ifremer.fr/sismer/program/mater/

1998-2001 MEDAR/MEDATLAS IIwww.ifremer.fr/sismer/program/mater/

MFSPP-MFSTEP1998-20012003-2006 www.bo.ingv.it/mfstep/

+ meta-data: Sea-search, EDIOS

They have been made possible by the development of common standards and infrastructures

WOCE/JGOFS, OMEX, CANIGO

GODAR

ARGO

MTPII-MATER 1996-1999MAss Transfer and Ecosystem Response

58 research groups from 10 EU Member States and 3 non-EU States 108 cruises (more than 1000 days of ship time)

130 long time series from fixed mooring and lagrangian drifters

254 main scientific equipments

A reference good quality multidisciplinary database > 200 parameters collected by:

MATER Database

Data Management Structure

Three regional Data CentresWesternCentralEastern

Publication of the Database on CDRom

MEDAR/MEDATLAS IIMEDAR/MEDATLAS II

EC-MAST Concerted Action (MAS3-CT98-0174/ERBIC20-CT98-0103)

DATA BASE CONTENTDATA BASE CONTENT(PARAMETERS)

Parameter Nb of Profiles Parameter Nb of Profiles

Temperature

284 371 Nitrite 10 508

Salinity 118 009 Ammonium 5 239

Oxygen 44 928 Chlorophyll 4 672

Phosphate 20 761 Alkalinity 2 548

Silicate 15 920 Total Phosphorus

2 381

PH 14 512 H2S 1 843

Nitrate 10 572 Total Nitrogen

153

SALINITYSALINITY

CHLOROPHYLLCHLOROPHYLL

CLIMATOLOGYMethodology

Computation of Climatological Analysis by Variational Inverse Model (VIM) algorithms

Computation made on finite elements and then re-interpolated on a regular grid (0.2 degrees in Latitude and Longitude), with smaller scales for local computations

T, S and bio-chemical climatology reviewed by regional experts and modellers

http://modb.oce.ulg.ac.be/Medar

CLIMATOLOGY - CLIMATOLOGY - ResultsResults

Selected numerical fields depending on data availability:

Annual , seasonal and monthly climatology

Temperature, Salinity

Annual and seasonal

Oxygen, Silicate, Phosphate

Hydrogen sulphide (H2S) in the Black Sea

Annual only

Nitrate, Nitrite, pH, Ammonium, Alkalinity, Chlorophyll

No climatology

Total Phosphorus, Total Nitrogen+ 2500 horizontal maps, vertical sections and data

location

SALINITY at 10m SALINITY at 10m DepthDepth

CD-ROM 4: climatology Black Sea + E-Mediterranean

CD-ROM 3: ClimatologyGlobal + W-Mediterranean

DATA PRODUCTDATA PRODUCT(A set of 4 CD-ROMs)

CD-ROM 2: DatabaseObserved data + SELMED interface for extraction (according to various criteria), interpolation and visualization - export formats: MEDATLAS, CSV or ODV.

CD-ROM 1: Documentation on the project and its resultsCruise inventorySoftware

QCmedarODV

MFSPP Real time data management

VOS Voluntary Observing ShipM3A Multisensor Moored Array MEDARGO Subsurface Profiling SystemGLIDERS Basin Wide Monitoring Technology Atmospheric forcing dataSatellite Data

MFSTEP RT Data Access XBt

MFSTEP RT Data Access – MEDARGO Floats

Standardization

mandatory meta-dataISO 19115

common exchange format(s) : ASCII : MEDATLAS NetCdf : ARGO/MFSTEP

quality controlsOn dataOn products

Requested for interoperability :Communication protocol

Marine XML

QUALITY CHECKS

QCO : Automatic check of the formatQC1 : Automatic and visual check of the headers

QC2 : Automatic and visual check of the data points

a quality flag to each numerical value (GTSPP flag scale)

QC1: Location, date, duplicates

QC-2 : check of the data points

Automatic Checks ResultPressure + one more

observation (E)Out of the regional scale

(min & max values)Increasing pressure

Data below the bottom depthCoherence with pre-existing

statistics (LEVITUS, MODB, MEDATLAS)

No constant profilesSpikesVertical stability

E= Elimination

Conclusion 1: Present available Conclusion 1: Present available data infrastructure and services data infrastructure and services for the Mediterranean and Black for the Mediterranean and Black

SeaSea

The data management network of NODC/DNA disseminate data from national and international programs provides basic data services:Implementation of internationally agreed protocols (when available) and practices for data formatting and checking,Continuous compilation of national data, quality checking with feedback to source scientists, perennial archiving,Data dissemination : routine regional or thematic subsets, and answers to specific requests,State of the art watch to develop standards and make use of the communication technology.

Conclusion 2: What remain to be done

Direct internet access to the most complete and integrated data sets : historical data + data released in recent projects +real time data more quality data and products such as estimates of the mean, decadal, seasonal, monthly statistics at basin, regional and shelf scalesInsure continuity and integration with other Pan-European and international programs:

Avoid to stop the dynamicsCompatibility with other networks

Develop the standardization with ISO 19115 and Marine XML, especially for meta-data and communicationDevelop marketing to and feedback from the users

Avoid to create new non compatible systems

SEA-DATANET : New concerted actions in

preparationto develop :

An internet integrated portalA communication protocol (ISO19115, Marine XML) between local systemsQuality Control procedures to be applied on data and products according to the existing international standards or standards developed in the project, especially for non-physical dataMarketing of the user community, to get more data and provide better servicesEnhanced international cooperation & capacity building activities

Sea Data network

a semi-distributed model that incorporates, but enhances, the existing infrastructures

professional archiving centresscientific centres SMEs

User

Elements of the Oceanographic Data System

Science Centres

Data Centres

Data & Meta Data Scientific

ProductsStandard Products

Phases of Sea-Datanet

1. Design study : protoype of the system On line networking of a limited number

of centre to provide data Access to all via internet Test of feasibility and cost estimation

for any current parameter2. Development of the system

On extended network of data sources On a limited number of parameters

3. Implementation and evolution

Expected long term results of Sea DataNet

Standardize, secure and disseminate the data holding of the Pan-European communityDecrease or optimisation of the overall costs of the data management of the projects Training on standards and methodologies developed in the projectRobust statistics and trends over the last decades of the physical and bio-chemical parametersA recognised Pan-European data infrastructure able to contributes to international programmes related to GOOS/MEDGOOS, CLIVAR,JGOFS..