MEDIN Partners Meeting 2010

Submitting data to and using Data Archive Centres

MEDIN aims to provide:

•secure long-term management of marine data sets by setting up a network of Data Archive Centres (DACs)

•improved access to authoritative marine data held in this network, through a central discovery metadata portal

•an agreed set of common standards for metadata, data format and content maintained and supported by partners

•guidelines, contractual clauses and software tools to support standards and best practice data management

DACS are the beating heart of the MEDIN network and the

delivery mechanism

2013

Fisheries Marine water geophys marine bathymetrymet. column / geology species

oceanog. & habitats

Discovery /evaluation metadata

Users

Data search

DAC and data

specification standards

Metadata standards

Data in from partners and govt contracts

metadata in from external databases

tools

tools

Resources, Products and

services

Current coveragethere are four accredited MEDIN DACs currently:

   British Geological Survey (BGS) for seabed and sub-seabed geology, geophysics data

   British Oceanography Data Centre (BODC) for water column oceanographic data

   Data Archive for Seabed Species and Habitats (DASSH) for benthic flora, fauna and habitat data

   UK Hydrographic Office (UKHO) for bathymetry data

Additional coverage•Met data

•Heritage data

•Fisheries data

Meeting the MEDIN Data Archive Centre Requirements

ORGANISATIONAL FRAMEWORK• Generally exhibiting evidence of expertise and a track record in the scientific area of the data• Committed to provide sufficient resources for defined period of time and plans for transition if and when it ends • Committed to return of data holdings to originators, or lodging with an alternative and suitable repository, if the DAC becomes unsustainable• Provide annual report as specified by MEDIN

QUALITY CONTROL AND MAINTENANCE• Adherence to MEDIN Discovery Metadata Standard and appropriate international principles• Data collection according to defined quality principles and accepted procedures• Quality assurance of the collected data• Committed to advising third party organisations collecting similar types of data on procedures, and providing data-banking (warehousing) and curation facilities for such similar data from other sources

TECHNICAL INFRASTRUCTURE• Databasing and banking with appropriate metadata standards• Auditable process for long term custodianship and updating of data sets, with appropriate disaster planning

USER ACCESS AND COMMUNICATION• Committed to, and focus on, customer service• Committed to raising awareness of the holdings and promoting the use of the data• Making datasets freely available wherever possible (not necessarily at zero cost)

Engaging with the DAC network

Session on how to work with the DACS and submission of data to the network.

Tools now in place to interrogate metadata and to download data from DACS

Future of DACS/MEDINStructures now in place

•How to maintain and expand the network?•How to ensure the network delivers and is able to deliver to partners?•MEDIN Executive team is currently considering the funding options for the MEDIN network and crucially the DACS•MEDIN are looking at sustainability, extending the network only where finances permit and establishing a DAC core funders group.

Data Flows – Key StepsFirst• Identify DAC where data will be archived • Agree where metadata and data will be published by MEDIN

(e.g. to UKLP, INSPIRE) • Define access and licence conditions• Agree format requirements and archiving costs

Collect Data • Generate a unique resource identifier code• Generate, validate and publish metadata record• Prepare data according to appropriate guidelines• Apply Quality Control • Archive data at DAC• Provide data updates as agreed with DAC

Data from consultancy

Metadata created using online tool, URI assigned

Countryside Agency Copies of data and metadata stored at Countryside agency

MEDIN DAC

QA Metadata uploaded to server and available through portalData archived at

DAC

Updates

QA

Accesses data according to availability agreed by Countryside Agency

USER Searches for appropriate data through the

metadata portal

Error(s) found

Errors in data/metadata reported back to Countryside Agency

Flow of Data

Flow of Metadata

User

Case Study 1. Habitat Survey by a Countryside Agency

CSRCruise Report Updates

Metadata conversion mapping CSR to MEDIN metadata and schematron, URI assigned.

This may be carried out either by the fisheries laboratory or the DAC, to be decided with

the fisheries lab

MEDIN metadata

MEDIN DAC

QA according to type Metadata made available onlineData archived (Including Cruise Reports and CSRs)

USER

Searches for appropriate data using metadata on webportal

Accesses appropriate data according to availability agreed

by Fisheries Laboratory

Cruise data

Fisheries Laboratory

Cruise Data

Error(s) found

Errors in data reported back to Fisheries lab

Flow of Data

Flow of Metadata

User

Case Study 3. A Research Cruise by a Fisheries Laboratory

1 2 3 4 5

Habitat Survey by Countryside Agency

Environmental Survey by Policy Agency

Research Cruise by Fisheries Laboratory

Data Collected for CSEMP and submitted to MERMAN

Metadata on Routine Monitoring programmes submitted to UKDMOS

Unique Resource Identifier Contractor / MEDIN tool Data collection contractor or interim data management contractor/ MEDIN tool

Fisheries Laboratory / MEDIN tool

Organisation/UKDMOS Monitoring Agency / MEDIN tool

Metadata Generation

Contractor - MEDIN standard / MEDIN mdata tool

Data collection contractor or interim data management contractor:

MEDIN standard / MEDIN mdata tool

Created through mapping from CSR by DAC or Fisheries Lab

MERMAN/UKDMOS Monitoring Agency to UKDMOS and transfer to MEDIN

Validation MEDIN Tool MEDIN tool MEDIN tool UKDMOS to MEDIN metadata transfer

MEDIN translation tool

Publication MEDIN (DAC) MEDIN (DAC) MEDIN (DAC) MEDIN (DAC)? MEDIN

Data Generation MEDIN standards MEDIN standards MEDIN / IOC standards WQ agency Monitoring Agency

Quality Control Countryside Agency /DAC on upload

Data collection contractor / interim data management contractor / DAC

Fisheries Laboratory /DAC on upload

WQ agency (Quasimeme, Bequalm)

Monitoring Agency / DAC on upload

Archival MEDIN DAC Intermediate storage by intermediate data management contractor then MEDIN DAC

MEDIN DAC MEDIN DAC Monitoring Agency / or MEDIN DAC

Update management Countryside agency advises MEDIN DAC

Fisheries Laboratory advises MEDIN DAC

Via updates to MERMAN Monitoring Agency advises MEDIN DAC

Tools used? MEDIN online metadata toolMEDIN tool

MEDIN online metadata tool MEDIN Data Clause appliedMEDIN tool

CSR metadata mapping / MEDIN tool

MEDIN tool MERMAN MEDIN tool MEDIN Translation Tool