metadata creation and validation methods. writing metadata
TRANSCRIPT
Metadata Creation and Validation Methods
Writing Metadata
IT’S NOT SO
BAD!!• First records are the hardest
• Not all fields may need to be filled in
• Tools are available
• Training classes can be taken
• Can often be produced automatically
• Can (and should) be reviewed for updates
Tips for Writing Metadata
Stepsfor
writingquality
metadata
Stepsfor
writingquality
metadata
Writing Metadata
Organize your informationOrganize your information
Write your metadata fileWrite your metadata file
Review your fileReview your file
Have someone else reviewHave someone else review
ReviseRevise
PublishPublish
Organize your informationOrganize your information
Write your metadata fileWrite your metadata file
Review your fileReview your file
Have someone else reviewHave someone else review
ReviseRevise
PublishPublish
•Before you begin writing, get organized
• Document your data as you go
• Write so others can understand
•Always review your document
Writing Metadata
Metadata entry toolMetadata entry tool
coffeechocolate
standard and/orworkbook
ISOeditor
sense of humour!!!
• Write simply but completely
• Document for a general audience
• Be consistent in style and terminology
Keep your readers in mind
• Define all acronyms
• Avoid using jargon• Clearly state data limitations
Keep your readers in mind
Write a complete title that includes…Write a complete title that includes…
• What
• Where
• When
• Who
Writing Metadata
Which is better?
Greater Yellowstone Rivers from 1:126,700 Forest Visitor Maps (1961-1983)
The title is critical in helping others find your data.
Vague: We checked our work and it looks complete.
Specific: We checked our work using 3 separate sets of check plots reviewed by 2 different people. We determined our work to be 95% complete based on these visual inspections.
Be specific. Quantify when you can.
Select your key words wiselySelect your key words wisely
• Use unambiguous words
• Use descriptive words
• Fully qualify geographic locations
• Have someone else read it
• If you’re the only reviewer, put it away and read it again later
• Check for clarity and omissions
Review your final product
• Can a novice understand what you wrote?
• Are your data properly documented for posterity?
When you review your work, ask:
• Does the documentation present all the information needed to use or reuse the data?
• Are any pieces missing?
When you review your work, ask:
Organize your informationOrganize your information
Write your metadata fileWrite your metadata file
Review your fileReview your file
Have someone else reviewHave someone else review
ReviseRevise
PublishPublish
Six Stepsfor
WritingQuality
Metadata
Six Stepsfor
WritingQuality
Metadata
Writing MetadataWriting Metadata
Write so that others will understand
ISO Metadata Creation Methods
Creating ISO MetadataWays to create ISO 19115 metadata
1. Transform from existing FGDC Metadata2. Develop from templates
• ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ISO_Training/Transition_to_ISO/templates/
3. Develop from scratchFGDC Metadata Guidance
– http://www.fgdc.gov/metadata/geospatial-metadata-standards
Transform from Existing CSDGM using XSLT
• Extensible Stylesheet Language Transformations (XSLT) is an XML-based language used for the transformation of XML documents into other XML or "human-readable" documents via stylesheets (XSL).
• The original document is not changed; rather, a new document is created based on the content of an existing one.
• It does NOT guarantee valid XML records against a particular schema!!!! (simply displays the content in a new way.)
This is a part of the mapping for FGDC CSDGM to ISO 19115.
Comments are Best Practices or Questions
Transforming Metadata
Transforming CSDGM to ISO using XMLSpy• Open XMLSpy XML Editor• Open FGDC RSE XML file named
Metadata to Transform.xml• Select “F10” or XSL/Xquery > XSL Transformation from Menu
– Select transform– CSDGM to ISO, use csdgm2iso19115-2.xml– RSE to ISO, use fgdcrse2iso19115-2.xsl
• Run transformation• Select Text for output view• Save as XML
Clue this is FGDC RSE so must use correct transform
Transforming FGDC Metadata using <oXygen/>
• Open <oXygen/> XML Editor• Open FGDC RSE XML file named
Metadata to Transform.xml
• Set up transformation scenario– one time set up– Name the scenario e.g. as “RSE to ISO 19115-2”– Select transform and transformation engine– For RSE to ISO use fgdcrse2iso19115-2.xsl – Select Saxon-PE or EE transformers)
• Run transformation
Transforming FGDC Metadata using MERMAid
• Navigate to record to transform in Record level interface
• Select “Export” tab• Select ISO 19115-2, and “Produce View” button• New window will open• Select ISO 19110 for Section 5, Entity and
Attributes.
Other Transformations• ISO to FGDC• DIF to ISO• FGDC THREDDS• netCDF to ISO• Various ISO and FGDC views• Custom transforms (from databases to metadata
standards)
Transforming Metadata
http://www.ncddc.noaa.gov/metadata-standards/metadata-xml/
Develop Metadata from Templates
• ../pub/Metadata/Online_ISO_Training/Transition_to_ISO/templates
• MDtemplate• for ISO 19115
• MIBiotemplate• for ISO 19115-2 with Biological Extensions
• MItemplate• For ISO 19115-2
ExerciseTransforming FGDC CSDGM Metadata to ISO
19115-2 Metadata Exercise
• ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ISO_Training/Transition_to_ISO/exercises/metadata2transform.xml
Validating ISO Metadata
Tools for Validation
• Schemas
• NameSpaces
• Schematrons
XML Schemas• Defines the structure, content, and some
semantics of XML documents• Pattern that represents the data’s model and
defines the objects, attributes, and relationships• Defines the rules for the structure and content
of an XML document
Which schema do I use?• Use the schema reference at
http://www.ngdc.noaa.gov/metadata/published/xsd/schema.xsd– MD_Metadata root (19115) is found at gmd.xsd– MI_Metadata root (19115-2) is found at gmi.xsd– FC_FeatureCatalogue root (19110) is found at gfc.xsd
• Use biological schema set to document biological records (extends either MD or MI Metadata)
<gmi:MI_Metadata><gmd:fileIdentifier>
<gco:CharacterString>insert text</gco:CharacterString></gmd:fileIdentifier><gmd:language>
<gco:CharacterString>insert text</gco:CharacterString></gmd:language>
xmlns:gmi=“http://www.isotc211.org/2005/gmi”xmlns:gmd=“http://www.isotc211.org/2005/gmd”xmlns:gco="http://www.isotc211.org/2005/gco"
Namespaces
These codes are called namespaces. The namespace is a container providing context and rules for items. A definition of a term may change, depending on what namespace is applied.
Namespace Abbreviationsgco Geographic Common extensible markup language
gfc Geographic Feature Catalogue extensible markup language
gmd Geographic Metadata extensible markup language
gmx Geographic Metadata XML schema
gss Geographic Spatial Schema extensible markup language
gsr Geographic Spatial Referencing extensible markup language
gts Geographic Temporal Schema extensible markup language
gml Geography Markup Language
xlink XML Linking Language
xs W3C XML base schemas
Validation Tips<gmi:MI_Metadata
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:gmd="http://www.isotc211.org/2005/gmd" xmlns:gco= “http://www.isotc211.org/2005/gco”xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:srv="http://www.isotc211.org/2005/srv" xmlns:gml="http://www.opengis.net/gml/3.2" xmlns:gsr="http://www.isotc211.org/2005/gsr" xmlns:gss="http://www.isotc211.org/2005/gss" xmlns:gts="http://www.isotc211.org/2005/gts" xmlns:gmx="http://www.isotc211.org/2005/gmx" xmlns:gmi="http://www.isotc211.org/2005/gmi" xsi:schemaLocation="http://www.isotc211.org/2005/gmi http://www.ngdc.noaa.gov/metadata/published/xsd/schema.xsd">
Schematrons• Used in conjunction with schemas• Checks for additional validation that the schema
cannot check– Content such as west bounding coordinate is west of the
east bounding coordinate• Delivers human-readable error messages
Online Validation Help• ISO Validation FYI
– https://geo-ide.noaa.gov/wiki/index.php?title=ISO_Validation
• Validation Error Guidance for both XMLSpy and oXygen– https://geo-ide.noaa.gov/wiki/index.php?
title=Validation_Error_Guidance• Online Validation
– https://www.ngdc.noaa.gov/docucomp/recordServices
Exercise• Metadata to Fix
– ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ISO_Training/Transition_to_ISO/exercises/metadata2fix1.xml• Open record above in Spy or oXygen• Apply correct schema• Check namespaces• Check validation
Email questions to [email protected]