Geospatial Metadata and Spatial Data WorkshopGeospatial Metadata and Spatial Data Workshop

Workshop ProgrammeWorkshop ProgrammePRESENTATION SESSION:PRESENTATION SESSION:

Background information

Metadata, standards and application profiles

UK Academic Geospatial Metadata Application Profile, Version 2 (UK AGMAP 2) and guidelines

Geodoc Metadata Editor tool, Go-Geo! portal and other resources

ShareGeo Open spatial data repository

Look at current and future activities

REFRESHMENTS (15 - 30 minutes)REFRESHMENTS (15 - 30 minutes)

DEMONSTRATION/HANDS-ON SESSION: DEMONSTRATION/HANDS-ON SESSION:

Geodoc Metadata Editor tool, Go-Geo! portal and ShareGeo Open spatial data repository

BackgroundBackground three decades of GIS and spatial

data capture technology

an eclectic range of academic disciplines using GIS as a research and teaching tool

considerable cost and time invested in spatial data creation

*2006 spatial data audit at 4 universities: +500 dataset files, 100s of orphan datasets

Requires a spatial data management, discovery and sharing solution delivered through portal technology and metadata metadata.

So what is So what is METADATAMETADATA?The word appears to be of Greek and Latin origin……

but metadatametadata represents something completely different……

Photographic Images copyright: Jupiter Images 2006

Photographic Images copyright: Jupiter Images 2006

and it’s not sun and holiday

Represents a documented and ordered summary of information that describes something, in this case, a spatial dataset.

Provides the What, Where, When What, Where, When and WhyWhy of a dataset, Ownership Ownership and and ContactContact details and Access Access andand Use Use conditions.

Think of metadata as a recipe for making beer…..Think of metadata as a recipe for making beer…..

WhatWhat are the ingredients?

WhatWhat are thebrewing steps?

WhoWho sells the ingredients or

Wherehere can youbuy them?

Purpose of makingbeer?

Metadata (data describing data)Metadata (data describing data)

Photographic Images copyright: Jupiter Images 2006

An incentive to encourage metadata creation?

WhereWhere is the study area represented in the data?

WhenWhen were the data collected?

WhatWhat is the dataset’s purpose? 

spatial reference system? spatial accuracy? type of application? processes or algorithms used?

WhoWho supplies the data?

WhatWhat do these polygons represent?

WhatWhat attribute information is associated with these polygons?

So why metadata? So why metadata? Can you tell me fromCan you tell me fromthese files…..these files…..

WhatWhat do these SOILCLASS

values mean?

WhatWhat does this attribute mean?

These questions can be answered in one

metadata record

The relevance of geospatial metadataThe relevance of geospatial metadata

Useful for local data management

DatasetDatasetCreator/Creator/

UserUser

MetadataMetadata RecordRecord

Spatial dataset Spatial dataset DirectoryDirectory

SpatialSpatialDatasetsDatasets

MetadataMetadataDirectoryDirectory

GeoportalGeoportal: an interface to run searches on the internet to locate geographical resources, and to discover, harvest and publish metadata records representing spatial data and geo services.

A geoportal enables users to search and discover geospatial metadata using

geographic location (co-ordinates and place name) free text date resource type

GeoportalGeoportal

Metadata Metadata RecordRecord

Spatial Spatial DatasetsDatasets

and and Geo-servicesGeo-services

Useful to discover spatial data and services via metadata published Useful to discover spatial data and services via metadata published on a Geoportal on a Geoportal

Dataset B (Contours)

Dataset A (Raster Map)

Dataset C (3D Model)

Revealing and sharing spatial data from different sources Revealing and sharing spatial data from different sources offers potential for creating new datasetsoffers potential for creating new datasets

© Crown Copyright/database right 2008

© Crown Copyright/database right 2008© Crown Copyright/database right 2008

© Crown Copyright/database right 2008© Crown Copyright/database right 2008

and developing GIS applicationsand developing GIS applications

Other benefits: data protectionOther benefits: data protection

Photographic Images copyright: Jupiter Images 2006

protects investments of time and cost dedicated to dataset creation and development;

maintains an inventory of datasets to reduce time required to re-assess existing datasets for new and future applications;

ensures integrity of existing and new datasets using metadata as a tracking mechanism to monitor changes and edits to datasets;

reduces and minimises the disruptive effects of staff turnover;

eliminates or reduces the risk of redundancy in dataset collection;

accidental deletion of dataset files.

1. Intellectual Property Rights (IPR)2. residual licensed data rights for derived data 3. liability fears4. concerns over data quality (data creator and user)5. privacy and security6. time and cost for data delivery7. data transformation and harmonisation (scale, positional

accuracy, projections, formats)8. legacy data9. time and cost to anonymise data for release10. time and cost for metadata record updates, especially descriptive

level metadata11. performance, maintenance and enhancements of portals and

repositories12. data archiving13. data and software warehousing issues14. long-term commitment and investment in the infrastructure15. revisions to standards16. confusion about standards compliance and which standard to use

1. Intellectual Property Rights (IPR)2. residual licensed data rights for derived data 3. liability fears4. concerns over data quality (data creator and user)5. privacy and security6. time and cost for data delivery7. data transformation and harmonisation (scale, positional

accuracy, projections, formats)8. legacy data9. time and cost to anonymise data for release10. time and cost for metadata record updates, especially descriptive

level metadata11. performance, maintenance and enhancements of portals and

repositories12. data archiving13. data and software warehousing issues14. long-term commitment and investment in the infrastructure15. revisions to standards16. confusion about standards compliance and which standard to use

Still issues though!Still issues though!Still issues though!Still issues though!

Metadata standardsMetadata standards provide precise specifications; enforce and ensure consistency and interoperability; define and describe metadata entities and data elements; classify and group relevant metadata elements with entities; assign structure and conditions (obligations, data type, domain).

Dublin Core (ISO 15836)Dublin Core (ISO 15836) Dublin Core: 15 elements to facilitate simple resource discovery

in a networked environment (e.g. internet or library)

Photographic Images copyright: Jupiter Images 2006

Geospatial metadata standardsGeospatial metadata standards

Federal Geographic Data Committee (FGDC) Content Standard Federal Geographic Data Committee (FGDC) Content Standard for Digital Geospatial Metadata (CSDGM)for Digital Geospatial Metadata (CSDGM) introduced in mid 1990s for documenting spatial datasets.

ISO 19115 Metadata Standard for Geographic InformationISO 19115 Metadata Standard for Geographic Information was ratified in 2003 and supersedes FGDC.

Geospatial metadata standards are critical for supporting Geospatial metadata standards are critical for supporting metadata creation and………………………… metadata creation and…………………………

OtherContent Providers

NGDF/GIgatewayNetwork

Geo-data Gateway

Local Go-Geo!database

Geoportal

portal interoperability and search capabilities across the internet.

User

Centre for Ecology and Hydrology (CEH)Centre for Ecology

and Hydrology (CEH)

National Environment Research Council (NERC)

National Environment Research Council (NERC)

National Soil Resources Institute (NSRI)

National Soil Resources Institute (NSRI)

Geospatial Metadata Application ProfilesGeospatial Metadata Application ProfilesISO 19115 standard has too many elements (300+)

* An application profile is derived from a standard and represents a reduction of the number of entities and elements.

* It should include the core element set of a standard to support interoperability across the wider geospatial community (DiscoveryDiscovery level level metadata).

* Should include elements for DescriptiveDescriptive level metadata?

* It can be extended to include elements which are best suited for a working group’s specific applications.

Example: The Biological Data Profile (BDP)The Biological Data Profile (BDP)

An approved profile with additional elements to allow for documenting biological information such as taxonomytaxonomy, m, methodologyethodology and analytical toolsanalytical tools.

* An application profile is derived from a standard and represents a reduction of the number of entities and elements.

* It should include the core element set of a standard to support interoperability across the wider geospatial community (DiscoveryDiscovery level level metadata).

* Should include elements for DescriptiveDescriptive level metadata?

* It can be extended to include elements which are best suited for a working group’s specific applications.

Example: The Biological Data Profile (BDP)The Biological Data Profile (BDP)

An approved profile with additional elements to allow for documenting biological information such as taxonomytaxonomy, m, methodologyethodology and analytical toolsanalytical tools.

http://www.flickr.com/photos/f10n4/186861991/http://www.flickr.com/photos/f10n4/186861991/

Creating application profiles from ISO 19115Creating application profiles from ISO 19115

ISO 19115Metadata Standard

CoreElement Set

Application

Profiles

Academia (43 + 33=76)

Public Sector(43 + 62=105)

Private Sector(43 + 12=55)300+

elements

43 elements

HealthHealth

GeologicalSciences

GeologicalSciences

SpecialisedAPs

* ANZLIC Metadata Profile

* North American Application Profile (NAP), Canada and the US

** INSPIRE Directive Metadata Guidelines** INSPIRE Directive Metadata Guidelines

** UK GEMINI 2.1** UK GEMINI 2.1, an INSPIRE compliant geospatial metadata standard for the UK

* ANZLIC Metadata Profile

* North American Application Profile (NAP), Canada and the US

** INSPIRE Directive Metadata Guidelines** INSPIRE Directive Metadata Guidelines

** UK GEMINI 2.1** UK GEMINI 2.1, an INSPIRE compliant geospatial metadata standard for the UK

Infrastructure for Spatial Information

in the European Community (INSPIRE)

Infrastructure for Spatial Information

in the European Community (INSPIRE)

*European Commission (EC)*European Environment

Agency (EEA)*Representatives from

Member States (Mapping/GIS)

*European Commission (EC)*European Environment

Agency (EEA)*Representatives from

Member States (Mapping/GIS)

INSPIRE Directive Metadata GuidelinesINSPIRE Directive Metadata Guidelines

INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC] Targets electronic spatial data and services for environmental information.

Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information.

These data and services to be delivered through initiatives across Europe.

INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales.

Scotland’s Parliament enacted a complementary regulation which came into force on the same date.

Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services.

Includes UK academia as it must comply with the Freedom of Information Act, 2000.

Targets electronic spatial data and services for environmental information.

Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information.

These data and services to be delivered through initiatives across Europe.

INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales.

Scotland’s Parliament enacted a complementary regulation which came into force on the same date.

Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services.

Includes UK academia as it must comply with the Freedom of Information Act, 2000.

• Provide metadata catalogues to reveal what information is available.

• Provide online data discoverydiscovery, viewview, downloaddownload and transformationtransformation (interoperability) services.

• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations.

• Set up e-commerce arrangements where charging is applicable.

• Introduce monitoring mechanisms to show that information is being made available.

• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure.

• Comply with the 34 data specifications in three annexes (reference geographies, environmental datasets).

• Provide metadata catalogues to reveal what information is available.

• Provide online data discoverydiscovery, viewview, downloaddownload and transformationtransformation (interoperability) services.

• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations.

• Set up e-commerce arrangements where charging is applicable.

• Introduce monitoring mechanisms to show that information is being made available.

• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure.

• Comply with the 34 data specifications in three annexes (reference geographies, environmental datasets).

INSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member states

INSPIRE spatial data themes and deadlines for creating metadataINSPIRE spatial data themes and deadlines for creating metadata

INSPIRE Metadata Editor and GeoportalINSPIRE Metadata Editor and Geoportal

* First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework (NGDF)

* Targeting the UK public sector

* 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive.

* First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework (NGDF)

* Targeting the UK public sector

* 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive.

UK GEMINIUK GEMINI

UK Location Programme (UKLP) is a pan-government

collaborative initiative with theresponsibility to develop and implement

the INSPIRE Directive 2007/2/EC and the UK Location Strategy.

UK Location Programme (UKLP) is a pan-government

collaborative initiative with theresponsibility to develop and implement

the INSPIRE Directive 2007/2/EC and the UK Location Strategy.

UK Location Metadata Editor and Catalogue (beta) supports UK GEMINI 2.1

UK Location Metadata Editor and Catalogue (beta) supports UK GEMINI 2.1

http://www.flickr.com/photos/musebrarian/3289649684/#/http://www.flickr.com/photos/musebrarian/3289649684/#/

Geo resources for UK academiaGeo resources for UK academia

UK Academic Geospatial Metadata Application UK Academic Geospatial Metadata Application Profile, Version 2 (UK AGMAP 2)Profile, Version 2 (UK AGMAP 2)

UK AGMAP 2 created to support the specific needs of the UK H&FE academic communities.

Comprises elements from ISO 19115, UK GEMINI 2 and INSPIRE.

Supports documentation of a dataset, dataset series or geo service for the purpose of discovery and description.

Mapped to Dublin Core, FGDC, INSPIRE, UK GEMINI 2 and DDI.

UK AGMAP 2 profile for datasets

and dataset series

UK AGMAP 2 profile for datasets

and dataset series

Contact details = 7

Drop down lists = 10

Contact details = 7

Drop down lists = 10

Red = MandatoryRed = Mandatory

Green = ConditionalGreen = Conditional

32 mandatory32 mandatory

91 elements 91 elements

UK AGMAP 2 profile for

Geo-services

UK AGMAP 2 profile for

Geo-services

Contact details = 7

Drop down lists = 6

Contact details = 7

Drop down lists = 6

Red = MandatoryRed = Mandatory

Green = ConditionalGreen = Conditional

25 mandatory25 mandatory

40 elements 40 elements

Contain descriptions and examples to assist metadata creators and Go-Geo! portal users from numerous, eclectic academic disciplines.

UK AGMAP 2 GuidelinesUK AGMAP 2 Guidelines

Most spatial data information is stored in our heads.

We need to move it from there to electronic files.

Metadata CreationMetadata Creation

Photographic Images copyright: Jupiter Images 2006

Mind reading aliens?

Solutions?Solutions?Solutions?Solutions?

Spatial data extraction device?

Geodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor Tool

Geodoc design and functionality• Java-built online tool

• authentication required

• text fields and drop-down lists for entering information

• validation (red fields)

access to metadata guidelines and Geodoc reference guide.

MyGo-Geo! automation and customisation tool

Geodoc coordinate extent toolGeodoc coordinate extent toolMap tool captures co-ordinate values for bounding box elements used to define the extent of a dataset’s study area.

Extents for Nations at the click of the mouse

Extents for Nations at the click of the mouse

Direct links at click of button to metadata guidelines ‘Help’ pages Direct links at click of button to metadata guidelines ‘Help’ pages

Personal and secure directory for storing, editing and exporting metadata records.

Geodoc exports UK AGMAP 2Metadata records in

user-friendly *.pdf format

Geodoc exports UK AGMAP 2Metadata records in

user-friendly *.pdf format

Publication on open or private (institutional) nodePublication on open or private (institutional) node

1,2) create and validate record;

3) submit record for review;

4,5) Metadata creator is contacted and record subsequently published on the Go-Geo! portal

11

22 33 55

A few easy steps to publication of a metadata A few easy steps to publication of a metadata record using Geodocrecord using Geodoc

44

Photographic Images copyright: Jupiter Images 2006

A simple interface designed for UK academia to run queries to discover metadata for spatial datasets.

The portal enables searching by the use of various options including

-free text -date -resource type -geographic location

www.gogeo.ac.ukwww.gogeo.ac.uk

Go-Geo! PortalGo-Geo! PortalGo-Geo! PortalGo-Geo! Portal

Go-Geo! simple searchPlace name search

using Unlock middleware gazetteer

Place name search using Unlock

middleware gazetteer

Search results page and extents display

Metadata record published on Go-Geo!

Links between Go-Geo! portal elements to UK AGMAP 2 guidelines

Advanced search

- Data Type- Location- Text- Date Range

- Data Type- Location- Text- Date Range

*BGS JIDI Photo Collection

*COPAC

*BGS JIDI Photo Collection

*COPAC

Access to metadata records published on institutional (private) nodeAccess to metadata records published on institutional (private) node

Why publish metadata on the Go-Geo! portal?Why publish metadata on the Go-Geo! portal?

a repository for you to store and manage your metadata thus savings in cost and time;

use metadata to announce your data and applications;

advertise (and sell?) your spatial datasets to other interested parties in academia and in the private and public sectors;

metadata in the portal can be referenced and cited for project proposals;

could be configured as an internal resource to access and share datasets.

Web resource channelsalmost 3,000 resources

Bookmark resources (MyGo-Geo!)

Other geospatial metadata resources

Geospatial Metadata Workshops July 2007 Aberdeen University Marine/ECO-IMAGINE

Geospatial Technologies Course

2008 Sheffield University

Southampton University

May 2010Plymouth University

2003 Durham University

City University

2004University of Essex

York UniversityStrathclyde University

Bradford University Oxford Brookes

University Coventry UniversityEdinburgh University

Oxford University Kingston University

Sheffield University

2006 Aberdeen University

Leeds UniversityCambridge University

Oxford UniversityStirling University

Glasgow University Heriot-Watt University Strathclyde University

Kingston UniversityGISRUK Conference

(Nottingham)Edinburgh University

Autumn 2010 Cardiff University

Aberdeen UniversityLancaster UniversityGlasgow UniversityLeeds UniversityLeeds University

Civil EngineeringBiological Sciences

Planning

Environmental Sciences

Architecture

Information Technology

Retailing

Climate

Sociology

Library Science Landscape Planning

Archaeology

Mathematics

Health

EcologyGeosciencesComputing

ShareGeo OpenShareGeo Open Key to delivering a Spatial Data Infrastructure (SDI) for the UK academic GI community.

A repository for deposit and extraction of spatial data.

Support access to and sharing of spatial data.

Holds national and international spatial datasets (raster, vector and tabular).

ArcGIS plugin to create metadata to deposit with data.

Spatial dataset extractionSpatial dataset extraction

Spatial data submission: simple metadata record form to complete; extents extracted from datasetSpatial data submission: simple metadata record form to complete; extents extracted from dataset

Ordnance Survey (OS OpenData)

ShareGeo (closed)ShareGeo (closed) Addresses issues surrounding IPR and spatial data derived from

licensed data.

Addresses issues surrounding IPR and spatial data derived from

licensed data.

Current and future activitiesCurrent and future activities

Rebuild Go-Geo! portal with GeoNetworkRebuild Go-Geo! portal with GeoNetworkGeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web.

Provides powerful metadata editing and search functions as well as an embedded interactive web map viewer.

Rebuild Go-Geo! portal with GeoNetworkRebuild Go-Geo! portal with GeoNetworkGeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web.

Provides powerful metadata editing and search functions as well as an embedded interactive web map viewer.

http://www.flickr.com/photos/mndrix/4203609704/http://www.flickr.com/photos/mndrix/4203609704/

-UK AGMAP 2-Guidelines

-Geodoc metadata tool-Go-Geo! portal nodes

-Workshops-eLearning objects

Geography

Archaeology

Geological Sciences

Biological Sciences

Research

Offer Go-Geo! resources for local spatial data management

UK AGMAP 2Guidelines

Geodoc tadata toolCustomised Go-Geo! Portal

NodesTraining

Geography

Archaeology

Geological Sciences

Biological Sciences

Go-Geo!

Go-Go!

Go-Geo!

University A

UK AGMAP 2 Guidelines

Geodoc metadata toolCustomised Go-Geo! Portal

NodesTraining

Geography

Archaeology

Geological Sciences

Biological Sciences

Go-Geo!

Go-Go!

Go-Geo!

University B

UK AGMAP 2Guidelines

Geodoc metadata toolCustomised Go-Geo! Portal

NodesTraining

Geography

Archaeology

Geological Sciences

Biological Sciences

Go-Geo!

Go-Go!

Go-Geo!

University C

UK AGMAP 2Guidelines

Geodoc metadata tool Customised Go-Geo! Portal

NodesTraining

Geography

Archaeology

Geological Sciences

Biological Sciences

Go-Geo!

Go-Go!

University D

Go-Geo!

Open Spatial Data Infrastructure (SDI) Open Spatial Data Infrastructure (SDI) for UK academiafor UK academia

Otherresources and portals

Spatial Data Spatial Data RepositoryRepository

Spatial data

Metadata

Search

Datauser

Metadata

Discover

Locate

Access

Use

Publish

Fit for purpose?

Preserve

Steps to data immortality

Encourage and promote more metadata creation and publication.

*Cambridge, Edinburgh, Kingston, Leeds, Sheffield and Southampton have created and published more than +200 metadata records on Go-Geo! portal (global and private).

Engage with UK academic institutions to identify INSPIRE data.

The way forward…..The way forward…..

Questions?