ceos idn report cocoa beach, fl wgiss-37, april 2014 michael morahan [email protected]
TRANSCRIPT
2
IDN Session Agenda
• WGISS-36 Action Items • IDN website design• New Development 9.9.3 • IDN Metrics • Questions
3
WGISS-35 Action Items
WGISS-36-16
Description: The IDN Interest Group to investigate a DIF Management Tool.
IDN has created a mock-up and started development of tool
4
WGISS-35 Action Items
WGISS-35-7
5
IDN New Design Story-board
IDN New Site Design
6
GCMD/IDN 9.9.1 Release
7
GCMD/IDN 9.9.1 Release
8
GCMD/IDN 9.9.1 Release
9
GCMD/IDN 9.9.1 Release
10
GCMD/IDN 9.9.1 Release
11
GCMD/IDN 9.9.1 Release
12
GCMD/IDN 9.9.1 Release
13
GCMD/IDN 9.9.1 Release
14
GCMD/IDN 9.9.1 Release
15
GCMD/IDN 9.9.1 Release
16
GCMD/IDN 9.9.1 Release
17
GCMD/IDN 9.9.1 Release
18
GCMD/IDN 9.9.3 release
(Spring 2014)
GCMD/IDN 9.9.2 Release
• New Features:• Metadata Mapping Table and API• OpenSearch
19
IDN Release 9.9.3
Metadata Tagging
The IDN/GCMD is implementing a generic metadata tagging API allowing organizations to apply externally defined "Tags" to metadata held in the IDN/GCMD database. These tags are user defined (tied to an account) and are intended to capture metadata details such as:
• Collaborations: work flow process details like "has been reviewed by xyx"
• Catalogers: impromptu grouping of records o events like an earthquakeo similar studies relating to a discipline across providers
• Metadata Handlers: non-scientific data such as an internal tracking number
• Researchers: Personal notes ("cite this record in report abc")
20
IDN Release 9.9.3
API Calls
The latest API can be found on http://gcmddemo.gsfc.nasa.gov/mws/tags with the future destination of the API being the existing public service server http://gcmdservices.gsfc.nasa.gov/mws/tags. Both servers requires an account in the EOSDIS User Registration System (URS) and can be called with the "curl" command or restful software. All tags are tired to the URS account.
21
IDN Release 9.9.3
API Calls
22
IDN Release 9.9.3
XML Output
The primary GET interface will return a list of tags and documents or just one document if an entry id is supplied. Optionally additional metadata information can be specified in the the "sections" list and these tags will be included in the output XML but by default only then entry_id only tags is returned.
23
IDN Release 9.9.3
Tags example:
<?xml version="1.0" encoding="UTF-8"?>
<tags>
<header><time>20ms</time></header>
<result>
<DIF>
<Entry_ID>MOD021KM</Entry_ID>
<Data_Center>...</Data_Center>
<Metadata_Tag>
<Metadata>
<Group>org.ceos.wgiss.cwic</Group>
<Name>public_data_set</Name>
<Value>cwic_public</Value>
<Description> Set to cwic_public when this record is to be included in the CWIC repository </Description>
</Metadata>
<Metadata_Tag>
</DIF>
</result>
</tags>
25
IDN Release 9.9.3
IDN/GCMD OpenSearch
The GCMD OpenSearch implementation has been designed to support both browser integration (via custom search sites in FireFox for example) and API implementers interesting in including IDN/GCMD in distributed searches.
In both cases metadata records can be searched using free text and GCMD Keywords and API writers calling the OpenSearch interface directly can include, GEO Box coordinates, and temporal values.
Results can be viewed in either HTML, Atom, RSS, or CSV (BETA).
All Open Search query results can also be bounded by GCMD portal subsets (portals; predefined queries forces on one discipline and/or provider contribution).
Long result lists are returned in "pages", that is 500 results could be viewed in 10 50 page requests.
26
IDN Release 9.9.3
OpenSearch Description Document (OSDD)
Access to the IDN/GCMD OpenSearch interface begins with the OpenSearch Description Document, a machine readable XML file which describes the capabilities available in the IDN/GCMD implementation of OpenSearch. This document defines how to properly build a query.
http://gcmd.nasa.gov/KeywordSearch/default/openSearch.jsp?Portal=idn_ceos
27
IDN Release 9.9.3
Amongst all the XML there are a set of links inside of "Url" tags that describe the format of a query. Below is an example of the url to call for getting results in the Atom:
<Url type="application/atom+xml" method="GET”
template="http://gcmd.gsfc.nasa.gov/KeywordSearch/OpenSearch.do
?searchTerms={searchTerms}
&count={count?}
&startIndex={startIndex?}
&startPage={startPage?} &MetadataType=0 &output=atom &Portal=idn_ceos" />
28
IDN Release 9.9.3
Explanation: • &amp; is how XML says "&". Type "&" in curl or
browser.• Open Search variables to the URL are described with {} brackets
and ? denotes optional calls • searchTerms - Freetext, GCMD Query Language, GCMD Keywords• pagination - `{count?}`, `{startPage?}`• geo - `{geo:box?}` (code assumes `INTERSECTS` mode)• date - `{time:start?}`, `{time:end?}` (code assumes `T00:00:00Z`)• output - hardcoded in each URL, possible options include:
• HTML - uses standard IDN/GCMD view for the requested portal• ATOM - most robust output• RSS - simple and basic• CSV - XSL compatible spreadsheets are fun and cool!
• portal - hardcoded in each URL, defaults to GCMD, can use idn_ceos for the IDN, see: http://gcmd.nasa.gov/add/portals.html
29
IDN Release 9.9.3
Results:
Results very based on the standards for each output type but in all cases Entry IDs and urls to more detailed descriptions can be found for records in the IDN/GCMD database. In the atom response you should expect URLs in link tags for example:
<link rel="alternate" type="text/html" title="permalink" href="http://gcmd.nasa.gov/r/d/SHADOZ_TAHITI"/>
Try it out:
A search for the first 10 records with a word that starts with water (water*) in a specific location and time within the IDN subset:
curl"http://gcmd.nasa.gov/KeywordSearch/OpenSearch.do?searchTerms=water*&output=atom&count=10&startPage=1&geoBox=-150,-45,-150,45&timeStart=2000-02-14&timeEnd=2010-02-14&Portal=idn_ceos""
30
IDN Release 9.9.3
Further Reader:
• http://gcmd.nasa.gov/Connect • http://gcmd.nasa.gov/add/portals.html • http://gcmd.nasa.gov/learn/faqs/search_directions.html
31
IDN Metrics
IDN SiteMarch 2013 – March 2014
Total Visits: 34,672
Average Visits per day: 88
Average Visits per month: 2,667
Total Page Views: 69,289
Average pages viewed per day: 175
IDN Usage by Continent
IDN Usage by Country
Top 5 Countries:
1) United States2) China3) India4) Republic of Korea5) Canada
User Access of CSW
Total Visits: 42,807 Average Visits per day: 108Total Page Views: 1,222,882 Average Page Views per day: 3,088
2014
2013
User Access of GCMD Services
Total Visits: 77,478 Average Visits per day: 212Total Page Views: 283,679 Average Page Views per day: 777
Other
36
US GEO/GEOSS MetricsCurrent IDN/GCMD Database Statistics
Total ISO-19115 Metadata Records in CSW Server: 24733
ISO-19115 Metadata Records Tagged as GEOSSDataCore: 9697
(+15 INPE & +1 JAXA Metadata Records)
Centers for Disease Control and Prevention (CDC) 18
Department of Homeland Security (DHS) 8
National Oceanic and Atmospheric Administration (NOAA) 1720
Department of Defense (DOD) 142
Department of Energy (DOE) 336
Department of the Interior (DOI) 1998
Department of State (DOS) 15
Department of Transportation (DOT) 23
Environmental Protection Agency (EPA) 164
National Aeronautics and Space Administration (NASA) 4788
National Science Foundation (NSF) 1541
Smithsonian Institute (SI) 46
U.S. Department of Agriculture (USDA) 710
US GEO Data Core Contributions by Agency:
37
IDN Statistics Page
• IDN Statistics Page link:• Stats:
o CEOS DIF countso CEOS DIFs by Parameterso CEOS DIFs by Source_Name Bucket (Platform Type)o CEOS DIFs by IDN_Nodeo CEOS DIFs by Data Center
• http://idn.ceos.org/idn-resources/stats_ceos_dif_count.pdf
38
IDN Statistics Page
39
Stay Connected
• Email notifications (Send email to [email protected] to sign up)
docBUILDER: News and downtime notifications on metadata authoring tool ([email protected])
Interoperability Forum: Release announcements and proposed changes to DIF and SERF ([email protected])
