center for environmental studies arizona state university digital research records at center for...

Center for Environmental Studies

Arizona State University

Digital Research Records at Center for Environmental

Studies

Peter McCartney



• Distributed Resources– 5 institutions, 8 departments

• BiodiversityTaxonomic information BrowsingCollections querySpecies checklistsIdentification Keys

• Research metadata– Datasets, Literature,Images, Protocols, Models

• Data access– Download, Visualization, EDA



History

• LTER Mandate to provide long-term management of Ecological Data

• Expand ASU Capacity for large environmental initiatives through integration

• Develop more effective data sharing with central Arizona partner (Federal, State, Municipal, NGO)



Model for EcoInformatics

Primary Data Storage

Syntactic Metadata

Access Technology

Semantic Metadata

Framework Data

Indexing Catalogs

Knowledge-based Query Systems

Broad Spatial and Temporal Research

Outreach

Knowledge

Information

Data



Distributed computing

ADWR

MAG

Message Pathway

Metadata Service

ASU GIS Lab

CES Informatics

Lab

ADEQ

Geo Sciences Remote

Sensing Lab

ASUMesoNet

Lab

Office of Climatology

Data Service

Model Service

LandscapeEcology

Modeling Lab



Ecological Data Archives

• Diversity in formats, schema, size, organization.– Tabular – SQL, ASCII, App formats– GIS – shapefiles, SDE, coverages– Raster – raw, SDE, Remote sensing,

Erdas, ESRI Grid

• Standards and procedures may exist within individual archives– Few standards at network level



Ecological Metadata Language

• Serve to integrate, rather than dictate, site solutions for data management– ASU, Central Arizona, Naitonal

LTER network, OBFS• Machine parsable

– Based on XML• Build on existing standards

– FLED, Dublin core, ISO 19115, FGDC



EML 2.0 Design

• Modular, with classes relating to specific functional roles

• Uses XML Schema complex types to define extensible base classes of information resources

• Extensible via the linking of new modules within the schema

• Organized to abstract the logical description of data from the physical



EML Related Projects at CES

• Xylographa – Metadata Creation• Xanthoria – Metadata Query• Xylopia- Metadata mediated Access



Xylographa: Metadata Cretation



WebApplication

Query ManagerXanthoria SOAP

Client

Database TargetXanthoria SOAP Server

XML File TargetXanthoria SOAP Server

Xindice TargetXanthoria SOAP Server

Metacat TargetXanthoria SOAP Server

HTTPBrowser

SOAP Messages

SOAP Messages

SOAP Messages

SOAP Messages

Relational Database

Metacat

XML Files

XML Database

Xanthoria Client

ApplicationXML

Schema

Metadata archivesUser

HTTPRequest/Response

Xanthoria: Metadata Query



RDBMS Connector

RDBMSCatalog

EML ConfigurationWizard

Config.XML

Xylographa

XanthoriaConnector

NativeXML

XSL

StandardXML



Xanthoria Methods

ping(src): boolean query(returnfields, querygroup, query

statement, src): ElementgetFullRecordElement(id, src): ElementgetFullRecordPath(id, src): Stringload(file, src): String src = target name

CES Center for Environmental Studies



Xanthoria Query Reply




Xanthoria Request




Xylopia: Metadata Mediate Access

A web-service (Apache SOAP) based data analysis application for EML

Uses EML Metadata to resolve message content

Modules for:Data QueryProcessingVisualizationAnalysis




Xylopia Components

Data CollectorInput: EML Query

Output: Clipped EML & Raw Data or Processed Data (ASCII)

Graph GeneratorInput: Clipped EML & GG Message

Output: PNG graph

Statistics CalculatorInput: Clipped EML & SC Message

Output: Clipped EML & Stats (ASCII)

Map Generator*Input: EML Query & MG Message

Output: JPG, zip, map service configuration

*This module is not a web-service

Xylopia Server-side

Xylopia Client-side

Web-based Application (SEINet, Ecology Explorers, ClimDB, etc.)

SOAP




Typical Xylopia Workflow

EML Query message built by the app/user App sends the message to the Data Collector Data Collector finds the data, puts it into an

ascii file and places the data and a new ‘clipped eml’ into a designated drop box

App gets these data and displays it to the user If the user requests a graph or statistics on

these data, the ‘clipped eml’ and ascii file is usually used by these web services

If the user requests mapping data, the Data Collector’s output varies depending on the requested file’s format


center for environmental studies arizona state university digital research records at center for...

Documents

metadata query slide

metadata cretation slide

eda slide

fgdc slide

physical slide

ngo slide

data management asu

network level slide