ECHO Overview and State of the System

ESIP Winter Meeting 2014

Katie BaynesNASA ECHO Teamkathleen.baynes@nasa.gov

ECHO SYSTEM OVERVIEWESIP Winter 2014

What Metadata?• NASA’s Earth Observing Satellites (EOS) monitor

daily events and long term environmental changes

• EOSDIS data collection includes over 3,500 data types• Land

» Cover & Usage» Surface temperature» Soil moisture» Surface topography

• Atmosphere» Winds & Precipitation» Aerosols & Clouds» Temperature & Humidity» Solar radiation

• Ocean Dynamics » Surface temperature» Surface wind fields & Heat flux» Surface topography» Ocean color

• Cryosphere» Sea/Land Ice & Snow Cover

• Human Dimensions» Population & Land Use» Human & Environmental Health» Ecosystems

Reverb• ECHO’s web front end• Novices and Experts• Searching

– Temporal– Spatial– Keywords– Platforms/Instruments/Sensors– Processing Level

• Ordering• Downloads• Services

– Sub-setting– Re-projection

http://reverb.echo.nasa.gov/reverb

Metadata IngestD

at

a P

ro

vid

er

In

ge

st

ECHO Catalog

REST API

FTP Ingest

ISO 19115 Data

Provider

ECHO 10 Data

Provider

ISO 19115 Data

Provider

ECHO 10 Data

ProviderFormat X

Both Collection and Granule Level

Search and Metadata Retrieval

ECHO Catalog

REST API

ReverbESIP

OpenSearch

CWICGiovanni

…

DirectClients

Cli

en

t D

at

a

Re

tr

iev

al • Multi-format Retrieval

• ECHO10• JSON• ISO 19115

• Searching• Ordering

OPERATIONAL STATISTICS AND INTERESTING METRICS

ESIP Winter 2014

Some ECHO Stats

• Central EOSDIS Metadata Repository– Holdings

• 3830 Collections• 142 Million Granules

– Client Applications• Reverb• ASTER Volcano Group• GHRC Data Albums Access• OpenSearch Clients (CWIC, et al)• GIBS• Non-self-identifying clients (aka ‘Other’)

How Much Traffic Does ECHO See?

10/13 - 10/19

10/20 - 10/27

10/27 - 11/02

11/03 - 11/09

11/10 - 11/16

11/17 - 11/23

11/24 - 11/30

12/01 - 12/07

12/08 - 12/14

12/15 - 12/21

12/22 - 12/29

12/29 - 01/05

0

100000

200000

300000

400000

500000

600000

700000

800000

131738

187327167963

148929111246 116986

Total ECHO Queries

ECHO Current

GHRC/UAH Data Albums work in full swing ~650k queries

Who’s Using ECHO?

Reverb Ops18% GMU

0%

GMUCWICWrapper39%

SSW1%GESDISC

0%

AVAPC7%MODAPS

0%

GHRC/UAH32%

Other2%

Client Breakdown for a Week in October 2013

Reverb Ops37%

GMU0%

GMUCWICWrapper42%

SSW1%

GESDISC0%

GSFCS4PA0%

AVAPC7%

MODAPS0%

GHRC/UAH2%

Other10%

Client Breakdown for a Week in December 2013

How Fast is ECHO?

10/13 - 10/19

10/20 - 10/27

10/27 - 11/02

11/03 - 11/09

11/10 - 11/16

11/17 - 11/23

11/24 - 11/30

12/01 - 12/07

12/08 - 12/14

12/15 - 12/21

12/22 - 12/28

12/29 - 01/05

0.000

0.500

1.000

1.500

2.000

2.500

3.000

3.500

4.000

4.500

3.251

Average Query Time (12 Week Moving Average)

Seco

nds

Adding More Interesting Metrics …

Composite Reverb spatial search heat map for the last year

Looking at How People are Using Reverb …

ECHO Continues to work on Serving the Right People with the Right Tools

WHATS BEEN GOING ON?ESIP Winter 2014

High Level Overview

• ECHO Technical Interchange – Spring 2013• NRT Data• Order Workflow Re-Work• Indexing Landsat 8 Data• Revisiting User Settings• ISO Activities• More!

( R o u g h l y C h r o n o l o g i c a l )

ECHO Technical Interchange

http://fc04.deviantart.net/fs43/f/2009/099/8/5/CAT_PARADE_by_dolle.png

LANCE NEAR REAL TIME INDEXINGESIP Winter 2014

Current NRT Holdings (with GIBS!)Spacecraft/Instrument ECHO* GIBS**

Aqua/AIRS 8 Collections24960 Granules

(2)7 Imagery LayersMay 2012 -> Present

Aura/MLS 7 Collections13152 Granules

14 Imagery LayersMay 2012 -> Present

Aura/OMI Non-Operational2 Collections364 Granules

8 Imagery LayersMay 2012 -> Present

Terra/MODIS 22 Collections48415 Granules

23 Imagery LayersMay 2012 -> Present

Aqua/MODIS 21 Collections48428 Granules

21 Imagery LayersMay 2012 -> Present

* - Granules aged off after 7-10 days** - Daily images not currently aged off

Exposing ECHO’s NRT Holdings

Visual Indicators Quickly Call Out NRT Collections

In Reverb

Discovering NRT in ECHO

• Extending our Data Model and API– Metadata Element

– API Query Parameter

<CollectionDataType>NEAR_REAL_TIME</CollectionDataType>

https://api.echo.nasa.gov:443/catalog-rest/echo_catalog/datasets?collection_data_type=NEAR_REAL_TIME

ONGOING WORKESIP Winter 2014

Revisiting Ordering Workflows

Indexing New Data Collections

More Visualization Options …

Pre-WRS-2

Revisiting User Settings

ISO19115 and ECHO

• Following activities of NASA’s MENDS Study• Incorporating updated data translations• Learning more about

community use and adoption• Working with this guy• Ingest of New Products in

ISO19115/19139

Questions?

http://goo.gl/IRvY7oSample Code:

echo@echo.nasa.gov