data access and data extraction services within the land imagery portal

34
Data access and Data extraction Services within the Land Imagery portal Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data Frascati, Italy - October 12th, 2012

Upload: gasperi-jerome

Post on 21-Dec-2014

212 views

Category:

Technology


3 download

DESCRIPTION

Models for scientific exploitation of EO Data - Frascati - October 12th 2012 Presentation of the architecture of the french Land Imagery portal data access

TRANSCRIPT

Page 1: Data access and data extraction services within the Land Imagery Portal

Data access and Data extractionServices within the Land Imagery portal

Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO DataFrascati, Italy - October 12th, 2012

Page 2: Data access and data extraction services within the Land Imagery Portal

Land Imagery Portal

Overview

Search service

Download service

What's next

Thematic data extraction

Page 3: Data access and data extraction services within the Land Imagery Portal

Land Imagery Portal

Page 4: Data access and data extraction services within the Land Imagery Portal

The PTSC* is the future French "Thematic Center for Land Imagery"

* temporary name, subject to change when operational

Page 5: Data access and data extraction services within the Land Imagery Portal

v0 (end of 2012)Official launch of the portal

v1 (2013)additionnal datasets from CNES and partners, SSO integration, etc.

Page 6: Data access and data extraction services within the Land Imagery Portal

Search service

Page 7: Data access and data extraction services within the Land Imagery Portal

Metacatalogbased on SITOOLS

Indexes each data providersmetadata using dedicatedconnectors (OpenSearch,CSW CIM or CSW ISO)

Metadata are stored within aninternal structure including

necessary properties to be compliantwith INSPIRE and HMAmetadata requirement

Additional information can be storedbeside metadata

(e.g. thematic classification)

Offers multiple search interface(OpenSearch, CSW ISO - INSPIRE,

CSW EO - HMA)

Kalideos

SPIRITOpe

nSea

rch

SPOT Archives

POSTEL

MUSCATE

CNES

CSW

CIM

IGNGeoportal catalog

CSW

ISO

GEOSUDGEOSUD catalog

Data providersRegistry index

Ope

nSea

rch

Users

PTSCv?

v1

v1

Page 8: Data access and data extraction services within the Land Imagery Portal

Metacatalogbased on SITOOLS

Indexes each data providersmetadata using dedicatedconnectors (OpenSearch,CSW CIM or CSW ISO)

Metadata are stored within aninternal structure including

necessary properties to be compliantwith INSPIRE and HMAmetadata requirement

Additional information can be storedbeside metadata

(e.g. thematic classification)

Offers multiple search interface(OpenSearch, CSW ISO - INSPIRE,

CSW EO - HMA)

Kalideos

SPIRITOpe

nSea

rch

SPOT Archives

POSTEL

MUSCATE

CNES

CSW

CIM

IGNGeoportal catalog

CSW

ISO

GEOSUDGEOSUD catalog

Data providersRegistry index

Ope

nSea

rch

Users

PTSC

INSP

IRE

HM

A

v?

v1

v1

Page 9: Data access and data extraction services within the Land Imagery Portal

Metacatalogbased on SITOOLS

Indexes each data providersmetadata using dedicatedconnectors (OpenSearch,CSW CIM or CSW ISO)

Metadata are stored within aninternal structure including

necessary properties to be compliantwith INSPIRE and HMAmetadata requirement

Additional information can be storedbeside metadata

(e.g. thematic classification)

Offers multiple search interface(OpenSearch, CSW ISO - INSPIRE,

CSW EO - HMA)

Kalideos

SPIRITOpe

nSea

rch

SPOT Archives

POSTEL

MUSCATE

CNES

CSW

CIM

IGNGeoportal catalog

CSW

ISO

GEOSUDGEOSUD catalog

Data providersRegistry index

Ope

nSea

rch

Users

PTSC

INSP

IRE

HM

A

V0

v?

v1

v1

Page 10: Data access and data extraction services within the Land Imagery Portal

Metacatalogbased on SITOOLS

Indexes each data providersmetadata using dedicatedconnectors (OpenSearch,CSW CIM or CSW ISO)

Metadata are stored within aninternal structure including

necessary properties to be compliantwith INSPIRE and HMAmetadata requirement

Additional information can be storedbeside metadata

(e.g. thematic classification)

Offers multiple search interface(OpenSearch, CSW ISO - INSPIRE,

CSW EO - HMA)

Kalideos

SPIRITOpe

nSea

rch

SPOT Archives

POSTEL

MUSCATE

CNES

CSW

CIM

IGNGeoportal catalog

CSW

ISO

GEOSUDGEOSUD catalog

Data providersRegistry index

Ope

nSea

rch

Users

PTSC

INSP

IRE

HM

A

V0

V1

v?

v1

v1

Page 11: Data access and data extraction services within the Land Imagery Portal

Download service

Page 12: Data access and data extraction services within the Land Imagery Portal

Product download url is embeded within the product metadata returned by the search service

Page 13: Data access and data extraction services within the Land Imagery Portal

Two cases :url content mimeType is "text/html"

No direct download. The url is opened in another browser tab. User follows the instructions on the corresponding web page to download the product (this is typically the case for a product that required to explicitely sign an NDA before downloading it)

otherwise product can be downloaded directly

No common downloading format has been decided yet. The products are downloaded as is.

Page 14: Data access and data extraction services within the Land Imagery Portal

What's nextThematic data extraction

Page 15: Data access and data extraction services within the Land Imagery Portal

Important note - the following slides present a proposal that will be discussed by the PTSC partners to be integrated (or not) within the Land Imagery portal.

Page 16: Data access and data extraction services within the Land Imagery Portal

Thematic data extraction

Page 17: Data access and data extraction services within the Land Imagery Portal

?How to search within the portal for productsthat contains coastal cultivated areas ?

Page 18: Data access and data extraction services within the Land Imagery Portal

Orthorectified image

Page 19: Data access and data extraction services within the Land Imagery Portal

Orthorectified image

What we got

Page 20: Data access and data extraction services within the Land Imagery Portal

Orthorectified image Characterized image

What we got

Page 21: Data access and data extraction services within the Land Imagery Portal

Orthorectified image Characterized image

This is urban

This is water

This is forest

What we got

Page 22: Data access and data extraction services within the Land Imagery Portal

Orthorectified image Characterized image

This is urban

This is water

This is forest

What we got What we need

Page 23: Data access and data extraction services within the Land Imagery Portal

How to do this ?

Page 24: Data access and data extraction services within the Land Imagery Portal

SLACkERSimpLe Automated Characterization of EaRth observation products

Page 25: Data access and data extraction services within the Land Imagery Portal

SLACkER uses GLC 2000 classification to perform an automatic and location based

characterization of products

Page 26: Data access and data extraction services within the Land Imagery Portal

World land coverTIFF file ~ 650 Mo1 km resolution1 color = 1 thematic class22 classes

Global Land Cover 2000

Page 27: Data access and data extraction services within the Land Imagery Portal

Metacatalog

Ope

nSea

rch

PTSC 1. Get footprint bounding box 2. Get GLC2000 area

3. Process characterization

4. Store results SLACkER

0. Get metadata

IdentifierDescriptionCopyrightAcquisition dateAcquisition anglesThumbnail...+ Footprint

Page 28: Data access and data extraction services within the Land Imagery Portal

Tag table images within database glc2000 >> Add classification columns >> Processing 10 Crop GLC2000 raster : 24137 6169 156 119 Polygonize extracted raster Process footprint against Global Land Cover Store classification => 40.89% of Deserts (10 + 14 + 19) => 31.89% of Herbaceous (9 + 11 + 12 + 13) => 14.71% of Water (20) => 9.27% of Cultivated (15 + 16 + 17 + 18) => 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6)

( 28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover ) ( 6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover ) ( 12.24 % of 19 : Bare Areas ) ( 31.88 % of 12 : Shrub Cover, closed-open, deciduous ) ( 2.5 % of 3 : Tree Cover, broadleaved, deciduous, open ) ( 14.71 % of 20 : Water Bodies (natural & artificial) ) ( 0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover ) ( 2.81 % of 16 : Cultivated and managed areas ) ( 0.69 % of 4 : Tree Cover, needle-leaved, evergreen ) ( 0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )

Processing result example

INPUT : metadata

OUTPUT : additional thematics info storedbeside the metadata within the Metacatalog

Page 29: Data access and data extraction services within the Land Imagery Portal

Thematic sliders

SPOT cover - 1,300,000 scenes

Page 30: Data access and data extraction services within the Land Imagery Portal

Search for coastal cultivated area ?

Page 31: Data access and data extraction services within the Land Imagery Portal

Search results(footprints displayed in black over the map)

Coastal cultivated area

Page 32: Data access and data extraction services within the Land Imagery Portal

Thematic classificationis displayed within

the result metadata

costal...

...cultivated area

Page 33: Data access and data extraction services within the Land Imagery Portal

https://vimeo.com/51045597

Page 34: Data access and data extraction services within the Land Imagery Portal