the input process of the espon m4d database

The Input Process of

the ESPON M4D Database

ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner - Jérôme Gensel

1

ESPON 2013 Open Seminar

Workshop 11 – ESPON Tools

13-14 June 2012

Aalborg, Danmark

2

Being a TPG Member…

• How to Deliver My Data ?

• A guide can be found on the ESPON Data Portal (.pdf and .html)

3

Being a TPG Member…

4

Being a TPG Member… • How to Deliver My Data ?

• A guide can be found on the ESPON Data Portal (.pdf and .html)

• XLS Templates for Data and INSPIRE compliant Metadata sets

5

Being a TPG Member…

6

Being a TPG Member…

• How to Deliver My Data ?

• A guide can be found on the ESPON Data Portal (.pdf and .html)

• XLS Templates for Data and INSPIRE compliant Metadata sets

• Dictionnary of Spatial Units

7

Being a TPG Member…

8

Data and Metadata Workflow

9

Key Indicators: Strategy • 5 rules

1. Small Number2. Innovative3. High Level of Metadata4. Promote the Core Base Strategy5. Good Completeness

• Data and Metadata in the same XLS Template

10

Key Indicators: Delivery

11

Key Indicators: Delivery

12

Key Indicators: Delivery

13

Key Indicators: Delivery

14

Key Indicators: Delivery

• Data and Metadata in the same XLS Template

• To fill them up, please, follow the online Guide

• ESPON Data and Metadata Specifications

15

Key Indicators: Delivery

16

Key Indicators: Delivery

17

Key Indicators: Delivery• Through the Upload page of the ESPON Database Portal (restricted access)

1. Upload the Data+Metadata XLS Template

2. The first checking phase - Syntactic Check - is automatically launched

3. Consult the result4. While errors then Correct5. Correct warnings or/and Proceed to

the Checking Phase (Semantic Check)

18

Key Indicators: Tracking• A online Tool to see and consult reports about• Data+Metadata sets already entirely

checked• Data+Metadata sets currently checked• Which step(s) they have passed• Which step(s) remain

• A online Tool for• TPG Members and Manager• M4D Contact Teams• ESPON CU

19

Key Indicators: Tracking

20

Key Indicators: Syntactic Check

21

Key Indicators: Semantic Check

22

Key Indicators: First TPG Approbation

23

Key Indicators: Outliers Check

24

Key Indicators: Second TPG Approbation

25

Key Indicators: ESPON CU Approbation

26

Key Indicators: Integration

27

Data and Metadata Workflow

28

Zoom-In Data: Strategy• A Zoom-In Dataset does not cover the entire ESPON Area (EU27+4)

• Local data for a Region or a group of Regions (e.g. Greater Manchester at LAU2, Ile-de-France at employment basin level)

• Non ESPON Area and non ESPON Neighbourhood data (e.g. data on American, Brazilian or Japanese Regions)

29

Zoom-In Data: Delivery• Some Files are expected

• Data File (Template available)

30

Zoom-In Data: Delivery

31

Zoom-In Data: Delivery• Some Files are expected…

• Data File (Template available)• Geometry File (ESRI shapefile)

32

Zoom-In Data: Delivery

33

Zoom-In Data: Delivery

34

Zoom-In Data: Delivery• Some Files are expected…

• Data File (Template available)• Geometry File (ESRI shapefile)• Documentation File (Metadata• Case Study Dataset Sheet

35

Zoom-In Data: Delivery

36

Zoom-In Data: Delivery• Some Files are expected…

• Data File (Template available)• Geometry File (ESRI shapefile)• Documentation File (Metadata• Case Study Dataset Sheet• Case Study Indicator Sheet

37

Zoom-In Data: Delivery• Some Files are Expected• Data File (Template available)• Geometry File (ESRI shapefile)• Documentation File (Metadata• Case Study Dataset Sheet• Case Study Indicator Sheet

38

Zoom-In Data: Checking• Checking of Zoom-In Data

• The codes of the territorial units contained in the geometries and the dataset are the same

• The geometries are georeferenced• All the mandatory fields of the

documentation file are correctly filled

•A notification is sent

• Support and follow-up provided TIGRIS Team (University of Iasi, Romania) – M4D Partner

39

Zoom-In Data: Access• Accessing Case Studies of the ESPON Program

40

Zoom-In Data: Access

41

Zoom-In Data: Access• Accessing Case Studies of the ESPON Program

• Accessing One Case Study

42

Zoom-In Data: Access

43

Data and Metadata Workflow

44

Background Data: Strategy• ESPON TPGs may have produced • a lot of data useful for specialists but not

for other users (policy maker, practitioners…)

• intermediate data used to produce their key indicators

• These data are Background Data

• The database that contain them will be made available as a zip file…

• … With metadata described in an XLS Template

45

Background Data: Delivery• Some Files are expected• Data File (similar to the case-study xls

file)• Metadata File• Indicator + Source Descriptions

46

Project Database: Delivery

47

Background Data: Checking• A compliance check: template is followed and all the mandatory fields are filled• Syntactic Check

• No semantic and no outlier check on this delivery

48

Background Data: Access• Background Data will be made available on the ESPON Web page of each project

49

Project Database: Access

50

Agenda• 30th of June

• Web App v2 (online access to the current version under development)

• Database (today)• 30 datasets• 443 indicators• 1070213 indicator values

51

Agenda• 31th December 2012

• Web App v2 with all functionalities

• P1 Metadata online Editor

• Urban Data + Metadata Sets

• SWOT Analysis about OGC Web Services to access the ESPON Database

52

Agenda•In Between June and December 2012

• Regular updates of the Web App with new implemented features

• Continuous integration of new datasets via the new integration tools

53

Thanks from the M4D Partners