data management and qa/qc with priority data flows in eea
DESCRIPTION
Data management and QA/QC with priority data flows in EEA. 8 th Joint TFEIP/EIONET meeting Dublin, 23-24 October 2007 Sheila Cryan, EEA. Priority data flows. EEA and EIONET set of agreed, stable, well-defined objectives - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/1.jpg)
1
Data management and QA/QC with Data management and QA/QC with priority data flows in EEApriority data flows in EEA
88thth Joint TFEIP/EIONET meeting Joint TFEIP/EIONET meeting
Dublin, 23-24 October 2007Dublin, 23-24 October 2007Sheila Cryan, EEASheila Cryan, EEA
![Page 2: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/2.jpg)
2
Priority data flowsPriority data flows
• EEA and EIONET set of agreed, stable, well-defined objectives
• provide a focus for countries when they are putting procedures in place for regular reporting.
• better performance through “compétition amicale”
• praise for achievements rather than blame for failures.
![Page 3: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/3.jpg)
3
Who and what?Who and what?
http://www.eionet.europa.eu/dataflows
![Page 4: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/4.jpg)
4
Regular annual cycleRegular annual cycle
![Page 5: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/5.jpg)
5
Data reporting in 1990’s… Data reporting in 1990’s…
The Public and Decision-Makers
NFP, other National AuthoritiesPCP, NRC
EEA
Bigreport
consultants
ETCACC
ETCBD
ETCWater
CEC Others
![Page 6: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/6.jpg)
6
What is Reportnet? What is Reportnet?
Reportnet is a system of integrated IT tools and processes creating a shared information infrastructure to support the reporting of environmental dataand information in Europe
![Page 7: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/7.jpg)
7
EEA
The Public and Decision-Makers
ETCACC
ETCBD
ETCWater
NFP and other National AuthoritiesPCP, NRC
ESTAT DG ENV
Others
Reportnet……and after :-)and after :-)
![Page 8: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/8.jpg)
8
EE
A
NR
C N
RC
NR
C N
RC
NF
P
ET
C E
TC
DataCollection
DataHandling
Disseminationof information
![Page 9: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/9.jpg)
9
Rotating ReportnetRotating Reportnet
![Page 10: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/10.jpg)
10
Reportnet Reporting Obligations Database
Reporting obligations [Acidification]
![Page 11: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/11.jpg)
11
Definitions in Reportnet Data Dictionary
![Page 12: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/12.jpg)
12
... > Tables > Elements > Code lists
![Page 13: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/13.jpg)
13
Reportnet Central Data Repository
![Page 14: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/14.jpg)
14
Immediate feedback to the data reporter
![Page 15: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/15.jpg)
15
2nd level data quality checks
outlier
median
max. tolerated value = median * 1.5
min. tolerated value = median / 2
no outlier
outlier?
example chart
outlier
outlier
outlier
outlier
![Page 16: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/16.jpg)
16
Reportnet, version 1bReportnet, version 1b
Contentmonitoring
Informationproducts
EEAdata
services
Reportingobligations
Networkdirectory
Datadictionary
Dataexchangemodules
Datarepository
![Page 17: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/17.jpg)
17
QA/QC – Summary
1. National level: MS responsibility
2. EU level: Data quality index
3. EU level: Validation of reported data The Reportnet system is designed to support
quality control of reported data. A clear specification of data elements, data
types and code lists is needed. Data element specification in most reporting
sheets need further elaboration so that meaningful quality checks can be carried out.
![Page 18: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/18.jpg)
18
We do not have a magicdata washing machine!
The good thing about data quality is that literally anyone who wants
can contribute to its improvement.
![Page 19: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/19.jpg)
19
![Page 20: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/20.jpg)
20
Content in ReportnetContent in Reportnet
3716 envelopes 3716 envelopes
(8 October 2007)(8 October 2007)
![Page 21: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/21.jpg)
21
Informationproducts
Contentmonitoring
Datadictionary
Reportingobligations
EEAdata
services
Dataexchangemodules
Networkdirectory
Datarepository
Data handling
Data reporting Data dissemination
Reportnet under the magnifying glassReportnet under the magnifying glass
![Page 22: Data management and QA/QC with priority data flows in EEA](https://reader036.vdocuments.site/reader036/viewer/2022062422/56813f55550346895daa1ab8/html5/thumbnails/22.jpg)
22
Datarepository
New features 2004-2007New features 2004-2007
Contentmonitoring
2004GDEM = Converters + Webforms + QA2005More (automatic) convertersData Merging Module (DMM) = AggregatorUNS = Content monitoring, CAS2006Improved handling of GIS data:i.e. conversion, editing, display and QA2007 (?)
Default workflow >> Customised workflow