Implementation ofthe European Statistics Code of Practice

YaltaSeptember 2009Pieter Everaers, Eurostat

204/20/23

Implementation of the Code of Practice

1. The European Statistics Code of Practice

2. Eurostat implementation strategy

3. Monitoring and Reporting

4. Quality label for European official statistics

3

3 headings – 15 principles – 77 indicators

• Institutional environmentProfessional independence, Mandate for data collection, Adequacy of Resources, Quality commitment, Statistical confidentiality, Impartiality and objectivity

• Statistical processesSound methodology, Appropriate statistical procedures, Non-excessive burden on respondents, Cost effectiveness

• Statistical outputRelevance, Accuracy and reliability, Timeliness and punctuality, Coherence and comparability, Accessibility and clarity

Example of indicators:

(…)V. Statistical release dates and times are pre-announced.

VI. All users have equal access to statistical releases at the same time and any privileged pre-release access to any outside user is limited, controlled and publicised. In the event that leaks occur, pre-release arrangements should be revised so as to ensure impartiality.(…)

Example of indicators:

I. Where European Statistics are based on administrative data, the definitions and concepts used for the administrative purpose must be a good approximation to those required for statistical purposes.

II. In case of statistical surveys, questionnaires are systematically tested prior to the data collection.

III. Survey designs, sample selections, and sample weights are well based and regularly reviewed, revised or updated as required.

IV. Field operations, data entry, and coding are routinely monitored and revised as required.(…)VI. Revisions follow standard, well-established and transparent procedures.

Example of indicators:

I. Timeliness meets the highest European and international dissemination standards.

II. A standard daily time is set for the release of European Statistics.

III. Periodicity of European Statistics takes into account user requirements as much as possible.

IV. Any divergence from the dissemination time schedule is publicised in advance, explained and a new release date set.

V. Preliminary results of acceptable aggregate quality can be disseminated when considered useful.

The European Statistics Code of Practice (1)

404/20/23

addresses

•Users:•to show that statistics are trustworthy, objective and reliable.

•Governance authorities (Government, Ministries): •to ensure that statistical services are professionally organised and resourced, promote independence.

•Respondents:•to show that confidentiality is protected and response load controlled.

•Statistical authorities:•to provide benchmarks and values that should be adopted to produce and disseminate high quality statistics; to serve the organisation’s public image.

•Staff: •to provide guidelines for managers and staff that promote sharing of values and contributes to the integration of new colleagues, help to create a high quality workplace and a climate of integrity and excellence.

The European Statistics Code of Practice (2)

5

The Code of Practice and the UN Fundamental Principles

Institutional environment

Statistical processes Statistical output

Codeof

Practice

UNFundamental Principles

3

The European Statistics Code of Practice (3)

UNFundamental Principles

5, 9, 10

UNFundamental Principles

1, 2, 4, 6, 7

8

604/20/23

Implementation of the Code of Practice in the ESS

1. The European Statistics Code of Practice

2. Eurostat Implementation strategy

3. Monitoring and Reporting

4. Quality label for European official statistics

7

• 2005 Self-assessments by all NSIs based on a common questionnaire

7. For how many surveys do you assess the response burden?

> 75% 25-75% < 25% none

Share of surveys ....................................................................................................

8. Does your organisation have a definition of response burden …

Yes No

…. for individual respondents?

… for institutional respondents (e.g. enterprises)?

Detailed questions for each indicator, strength/weaknesses, improvement actions

• Protocols on selected issues

• Extension to other data providers at national level

ESS Implementation strategies (1)

• ESS good practices

8

904/20/23

Implementation of the Code of Practice in the ESS

1. The European Statistics Code of Practice

2. Eurostat Implementation strategy

3. Monitoring and Reporting

4. Quality label for European official statistics

10

• Surveillance

ESS-wide peer reviews during 2006-07 Regular reporting & monitoring of improvement actions European Statistical Governance Advisory Board

• Transparency

2006 Report to the EFC on self-assessments Publication of peer review reports Eurostat quality website 2008 Report to EP and Council

Monitoring and Reporting (1)

1104/20/23

Objectives– monitoring of the implementation of the Code of Practice

– to boost quality, to enhance credibility

– identification of ESS benchmarks and common difficulties

– sharing of ESS best practices and knowledge transfer

Scope– 27 EU MS + 4 EFTA MS + Eurostat

– institutional environment and dissemination practices

– co-ordination role of NSI

Mechanics– common guidelines and assessment basis

fully metfully met / /largely metlargely met/ / partly metpartly met / /not metnot met

– 2 ½ days, 3 peers, information package, various interlocutors

Monitoring and Reporting (5)ESS peer reviews

12

Results of the ESS peer reviewsHigh overall ESS compliance levels

Number of instances (indicator x statistical authority)

62%25%

12% 1%

Fully met

Largely met

Partly met

Not met

13

Results of the ESS peer reviews: Strengths

0

1

2

3

4Professional Independence

Mandate for data collection

Adequacy of resources

Quality commitmentStatistical confidentiality

Impartiality and objectivity

Accessibility and clarity

ESS average

sufficient legal mandate for NSI, practical difficulties to use admin. data

Strong legal basis, impressive safeguards across the ESS; excellent practices in micro-data access

Strong in practice, legislation to be

supplemented in some SAs to reinforce independence

High diversity across ESS;

lack of transparency in

some cases

14

Results of the ESS peer reviews:Areas for improvement

0

1

2

3

4Professional Independence

Mandate for data collection

Adequacy of resources

Quality commitmentStatistical confidentiality

Impartiality and objectivity

Accessibility and clarity

ESS average

High service orientation; modern dissemination channels; some SAs need to improve metadata and accessibility

Broadly satisfactory

resources, some severe

exceptions and risks for

meeting future demands

Lowest compliance levels compared to other principles, improvements needed on the ESS- wide scale

15

16

Statistical law covering all actors at national level

delineation of the statistics function

co-ordinated community (recruitment, training, ethical standards)

common dissemination platform

labelling/certification mechanism

ESS best practices:Compliance with the Code of Practice

by other national producers of European Statistics(not the NSI)

1704/20/23

Implementation of the Code of Practice in the ESS

1. The European Statistics Code of Practice

2. Eurostat Implementation strategy

3. Monitoring and Reporting

4. Quality label for European official statistics

1804/20/23

Guidance for users

Campaign for the Code

Positioning of official statistics in the information market

Improving quality

Improving quality reporting

Strengthening the co-ordination of production of statistics at European level

Objectives

Quality label for European official statistics (1)

19

ESS

impr

ovem

ent

actio

ns

time

Compliance with Code

Labelling of European official statistics signalling

compliance with the Code to users

Quality label for European official statistics (2)

20

Thank you for your attention!

http://ec.europa.eu/eurostat/quality