From Big Data to Smart Statistics

Mariana Kotzeva

Acting Director General

Eurostat

ESSnet Big Data Dissemination Workshop

Sofia,

23-24 Feb 2017

Eurostat

Eurostat

A simpler definition

Statistics are the mirror through which we view society

David Hand @ Royal Statistical Society 2010

3

Eurostat

Data revolution: challenges for official statistics

Data revolution

New data sources

New statistical and analytical methods and tools

Competition among data providers

New users' needs

Eurostat

Scheveningen Memorandum on Big Data

Sep 2013

Action plan and roadmap for the ESS

Examine potential of Big Data for statistics

Collaboration at European and global level

Explore partnerships

Address privacy and data protection

Need for new skills

Methodology, quality assessment and IT

Eurostat

Key areas

ESS Vision 2020

Eurostat 7

Envisaged Benefits

Faster data production

Higher detail, e.g. geographically, frequency

More data

More flexible response to user needs

Increased efficiency

Stay relevant

Eurostat

Policy Quality Skills

Experience sharing

Legislation IT

Infrastructures

Methods Ethics /

Communication

Partnerships

Pilots

Action Plan Themes

ESSnet Activities

Eurostat 9

Levels of activity

Big Data ESSnet

Eurostat Pilots

Bilateral collaboration with

NSIs

Data4Policy UNECE HLG

GWG Big Data

ESS TF Big Data

Eurostat

Policy for data

Active public policies to support digital transformation

Building a data friendly regulatory framework

Understanding the data value chain

Data will be the backbone for prosperous economies

Eurostat

Data for policy

Data as strategic asset for public sector organisation

• Legal considerations

• Early identification and governance of data sources, data analytics, quality and metadata management

• Proper insertion of data driven insights into policy-cycle

Challenges

• Early detection of trends

• Faster feedback in support of better regulations and evidence based policy-making

• Better information on impact and results of policy measures

Big data

Eurostat

European Commission

Data, information and knowledge management at the European Commission

Data4Policy inter-departmental group

Building a European data economy

Eurostat 13

Back to back with NTTS 2017

• Employment and skills

National teams competing on a policy question

Applications to use a big data source and ideally official statistics

• Prototype can be the subject of a scientific paper

Creation of data product

European Big Data Hackathon

Eurostat

What comes after Big Data?

https://opentechdiary.wordpress.com/tag/internet-of-things/

Eurostat

Internet of Things and smart systems

Machines communicate with machines and humans

Massive exchange of data & information

Intelligent systems extract and aggregate data and transform it to information

Cognitive systems will take(semi)autonomous decisions

IoT will affect private life and economy

Eurostat

Smart Statistics

• Embedded data capturing, processing and analysis

Future system of official statistics

• Enhance the efficiency of the entire statistical system

• ESS as a key provider of data4policy in a digital world

Expected benefits

Eurostat

Official statistics in the future

Product design instead of data collection design

•Access and analyse data flows

Accreditation and certification as core tasks of NSIs

New ways of interaction with users

• Exchange services for data

Trusted third party

•Data integrator

Embedded in data flow – statistics 'everywhere' 17