EU-MIDIS II

The Second European Union

Minorities and Discrimination

Survey

Surveying migrants

Jaroslav Kling

Research Officer

April, 2018

2

Council Regulation (EC) 168/2007

▪ to provide assistance and expertise on fundamental rights issues to the European Union institutions and the Member States, when they implement European Union law

▪ to collect, record, analyse and disseminate relevant, objective, reliable and comparable information and data on fundamental rights issues in the EU

▪ to promote dialogue with civil society, in order to raise public awareness of fundamental rights and actively disseminate information about its work

FRA’s mandate

3

FRA’s surveys

▪ EU-MIDIS: European Minorities and Discrimination survey (2008) – EU-27 ➢ 23,500 ethnic minorities & immigrants

➢ 5,000 majority population in 10 EU MS – random sample

▪ Roma pilot survey (2011) – 11 EU MS➢ 22,000 respondents – random sample

▪ Survey on Discrimination and Hate Crime against Jewish people (2012) – 8 EU MS➢ 6,000 respondents – online (opt-in)

▪ LGBT survey (2012) – EU-28➢ 93,500 respondents – online (opt-in)

▪ Violence against Women survey (2012) – EU-28➢ 42,000 women – random sample (general population)

▪ EU-MIDIS II (2015-2016) – EU-28➢ 25,500 ethnic minorities & immigrants (including Roma) – random sample

➢ Cognitive pre-test (2014) – 8 EU Member States, 280 interviews

▪ Fundamental Rights survey (2017-2019) – EU-28 ➢ general population

➢ Pre-test and feasibility study (2016); Pilot (2017-2018)

▪ Second Survey on Discrimination and Hate Crime against Jewish people (2018) online (opt-in) – 13 EU MS

▪ Roma and Travellers survey 2018 – 6 EU MS

4

EU-MIDIS II survey:

Why is it needed?

A. Collect EU-wide comparable data on immigrants and ethnicminorities for effectively assessing the impact of policymeasures:

– Non-discrimination and equality

– Roma inclusion

– Immigrant integration

– Europe 2020

– UN Sustainable Development Goals (SDGs)

B. Assess developments and progress made over time

C. Refine survey methodologies for hard-to-reach populations

D. Compare with the general population in EU-28 4

5

EU MIDIS II survey:

Objectives

Methodological:

• Allow for analysis of trends for selected indicators from EU MIDIS I and the Roma survey

• An EU wide comparative survey

• Refine survey methodologies for hard-to-reach populations

Content:

• Enjoyment and violations of fundamental rights: discrimination, victimisation, rights awareness (Employment; Education; Housing; Health; Goods and services)

• Integration of migrants – process/outcome

o Zaragoza indicators and available data sources (LSF, EU-SILC, PISA etc.)

o The added value of EU MIDIS II - gathering information for areas not covered in existing data sources (e.g. welcoming society) + other fundamental rights indicators to be developed by FRA

• Roma social inclusion

5

6

EU MIDIS II survey:

Concepts

• Discrimination and hate crime➢ Racial Equality Directive

➢ Employment Equality Directive

➢ Proposal for a “Horizontal Directive”

➢ Framework Decision on Racism and Xenophobia

• Integration / social inclusion➢ Transition from studying flows to studying conditions for integration and social inclusion in different

areas – EU Common Agenda for Integration; CBP 2004; Europe 2020

➢ Need for common indicators to monitor integration policies and outcomes (Zaragoza Declaration

2010) and harmonised statistical data

▪ Roma social inclusion➢ Europe 2020

➢ EU Framework for National Roma Integration Strategies

7

EU MIDIS II survey:

Timeline

• Survey preparations: October 2013

• Cognitive pre-test study of selected questions in 8 EU

MS (BE, EL, IT, HU, HR, MT, RO, UK), May 2014: o N=280 interviews (60 with Roma in 4 MS – EL, RO, HU, IT; 220 with

other immigrant/minority groups in 8 EU MS)

• Stakeholder & Survey Expert Meeting: March 2014

• Contract with Ipsos MORI: December 2014

• Fieldwork: September 2015 – January 2016

• Launch of the first findings: December 2016

7

8

EU-MIDIS II survey:

Methodology

➢ Survey conducted in all 28 EU MS

➢ Face to face interviews with 25,515 respondents providing

information on 77,659 individuals in households in 2015–

2016

➢ Translation in all official EU languages + Turkish, Kurdish,

Arabic, Russian, Somali and Tamazight (Morocco)

➢ Combination of sampling & weighting approaches allowed

representative samples of the selected target groups in each

EU MS

❖ See EU-MIDIS II Technical report – available online – detailed

description of the survey design and methodology

9

EU MIDIS II survey:

Questionnaire

10

EU-MIDIS II survey:

Target groups

7 different survey population “target groups”, 1–3 per MS

➢ Immigrants and descendants (1st or 2nd generation: based on country of birth and country of birth of parents)

➢ Turkey (6 EU MS: AT, BE, DE, DK, NL, SE)

➢ North Africa (5 EU MS: BE, ES, FR, IT, NL)

➢ Sub-Sahara (12 EU MS: AT, DE, DK, FI, FR, IE, IT, LU, MT, PT, SE, UK)

➢ Asia / South Asia (4 EU MS: CY, EL, IT, UK)

➢ Recent immigrants: born outside EU-28 & immigrated within the

last 10 years (2 EU MS: PL, SI)

➢ Roma: self-identification (9 EU MS: BG, CZ, EL, ES, HR, HU, PT, RO, SK)

➢ Russian minority: self-identification (3 EU MS: EE, LV, LT)

11

Target group definitions:

migrants

• Immigrants: born in a non-EU country, usual place of residence in the survey

country for the last 12 months, irrespective of their formal residence status and citizenship

• Recent immigrants: immigrated within the last 10 years (since 2004)

• Descendants of immigrants: born in one of the current EU Member

States and who have at least one parent born in a non-EU country

• North Africans and their descendants: Algeria, Egypt, Libya,

Morocco, Sudan, or Tunisia

• Sub-Saharans and persons of African descent: another

African country not listed under ‘North Africans’ or in the Caribbean

• South Asian: India, Bangladesh, Pakistan, Bhutan, Nepal, Sri Lanka and

Maldives

• Asians: another country in Asia

12

Target groups by EU MS

13

MSQuestionnaire CAPI script and

showcardsRespondent-friendly paper version of the

questionnaire

Interviewer training manual

and contact sheetsIntroductory letter Postcard

AT German, Turkish Somali, English, Turkish, French German German, Turkish, Somali German

BE French, Dutch Arabic, Turkish, Kurdish French, Dutch French, Dutch, Arabic, Turkish French, Dutch

CY Greek, English Greek, English Greek Greek, English, Tagalog Greek

DE German French, Turkish, Kurdish, English German German, French, Turkish, Kurdish, English, German

DK Danish, Turkish, Somali Turkish, Somali, Kurdish Danish Danish, Turkish, Kurdish, Somali Danish

EL Greek, English English Greek Greek, English Greek

ES Spanish French Spanish Spanish, Arabic, French Spanish

FI Finnish Somali Finnish Finnish, Somali Finnish

FR French French French, Arabic, Tigrinya French

IE English Somali English English, Somali English

IT Italian English, French, Arabic Italian Italian, English, French, Arabic Italian

LU French, Portuguese, English French, Portuguese, English French French, English, Portuguese French

MT Maltese, English English Maltese, English, Somali, French, Arabic Maltese, English

NL Dutch, Tamazight Arabic, Turkish, Kurdish, Tamazight Dutch Dutch, Arabic, Turkish, Kurdish, Tamazight Dutch

PL Polish Russian, English Polish Polish, Russian, English, Vietnamese Polish

PT Portuguese Portuguese Portuguese Portuguese

SE Swedish English, Kurdish Swedish Swedish, English Swedish

SI Slovenian Slovenian Slovenian Slovenian

UK English Somali English English, Hindi, Somali, Urdu English

Languages used in the

fieldwork materials: migrants

14

Respondent‘s eligibility criteria

• Individuals aged 16 years and older

• usual place of residence is in the EU MS surveyed

• living in private households in the EU MS surveyed for at

least the last 12 months

15

Sampling objectives

• Representativeness through random probability

sampling for all TG in 28 EU MS

• A minimum sample size of 500 interviews per MS

and a minimum of 400 interviews per TG

16

Sampling strategies:

migrants

➢ Direct un-clustered single-stage sampling selecting from individual person-level registers (three countries)

➢ Multi-stage area sampling, with primary sampling units (PSUs) selected at the first stage. For the second stage sampling within sample areas the choice is generally between:

• systematic sampling from address registers (4 EU Member States);

• addresses identified via random route (6 EU Member States)

– plus Focused enumeration to increase the efficiency of the sample;

• in Germany random walk route was assessed as not to be feasible and therefore addresses were identified through an onomastic (name matching)process and via referrals.

➢ Location sampling or centre-based sampling (7 EU Member States)

➢ A non-probability sampling in Luxembourg (quota sampling) after requests for register data were rejected and other forms of sampling were not feasible

Combination of various strategies in one country

17

Coverage and efficiency of design:

migrants

➢ To improve the efficiency of the screening and fieldwork related efforts

and costs, country sampling plans were:

➢ optimised through stratification of the frame according to degree of concentration of

the target population (i.e. percentage of target population in the total population of

the PSU)

• excluding empty or low concentration strata from the sample by setting a minimum level of concentration ‘cut-off’ (2,6% - 16%; coverage 17%-100%*)

• oversampling more concentrated strata; this resulted in lower sample efficiencies

18

Sampling frames:

migrants

• Census 2011 (BE (& address register), CY, EL, ES, FR, IT,

PL, PT; IE, UK (& post system))

• Population register (DK, FI, SE, SI; AT, NL (& post system))

• General Social Security Inspectorate (IGSS) statistics

2015 (LU)

• H&S onomastic (survey) and Microcensus 2013

(population adjustments) (DE)

• No official statistics, desk research estimations (MT)

19

Samples achieved in the EU MS:

migrants

EU MS Number of

interviews

EU MS Number of interviews

AT 1,054 IT 1,722

BE 1,339 LU 402

CY 436 MT 411

DE 1,419 NL 1,270

DK 851 PL 429

FI 502 PT* 1,078

FR 1,640 SE 802

EL* 1,023 SI 404

ES* 1,563 UK 1,216

IE 425

* Includes also Roma sample

20

Weighting

• Design– PSU selection stage (PPS)

– Address selection stage

• Adaptive cluster sampling adjustment

– Respondent selection stage

• Non-response– Neighbourhood characteristics at household level

– Respondent characteristics at individual level

• Post-stratification– Not possible due to unavailability of reliable data for the covered

population (except NL, FI)

– Region, urbanity

– Cross-country weights: estimated size of covered population

21

EU-MIDIS II survey:

Challenges

➢ Limited access to sampling frames and registers

➢ Operation outside the European statistical system

➢ Cooperation with national market research institutes

➢ Limited resources

➢ Diversity of sampling approaches

➢ Small sample sizes & coverage

➢ Random probability sampling in most countries

➢ Multilingual interviewers not available in all countries

➢ Ethical and cultural considerations relevant for training of interviewers

➢ Flexibility of interviewer matching

➢ Interviewers not used to the specificity of such surveys – screening

ineligibles is part of the work

22

➢ Possibility to reach out:

With targeted sampling approaches

Selection of target groups in relevant countries

With trained interviewers

Supporting materials

➢ Providing with EU wide and comparable data

On discrimination, victimisation, police stops

On social inclusion

Meeting policy needs

„Leaving no one behind“: Roma, immigrants and their descendants

Collecting data on hard-to-reach

groups: possible endeavour

23

EU-MIDIS II:

Publications

Publications:

• Roma Selected Findings - December 2016

• Muslims Selected Findings - September 2017

• Main results - December 2017

• Technical Report – December 2017

• Online visualisation – December 2017

FRA data explorer

Upcoming

• Thematic reports

• Microdata available

fra.europa.eu

Thank you!

EUMIDIS2@fra.europa.eu

jaroslav.kling@fra.europa.eu