Quantitative data Quantitative data collection on the status collection on the status of Roma in SEE and CEE:of Roma in SEE and CEE:Methodology, Purpose, and Policy Methodology, Purpose, and Policy

ApplicationApplication

Susanne MilcherSusanne Milcher

Specialist, Poverty and Economic Specialist, Poverty and Economic Development Development

UNDP Regional CentreUNDP Regional Centre

BratislavaBratislava

(17 September 2004)(17 September 2004)

Europe and CIS

OutlineOutline

General problems with ethnic General problems with ethnic datadata

The baseline survey The baseline survey methodologymethodology

Policy applicationPolicy application Future stepsFuture steps

Europe and CIS

Problems with relevant Problems with relevant datadata

Governments reluctant to collectGovernments reluctant to collect– Political considerationsPolitical considerations– Constitutional constraintsConstitutional constraints

Constituencies reluctant to shareConstituencies reluctant to share– Desire to avoid discrimination and Desire to avoid discrimination and

stigmatizationstigmatization– Desire to keep distance from the stateDesire to keep distance from the state

As a result:As a result: Opportunities to misuse and misinterpret Opportunities to misuse and misinterpret

data deficitsdata deficits But all aware that data is necessaryBut all aware that data is necessary

Europe and CIS

UNDP approach to the UNDP approach to the issueissue

Reliable quality quantitative data is a Reliable quality quantitative data is a necessarynecessary

precondition for relevant policies. It means precondition for relevant policies. It means data,data,

which is:which is: RelevantRelevant, adequately reflecting reality, adequately reflecting reality ComparableComparable – both between countries and – both between countries and

with majority populations (control group) in with majority populations (control group) in individual countries – over timeindividual countries – over time

Respecting privacy Respecting privacy – making sure will not – making sure will not be misused, individual is protected against be misused, individual is protected against discrimination discrimination

Europe and CIS

How to get there? The How to get there? The surveysurvey

Problems are of technical, Problems are of technical, methodological and legal nature methodological and legal nature and specific problems require and specific problems require specific approachesspecific approaches

Clear division of roles between Clear division of roles between international and national actors international and national actors necessary in the short, mid and long necessary in the short, mid and long run (phase-out strategy)run (phase-out strategy)

Link to MDGs monitoring (baseline)Link to MDGs monitoring (baseline)

Europe and CIS

How to get there?How to get there?

RelevancyRelevancy – related primarily to – related primarily to communities involvement in data collection communities involvement in data collection (Roma interviewers where possible, (Roma interviewers where possible, assistant interviewers in other cases)assistant interviewers in other cases)

ComparabilityComparability – applying consistent – applying consistent methodologies in different countries methodologies in different countries following the format HBS and LFSfollowing the format HBS and LFS

Include Include majority boostersmajority boosters Respecting Respecting privacyprivacy – not using registry – not using registry

datadata

Europe and CIS

Previous experiencePrevious experience

Regional UNDP/ILO large scale survey on Roma Regional UNDP/ILO large scale survey on Roma in five Central and Eastern European (CEE) in five Central and Eastern European (CEE) countries conducted in 2001countries conducted in 2001

Situation of Roma from a ‘human development’ Situation of Roma from a ‘human development’ perspectiveperspective

““How much” worse and specific characteristics of How much” worse and specific characteristics of their statustheir status

Answering these specific and concrete questions Answering these specific and concrete questions in quantitative figures is a necessary in quantitative figures is a necessary precondition both for understanding the precondition both for understanding the underlying causes and addressing them underlying causes and addressing them adequatelyadequately

Europe and CIS

Roma: poverty profilesRoma: poverty profiles

Average monthly per capita expenditures in Roma householdsBG CZ HU RO SK

As % of country average wage

15 31 17 13 18

As % of country average monthly household expenditures

34 46 26 30 30

Europe and CIS

Roma: Deprivation Roma: Deprivation indicators indicators

(% of people lacking access to)(% of people lacking access to)

Czech Republic

0 20 40 60 80

Car

TV set

Washing machine

Telephone

Running water

Toilet in the house

Roma

Countryaverage

Europe and CIS

Roma: Deprivation Roma: Deprivation indicators indicators

(% of people lacking access to)(% of people lacking access to)

Romania

0 20 40 60 80 100

Car

TV set

Washing machine

Telephone

Running water

Toilet in the house

Roma

Countryaverage

Europe and CIS

Roma: Unemployment (ILO Roma: Unemployment (ILO definition)definition)

0

10

20

30

40

50

60

70

BG CZ HU RO SK

Roma, broad unemployment rate 2001, country average

Europe and CIS

The survey IThe survey I

Supposed to provide base-line data for the Supposed to provide base-line data for the “Decade” progress monitoring and for NTL “Decade” progress monitoring and for NTL policy purposespolicy purposes

Covers all countries in SEE and CEE with Covers all countries in SEE and CEE with sizeable Roma minorities (“Decade +”)sizeable Roma minorities (“Decade +”)

Where relevant, has IDPs and refugees Where relevant, has IDPs and refugees boostersboosters

Will be the basis of a “regional Will be the basis of a “regional vulnerability report”vulnerability report”

Could be used as a pilot for similar data Could be used as a pilot for similar data collection exercises in the regioncollection exercises in the region

Europe and CIS

The survey IIThe survey II

The unit of analysis – householdThe unit of analysis – household Main interviewee – head of the Main interviewee – head of the

householdhousehold Universe studied – households in Roma Universe studied – households in Roma

settlementssettlements Roma settlements – municipalities or Roma settlements – municipalities or

neighborhoods with high concentration neighborhoods with high concentration of Romaof Roma

Territorial unit – municipalities with share Territorial unit – municipalities with share of Roma population equal or above the of Roma population equal or above the NTL average as registered by the censusNTL average as registered by the census

Europe and CIS

The sampling model The sampling model assumptionsassumptions

Census understate absolute numbers but Census understate absolute numbers but reflect the structure and distribution reflect the structure and distribution (“where those people are?”)(“where those people are?”)

The major disparities visible at the level The major disparities visible at the level of municipalitiesof municipalities

Comparability with the “majority in Comparability with the “majority in proximity” more important than with proximity” more important than with national averagenational average

Majority boosters – a “benchmark” Majority boosters – a “benchmark” sample for comparisons with non-Roma sample for comparisons with non-Roma in similar socioeconomic environment in similar socioeconomic environment

Europe and CIS

Inevitable impedimentsInevitable impediments

Sample may be under-representing Sample may be under-representing integrated Romaintegrated Roma

Majority population in proximity may not Majority population in proximity may not be sufficient for constructing a boosterbe sufficient for constructing a booster

Concentrated Roma neighborhood may Concentrated Roma neighborhood may still constitute a share lower than the still constitute a share lower than the NTL averageNTL average

Data not representative for sub-Data not representative for sub-grouping grouping

Europe and CIS

What shall the survey What shall the survey provide?provide?

Household representative information, Household representative information, “census-type” allowing approximations for“census-type” allowing approximations for– Poverty rates and depthPoverty rates and depth– Levels and sources of incomeLevels and sources of income– Educational attainment, completion rates, Educational attainment, completion rates,

enrollment rate and functional literacyenrollment rate and functional literacy– General picture of health status and access to General picture of health status and access to

health services health services – Dwellings characteristics (water, sanitation) for Dwellings characteristics (water, sanitation) for

deprivation indicatorsdeprivation indicators All this - disaggregated by age, sex, income All this - disaggregated by age, sex, income

status of the household and sub-national status of the household and sub-national levellevel

Europe and CIS

Dose of realism Dose of realism (the inevitable (the inevitable

constraints)constraints)

Not all indicators are possible to be Not all indicators are possible to be monitored or disaggregatedmonitored or disaggregated

Data (as any data perhaps) – still Data (as any data perhaps) – still approximation and should be used approximation and should be used as complementary to other as complementary to other statisticsstatistics

Cross-country comparability will be Cross-country comparability will be limited (if necessary at all)limited (if necessary at all)

Europe and CIS

Time-frameTime-frame

Completed sampling methodology and Completed sampling methodology and questionnairequestionnaire

August/September – translating, back August/September – translating, back translation and testing of the translation and testing of the questionnaire; samplingquestionnaire; sampling

End of August: identification of assistant-End of August: identification of assistant-interviewers and first training (Sofia)interviewers and first training (Sofia)

October: field-workOctober: field-work November: data availableNovember: data available First quarter 2005 “Vulnerability First quarter 2005 “Vulnerability

Assessment”Assessment”

Europe and CIS

Policy applicationPolicy application

Only based on quantitative data can the Only based on quantitative data can the actors involved (governments, donors, actors involved (governments, donors, implementing partners) outline priorities implementing partners) outline priorities and measure progressand measure progress

Disaggregated quantitative data is a Disaggregated quantitative data is a precondition for relevant national-level precondition for relevant national-level policies for sustainable inclusion of policies for sustainable inclusion of vulnerable groups and Roma in particularvulnerable groups and Roma in particular

Monitoring and evaluation of national-level Monitoring and evaluation of national-level policies, what impact has been achieved?policies, what impact has been achieved?

Europe and CIS

Future steps and possible Future steps and possible cooperationcooperation

Improve methodologies for vulnerability Improve methodologies for vulnerability analysis to establish disaggregated data analysis to establish disaggregated data collection capacities at the country level collection capacities at the country level in 2-3 yearsin 2-3 years

Work with National Statistical Offices on Work with National Statistical Offices on practical projects on data disaggregationpractical projects on data disaggregation

Elaborate possible approaches to Elaborate possible approaches to overcome legal barriers overcome legal barriers

Encourage and coordinate advocacy Encourage and coordinate advocacy campaign for new approach to “group-campaign for new approach to “group-related” data, incl. ethnic groupsrelated” data, incl. ethnic groups

Europe and CIS

Links to other Roma-Links to other Roma-related initiativesrelated initiatives

Follow up to first regional reportFollow up to first regional report ““Avoiding the Dependency Trap”Avoiding the Dependency Trap”

Decade of Roma InclusionDecade of Roma Inclusion baseline and baseline and monitoringmonitoring

Measuring the progress at national level Measuring the progress at national level (Czech Republic and Hungary)(Czech Republic and Hungary)

WB “Living Standards” assessmentWB “Living Standards” assessment Roma Development Opportunities Web-Roma Development Opportunities Web-

site, site, http://roma.undp.skhttp://roma.undp.sk

Europe and CIS

Thank you!Thank you!

Bratislava Regional CenterBratislava Regional Center

35 Grosslingova 35 Grosslingova

81109 Bratislava, Slovak Republic81109 Bratislava, Slovak Republic

+421 2 59337 111+421 2 59337 111

www.undp.skwww.undp.sk

http://roma.undp.skhttp://roma.undp.sk

http://mdgr.undp.skhttp://mdgr.undp.sk