The Core Welfare Indicators Questionnaire:

A CWIQ Option for Monitoring Poverty

Reduction Strategies

The Core Welfare Indicators Questionnaire:

A CWIQ Option for Monitoring Poverty

Reduction Strategies

FUTURE APPLICATIONSFUTURE APPLICATIONS

Monitoring socio-economic programmes overtime

GENERAL HOUSEHOLD SURVEY (GHS)

• CWIQ Technology could be adopted for other surveys/censuses

Measuring impacts of policies & programmes

ECONOMIC SURVEYSPrices (CPI, INFLATION)

Industrial Production

POPULATION CENSUS

Inputs

The Logframe defines M&E The Logframe defines M&E activities at four levelsactivities at four levels

Impact

Outcomes

Outputs

Impact on living standards

Who are the beneficiaries?(access, usage & satisfaction)

Goods & services generatedby the project/Program

Resources provided forProject/Program activities

It is used to monitor outcomes of development actions, (such as PRSPs) ….

It is used to monitor outcomes of development actions, (such as PRSPs) ….

…..through the use of leading indicators, such as access, use and satisfaction

…..through the use of leading indicators, such as access, use and satisfaction

The CWIQ is a household survey

The CWIQ is a household survey

Using CWIQ to monitor primary education in Ghana

Using CWIQ to monitor primary education in Ghana

0

10

20

30

40

50

60

70

80

90100

National Rural Rural poor Urban Urban poor

Access to schools (within 30 minutes)Usage (enrollment rates)Quality of service (% satisfied)

Access to schools (within 30 minutes)Usage (enrollment rates)Quality of service (% satisfied)

WARNING! % satisfied

All households 40%Rural households 30%Poor rural households 18%

Using CWIQ to monitor primary education in Ghana

Using CWIQ to monitor primary education in Ghana

0

5

10

15

20

25

30

35

40

45

50

National Rural Rural poor Urban Urban poor

Poor teaching Overcrowding Poor facilities Lack of books

What are they complaining about?

Lack of booksa problem everywhere

Poor facilities - seriousproblem in poor rural

communities

Benue total

Margin of error

(+/-%)All

RuralRural poor

All Urban

Urban poor

Worse now 27.6 5.5 30.6 23.4 14.6 23.8Better now 49.5 5.4 46.7 59.2 61.5 65.7

Household economic situation compared to one year ago

Sample CWIQ outputs - Nigeria

Sample CWIQ outputs - Nigeria

Overall more household feelthey are better off now,

especially among the poorNote margin of

error at 95% confidencelevel

Core Welfare Indicators by District

0

25

50

75

100Safe water source

Adult literacy

Net Primary Enrollment

Net Secondary Enrollment

Access to Health Services

Not Underweight

Kibaha Mtwara Total sample

Sample CWIQ outputs - Tanzania

Sample CWIQ outputs - Tanzania

Countries in which the CWIQ is planned or has been

implemented

Countries in which the CWIQ is planned or has been

implemented Kenya (pilot) Ghana (1997) Nigeria (1999,2001) Tanzania (2001) Lesotho (Nov.2001) Malawi (Sept.2001) Zambia (pilot)

Senegal Mali Rwanda CAR Guinea Bissau Mozambique

(2000/2001)

EXPERIENCES FROM COUNTRIESEXPERIENCES FROM COUNTRIES

As part of an on-going survey programme (master sample available, permanent survey organization)

Modification of questionnaire Nigeria (additional question on electricity, educational

attainment categorization, Gender module) Mozambique (module on Flood damage) Rwanda (Consumption module) HIV/AIDS module waiting to be tested Predictor variables are getting country-specific Questionnaire Translation (Tanzania) Probability Sample Pilots (Nigeria) National Surveys (Ghana, Mozambique)

How does the CWIQ work?How does the CWIQ work?

Large sampleShort

questionnaireRigorous control of data quality

Quick data entry & validation

Simple reporting

Fixed core, flexible modules

An off-the-shelf survey package

1. Sampling issues1. Sampling issues

Large samples are encouraged (for high precision)

A ‘core’ survey in a 5-10 year survey programAnnual sampling from Master Sample frames

builds up time seriesNot really intended for panel studies - but

these are not excludedSuitable for small area sampling

2. The questionnaire2. The questionnaire

8 pages / 9 sections (additional modules are increasing the pages)

3 levels hierarchy (household, household members, children)

Service delivery indicators (access, use and satisfaction)

Indicators on welfare status (Assets, housing, literacy, nutrition, employment)

Additional modules (HIV/AIDS; Gender; Flood Effects)

Suitable to monitor crisis situation (speed)

2. The questionnaire (contd.)2. The questionnaire (contd.)

The CWIQ does not collect consumption or expenditure data

The issue of poverty predictors– Kenya experience– Ghana experience– Nigeria/Mozambique experience– Rwanda experience

2. The questionnaire designed for scanning2. The questionnaire

designed for scanning

3. Quality control3. Quality control Data quality is achieved through tight control:

– thorough training;

– close supervision in the field;

– rapid data loading with extensive computerised validation checks; and.

– early feedback to interviewers in the case of problems.

Average number of interviews per enumerator/day - four.

Mean interview duration - about 40 minutes (with anthropometry).

With additional module – slight increase of 5 minutes.

Average comes down with national surveys.

RequiresTELEform for image processing of the scanned forms, converting the marked areas into data values;

Objective is to start data processing as soon as possible after the start of fieldwork.

A questionnaire can be scanned and converted into the database format in about 2 minutes.

Three people in the data processing team can handle 300 questionnaires per day.

The package includes comprehensive documentation on all aspects of the data processing.

4. Data Processing - Stage 14. Data Processing - Stage 14. Data Processing - Stage 14. Data Processing - Stage 1

How character recognition is verified and corrected using TELEform4. Data Processing - Stage 14. Data Processing - Stage 14. Data Processing - Stage 14. Data Processing - Stage 1

Requires Microsoft Access to build data structures, validate, correct, summarise and tabulate the data;

Once scanned the data are transferred to MS-Access which has been configured to:– perform a number of validation checks to test logical

consistency of the data– provide a means of editing erroneous records– generate derived variables

4. Data Processing - Stage 24. Data Processing - Stage 2

5. Generating results

Pre-programmed standard report using Access and Excel

Data can be exported to standard statistical analysis packages

Data and metadata stored and disseminated on CD-ROM

Standardized indicators simplify cross-country comparisons

CAPACITY BUILDING FEATURES OF CWIQCAPACITY BUILDING FEATURES OF CWIQ• Acquired capacity through CWIQ could benefit other Data Production

Process Improved Surveys Programming Tight Quality Control (better accuracy) Use of large sample (higher precision of estimates) Quick processing and quick release of results (Improved Timeliness) Overall Survey Management (rigorous training, close supervision, report

writing)• Additional Capacity

Building team of Consultants trained at EASTC to bring about rapid technology transfer to Africa

Training Statisticians/DP specialists from African Statistical Offices Getting students of Training Institutions familiar with CWIQ methodology

• Subsequent CWIQ rounds in African countries to be guided by African Experts (Ownership)

CHALLENGES AND OPPORTUNITIESCHALLENGES AND OPPORTUNITIES

Challenges Adopting the technology for other surveys in developing countries

particularly in Africa Sustainability of the survey system through getting the national

governments to fund the surveys Cooperation among International Community to improve the system

further What role for ECA (say) to serve as catalyst in the statistical

development in this direction

Opportunities Opportunity to involve the users in questionnaire review to assure

RELEVANCE of output African National Statistical Offices to establish Internet addresses to

bring about easy exchanges, namely: Dissemination of CWIQ results Dissemination of new developments/improvements in CWIQ system Implementation problems and solutions Results of field/methodological research

Networking (establish list – serve) African CSO’s, CWIQ consultants, Experts and persons directly working on CWIQ survey system including USERS.

Summary information It is quick! It’s a packageHelps build institutional capacity:

– to collect quality data– to speed up turnaround time– to generate annual series

TA is needed (2X6 weeks)Duration: 2-6 monthsCost per household (approximate):

– First year $54: (pilot survey on 1000 hh. costs $54,000)– Next year $33: (national survey on 10,000 hh. costs $330,000)– Cost to Respondents (40-45 minutes)

The CWIQ is just one of several tools needed for a poverty reduction

information system

The CWIQ is just one of several tools needed for a poverty reduction

information systemPoverty monitoring and moneymetric

analysis LSMS: Income and expenditure surveys

Poverty monitoring over time CWIQ; Admin. records; Prices collection

Poverty monitoring and poverty maps Censuses; small area surveys

Participative poverty monitoring (listening to the poor)

More information on the CWIQ is available at:

http://www.worldbank.org/af

r/stats/