SUB-MODULE 5.

MEANS OF VERIFICATION

RESULTS BASED LOGICAL FRAMEWORK TRAININGQuality Assurance and Results Department (ORQR.2)

I. Introduction to the RLF

II. Participatory Approach for RLF development

III. The results chain

IV. Performance indicators

V. Means of verification

VI. Risks and mitigation measures

6 Sub-Modules

TRAINING CONTENT

2RESULTS BASED LOGICAL FRAMEWORK TRAINING

Evaluation

I. Test at end of training

II. Multiple choice, open questions and case studies

CONTENT: SUB-MODULE 5

3

I. The means of verification in the RLF.

II. Definition.

III. Characteristics of the Means of Verification.

IV. Types of data sources.

V. Steps.

VI. Data collection matrix.

VII. Examples of means of verification.

VIII.Practical tips.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

4

OBJECTIVE: SUB-MODULE 5

At the end of this sub-module, Bank staff should be able to:

Define exactly how to gather information for each indicator.

Identify primary and secondary sources of information.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

I. The means of verification in the RBLF

5

Country and project name:Project objective:

Results chain

Performance indicatorsMeans of

verification

Risks and mitigation measuresIndicator Baseline Target

Impact

OutcomesOutcome 1Outcome 2 … etc.

OutputsComponent 1Output 1.1 Output 1.2 … etc.Component 2Output 2.1Output 2.2 … etc.

Key activityComponent 1:Component 2:

InputsComponent 1:Component 2:

RESULTS BASED LOGICAL FRAMEWORK TRAINING

6

Sources of information and resources for each indicator, which can be used to check whether the expected results of the project are / have been achieved.

The means of verification (MoV) provide the basis for monitoring and evaluation of performance indicators of a project.

The information derived from the sources identified in the MoV column will be used: As feedback for project management. To make adjustments to the project. To improve future projects (preparation).

II. Definition

RESULTS BASED LOGICAL FRAMEWORK TRAINING

7

Must be practical and economic (low cost)

They should specify: The format in which the information will be available. Who will provide the informations. Frequency (monthly, quarterly, annual, etc.).

An RLF indicator is relevant if there is a planned or existing system for collecting the corresponding information on a timely basis.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

III. Characteristics of the Means of Verification

8

IV. Types of data sources (1/3)

Secondary sources. Data that have been collected by various organizations (other than the implementing agency), such as: Socio-economic survey data. Government statistics

Limitations: Timeliness, quality of data and level of disaggregation. Data may have been collected with other interests in mind.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

9

Primary sources. Data that is collected by the implementing entity itself and may include:

Surveys, focus group interviews, direct observation, as well as administrative, budget or personnel data.

Limitations: Primary data normally involves a cost, along with consideration as to which organization will collect the data.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

IV. Types of data sources (2/3)

10

Statistical databases, census.

Databases of sectoral ministries.

Records of local governments.

Documents from project management.

Policies and strategies of the Bank.

Country Strategy Papers.

Gender patterns in the country.

The Bank’s gender and environment indicators.

Reports on the MDGs and Human Development.

Report on World Development, other donor reports.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

IV. Types of data sources (3/3)

11

V. Steps

During the development of the RLF indicators, the team must…

Review the country’s information systems relevant to the project – assess the validity, accuracy, level of disaggregation, and timely availability of the data.

Use indicators that already exist / widely available.

Do an inventroy of secondary sources.

If no secondary data sources for the indicators exist, consider gathering the data — primary sources.

Possibility of using proxy indicators.

If it is necessary to collect primary data, the following questions need to be considered: How? Who? When? Financing? (Data collection matrix)

RESULTS BASED LOGICAL FRAMEWORK TRAINING

VI. Data collection matrix

The purpose of this matrix is to ensure that the project spells out specifics of every aspect of verification for an indicator.

Means of verification

Performance indicators

Data sources

Method for data

collectionMethod for

data analysisReporting

formatResponsible

agency FrequencyData

collection cost (USD)

Latrines built for girls in 3 regions (#)

Primary Bill of Quantity count

Project Progress Report

Executing Agency Quarterly 150

Annual revenue

increased (CFA)

Secondary N/A N/A Tax ReportProvincial

Directorate of Administration

and FinanceAnnual 20

12RESULTS BASED LOGICAL FRAMEWORK TRAINING

VII. Examples of means of verification – Impact (1/3)

13

Performance indicatorsMeans of verification

Indicator Baseline (2010)

Target (2015)

Impact: Prevalence of waterborne diseases (%) 23 16

Ministry of Health – National monitoring report, 2016, Table 9B

Impact: Poverty rate (%) 65 48Poverty Reduction Strategy Paper (2011-2016) – Annual monitoring, 2015.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

14

Performance indicators

Means of verificationIndicator

Baseline (2010)

Target (2015)

Outcome: School enrollment in project area (%) 35 45

Ministry of Education – Annual monitoring report, 2016, Table 9B –Regions

Outcome: Annual incomes of small farmers (CFA/Month) 30 000 75 000

Provincial Directorate of Administration and Finance - Annual Tax Report, 2016.

Outcome: Conflicts between communities (Conflict Scale) High Low Minutes of meeting with

the community

RESULTS BASED LOGICAL FRAMEWORK TRAINING

VII. Examples of means of verification – Outcomes (2/3)

15

Performance indicatorsMeans of verification

Indicator Baseline (2010)

Target (2015)

Output: Classrooms built (#) 0 150Quarterly Project Progress Report

Output: Latrines built for girls (#) 0 25 Quarterly Project Progress Report

Output: Varieties of climate-resilient seeds tested in the province (#)

0 15 Quarterly Project Progress Report

RESULTS BASED LOGICAL FRAMEWORK TRAINING

VII. Examples of means of verification – Outputs (3/3)

16

Always draw data from reliable and functional information system.

Determine the data sources and performance indicators together to ensure that the indicators are practical and data collection is cost-effective.

Consider creating an independent information management system and conduct occasional surveys if secondary sources are not available.

Consider the participation of stakeholders in the monitoring of the project. This is often an effective way of monitoring performance.

RESULTS BASED LOGICAL FRAMEWORK TRAINING

VIII. Practical tips

17

Your one-stop shop to

quality assurance

and results

reporting tools used

throughout the

project cycle

RESULTS BASED LOGICAL FRAMEWORK TRAINING

ACCESSIBLE THROUGH THE INTRANET

Quality Assurance Assistant