Evaluation of the Paris Declaration Phase 2

DAC Evaluation Network15 June 2009

Niels Dabelstein

Phase II ’Architecture’

Again based on the principles of the ParisDeclaration: a joint evaluation comprising:

• Country level evaluations assessing results/outcomes• Additional donor/agency HQ studies• Supplementary studies with focus on results• Synthesis report to be presented to 4th HLF

Phase II Evaluation Model

Two complementary foci: 1) Implementation focus (expanded Phase I):• More diverse set of countries + wider range of

stakeholders• More attention to capacity building and assess

donor support to analytic & advisory activities• HQ level studies by donors not included in Phase I2) Results focus: • Identify PD influence on development effectiveness

(outcomes & results)

Methodological IssuesChallenges to evaluate the results:

• Brief time span since PD endorsed (March 2005)• External influences make attribution difficult• Demanding data requirements• Complementary methodologies required

To handle these challenges the evaluation should:• Have a balanced & sufficient sample of countries• Have sufficient coverage of sectors and themes• Produce information of good quality• Offer possibility of explanation and attribution

Methodological Issues

Therefore methods should include:• Synthesis of existing evaluations, research and

indicators• Comparative in-depth case studies chosen to contain a

good cross-section of common themes/sectors• Longitudinal studies: backward looking to track PD-like

(longer established) policies and possibly forward looking (‘theory-based’ to map plausible directions of travel)

• Targeted comparative studies to ‘supplement’ country-based evaluations

Overseeing the evaluationInternational Reference Group, co-chaired by Sri Lankaand the Netherlands

• Members of the DAC Network on Development Evaluation (who actively support)

• Partner countries who conduct country-level evaluations

• Multilaterals and CSOs

Tasks:• Endorse overall Evaluation Framework and ToRs for

component & supplementary studies • Review draft reports for quality, credibility & clarity

Participants in Int. Ref. Group • Australia• Austria• Belgium• Canada• Denmark• Finland• France• Germany• Global Fund/GAVI• Ireland• Japan• The Netherlands• New Zealand• Norway• Spain• Sweden• Switzerland• United Kingdom• USA• UNDG/UNDP• OECD/DAC• CONCORD• World Bank/IEG

• Afghanistan• Bangladesh• Benin• Bolivia• Cambodia• Cameroun• Columbia• DRC• Indonesia• Ghana• Kyrgyz Republic• Malawi• Mali• Mozambique• Papua New Guinea• Samoa• Senegal• South Africa• Sri Lanka• Uganda• Viet Nam• Zambia• Reality of Aid

Managing the evaluation

Management Group responsible for:

• Developing the overall evaluation framework and ToR Core Evaluation Team• Coordinating and managing the evaluation process• Guiding the component studies • Developing and managing supplementary studies and synthesis of findings and recommendations.

Evaluation Secretariat at Danish Institute for International Studies

Managing the evaluation

National Reference Groups

Established in-country and with key government, development partners and NGO stakeholders

• Approve detailed design of country study

• Serve as resource for country evaluation teams

• Review draft evaluation products for quality, credibility and clarity

Euro USD @ 1,30

Country Level Studies (18) 1.440.000 1.872.000

Donor HQ Studies (4) 320.000 416.000

Reference Group meetings (4) 350.000 455.000

Management Group Meetings (8) 25.000 32.500

Regional workshops (8) 225.000 292.500

Core team 1.000.000 1.300.000

Special Studies 550.000 715.000

Dissemination 310.000 403.000

Secretariat DIIS 740.000 962.000

Contingencies 125.000 162.500

Total Estimated Cost 5.085.000 6.610.500

BUDGET

Contributions  Euro   Euro

Austria   Norway  *

Australia 100.000 Spain 240.000

Belgium 180.000 Sweden 580.000*

Canada 160.000* Switzerland 160.000

Denmark 200.000 UK 670.000

Finland 360.000 US 317.000

France  * AfDB  

Germany 410.000* AsDB 80.000

Ireland 80.000 EC  

Japan 160.000 IDB  

Luxemburg   UN  

Netherlands 740.000 World Bank In kind 

New Zealand 45.000    

    TOTAL 4.482.000

Budget 5.085.000 Outstanding 603.000

Schedule of Events 2009• 11 – 13 Feb. 1st Meeting of the Reference Group for PD Evaluation Phase 2

Kick-off workshop - 1st draft Approach paper.• 15 May Approach Paper and TOR for Core Team approved.• 3 June Tender process initiated w. three bidders. (one has withdrawn)• 5 August Team Selection• 7 September Core Team operational• 1 October Draft Report on Untying of Aid to IRG for comments (by 11

October)• 26 – 28 Oct. Asia Pacific Regional Workshop in Cambodia• 1 November Final Report on Untying of Aid• 3 – 5 Nov. Latin America Regional Workshop in Colombia• 10 – 12 Nov. Anglophone Africa Regional Workshop in Malawi• 18 – 20 Nov. Francophone Africa Regional Workshop in Benin• 20 November Untying of Aid Report discussed in DAC• 30 November 2nd Meeting of the Reference Group for PD Evaluation Phase

2.1 December Country Level TOR; Work plan for 2010

• 2 – 3 Dec. WP-EFF, presentation of progress report and Untying of Aid Study