one un monitoring and evaluation what? development results one plan results a.one plan >...

18
One UN monitoring and evaluation WHAT? Development results One Plan results a. One Plan > principles b. HPPMG > operationalization of M&R system, including roles, responsibilities and reporting formats c. One Plan Database using VietInfo > situation monitoring d. UNEG Evaluation > independent evaluation of results HOW? Reform process UN Reform process / One UN / DaO a. Results Framework for the Reform Process (TNTF) b. UNEG Evaluation > independent evaluation of process

Upload: maddison-clayton

Post on 01-Apr-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

One UN monitoring and evaluation

WHAT? Development results

One Plan results

a. One Plan > principles

b. HPPMG > operationalization of M&R system, including roles, responsibilities and reporting formats

c. One Plan Database using VietInfo > situation monitoring

d. UNEG Evaluation > independent evaluation of results

HOW? Reform process

UN Reform process / One UN / DaO

a. Results Framework for the Reform Process (TNTF)

b. UNEG Evaluation > independent evaluation of process

Page 2: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

One Plan M & R + E

Results-based Monitoring and Reporting system by UNCT + GoV to inform decision making (i.e. streamlined, timely, collecting information once and with clear accountabilities)

Independent and impartial Evaluation by UNEG

Page 3: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Principles

1. Who wants what and when?2. Do things once3. Almost everything delivered in projects, so don’t

replicate their M&R systems4. Don’t blur accountabilities between projects

(agency reporting systems) and PCGs5. Take a RBM, not M&E approach6. Management by exception. Focus on identifying

what is going right and what wrong.

Page 4: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Annual Review process

Sequence of AR (mostly built on aggregation):1. Project performance, short report by agency +

IP2. Annual Review by PGC. Short report by PCG

conveners3. Annual One Plan Review by One Plan Steering

Committee4. Annual One Plan report prepared by RCO 5. Annual OPF report prepared by AA

Page 5: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Reporting and Planning Timeline

Draft Annual Project Performance Reports (by Nov 1)

Annual Report- PCG draft

(by Nov 30)

Annual PCG Review

meetings (by Dec 30)

PCG Annual Report finalized

(by Jan 30)

Annual OP 2 Draft Report (by March 1)

Annual OP 2 Review Meeting (by March 15)

Annual OP 2 Report finalized (by March 31)

Draft PCG AWP Final PCG AWP

Draft Reports Meetings Final product

One Plan

Project Agency

PCG

Page 6: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Project Performance

1. Are we on track to deliver agreed outputs? (will we deliver on time?)

2. If off track, what will the UN agency and IP do about it (clear accountability)?

3. Are the outputs still relevant? (our risks and assumptions)

4. Expenditure/budget on an annual basis (did we plan properly and deliver?)

Set up simple ‘traffic lights’ system for each project.

Page 7: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Annual Project Performance Report

Page 8: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Programme Coordination Groups

1. Progress against outcomes (drawn from One Plan database using VietInfo). Not UN contribution, but situation analysis as relates to OP results

2. Performance of projects (report on aggregate performance in a simple traffic light system)

3. Any big shifts in risks or assumptions and implications in the programmatic area

4. PCGs to review own Action Plan internally with regards to joint programming performance (e.g. advocacy, policy provision, reduction in transaction costs, identification of comparative advantage, etc.)

11 PCG reviews and short reports

Page 9: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

PCG Annual Work Plan

PCG AWP has two components:

1.Annual activity plan (AAP) is an overview of the activities of the Participating UN Organizations in delivering the Outputs of the OP.

Must contain just sufficient detail to enable joint planning of activities, identification of synergies between relevant activities and to eliminate duplications. The PCG AAP is a living work plan and will be updated periodically.

Should guide agency specific activity planning in order to maximize potential synergies among activities. Where agency-specific AWPs or Project Documents for 2009 have already been prepared, these will be incorporated into the PCG AAP and potential collaboration identified.

Will be developed through a joint planning and prioritizing process that involves appropriate government partners. The PCG AAPs will be the basis for all future agency-specific planning processes.

2.Common action plan (CAP) is developed by PCG members and focuses on common / joint activities related to advocacy policy, research and UN normative work. Undertaking this work will draw on the technical expertise available within the PCG, and may go beyond the resourced activities that are listed in agency work plans or project documents.

Page 10: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Annual PCG Report

Page 11: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

PCG Annual Work Plan

PCG Annual Work Plan (AWP)  

   

                         

Budget

OP Output Expected Result

 

Project / Activity title UN AgencyImplementing

Partner

Funding

Type of intervention

 

Target population Geographic locationTimeframe

Regular (Core) OR secured OR unsecured OPF secured OPF requested TOTALID

Budgeted Secured TBRPartners

    Q1 Q2 Q3 Q4

PCG TEE                                           

                                             

                                             

Who implements?

Reference to individual agency

Reference to OP output / expected

result

Funding

Timeframe for implementation

Where Budget

Other info about the intervention

Page 12: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

One Plan

1. Situation report from One Plan database using VietInfo for each of the five OP Outcomes – Implications for outcome achievement?

2. Aggregate project performance analysis at level of the five OP Outcomes and the OP

3. Identify areas in projects where performance not acceptable and what will do about it. Good practices and lessons learned.

4. UN non-project support – leadership, advocacy, etc.5. Discuss OPF performance

Annual OP Report + OPF report

Page 13: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Annual One Plan Report

Page 14: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

One Plan Database – using VietInfo

Page 15: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

One Plan database

1. OP db purpose is to monitor the situation in Viet Nam as it relates to the OP at Outcome level for all 23 programmatic clusters

2. OP db will provide PCGs with an overview of the situation for strategic programming purposes

3. Not to be confused with Monitoring and Reporting System of OP, which requires PCGs to report on performance of projects and results against PCGs individual Action Plans

Page 16: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

OP db principles

1. Use of available indicators from existing systems2. Keep number of indicators to a minimum3. Indicators at Outcome level4. Relevant to the Outcome in question5. Nationally owned, whenever possible6. Avoid subjective judgment or agency-driven need for

indicators7. Specific in quantity, quality8. Clear metadata (definition of the indicator)9. Data must be available10. Availability of base line data11. Disaggregation preferred

Page 17: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

OP db sources

1. Viet Nam Development Database (VDD)2. National Statistical Indicator System (NSIS)3. Multiple Indicator Cluster Survey (MICS)4. UNGASS Declaration of Commitment (DOC)5. Other sources?

Page 18: One UN monitoring and evaluation WHAT? Development results  One Plan results a.One Plan > principles b.HPPMG > operationalization of M&R system, including

Results Framework for the Reform Process

1. Agreed at last TNTF2. To start reporting against RF in December 2008