effective and efficient monitoring, evaluation and learning (mel), kate dowen ccxg gf september 2016

12
International Climate Fund (ICF) Effective and efficient Monitoring, evaluation and learning (MEL) Kate Dowen, Department for Business Energy and Industrial Strategy (BEIS)

Upload: oecd-environment

Post on 15-Apr-2017

80 views

Category:

Environment


4 download

TRANSCRIPT

International Climate Fund (ICF)

Effective and efficient Monitoring, evaluation and learning (MEL) Kate Dowen, Department for Business Energy and Industrial Strategy (BEIS)

Presenter
Presentation Notes

International Climate Fund – New Starter Pack 3

Scaling up Climate Finance

Climate Finance Figures: The UK Government set up the International Climate Fund in 2010 to provide £3.87bn between April 2011 and March 2016 In September 2015, the Prime Minister announced that the UK would significantly increase our climate finance over the next five years, providing at least £5.8bn ($9bn) by 2020.

The ICF Portfolio 2016 – 2021

DFIDBEISDefra

DFID - focusing in the poorest countries primarily on adaptation. BEIS - focused on mitigation. Defra- the smallest portfolio with a focus on forestry and biodiversity.

Presenter
Presentation Notes
BEIS spend amount and is doubling in size, Similarities to innovation

11

Diverse ICF Portfolio

Adaptation/Resilience CCRIF ARC stARCK+ BRACED

Forestry REM BioCF FCPF

Capacity Building CCS 2050 Pathways PMR ADB TA TCAF CDKN Private Finance

PPCR SEEC REEP

Technology CTF PMEH

Small Island Developing States PPCR SEEC REEP

Improving Architecture NAMA GCF Ci-Dev

Key BEIS Projects DFID Projects

…Senior support for strong PMO and M&E

Presenter
Presentation Notes
Large and very diverse portfolio.. Funds of funds in some cases, direct fund, Fund of funds Fund to MDB Funding TA / Capacity building Focussing on forestry, private finance, carbon markets etc.

Key Performance Indicators

• 16 KPIs – being used and reviewed • Annual reporting – supports annual reviews. • Aggregation – provides programme level data,

useful for communicating impact, but doesn’t help us make programming decisions

Presenter
Presentation Notes
Not all KPI’s are reported by all projects, there are some mandatory ones.. E.g every project should lead to transformaitonal change, as that is the objective of the ICF.. The KPI’s are based on the ICF Theory of Change

ICF Theory of Change

Presenter
Presentation Notes
KPI’s come from this.. If projects don’t report against any KPI, they do not fit the ICF ToC

Overall ICF Results to date, as of March 2015

KPI Key Performance Indicator Achieved Results

(2011-2015)

Expected Results (programme

lifetime)

1 People supported to cope with Climate Change 15,000,000 53,000,000

2 People with clean energy access 2,600,000 33,000,000 5 Jobs created 39,000 100,000 6 GHG avoided (t CO2e) 2,300,000 430,000,000 7 Installed capacity (MW) 190 3,100 8 Area of deforestation avoided (hect.) 6,600 7,800,000 9 Units low carbon technology installed 310,000 3,600,000

11 Public finance mobilised (£) 1,200,000,000 3,700,000,000 12 Private finance mobilised (£) 330,000,000 3,400,000,000

Source: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/463954/ICF_Results_Note_Final.pdf

Presenter
Presentation Notes
Means we can report results like these Shows where you’re leaning towards at portfolio level

The ‘L’ in MEL

5

Monitoring and Evaluation are primarily done for two purposes:

ICF portfolio aims for ‘transformational’ change. This required pioneering new approaches. By its nature a riskier portfolio, for which learning (for future spend) is essential! Greatest value is learning…

Challenges for donors

International Climate Fund – New Starter Pack 5

• Large diverse portfolio across the ICF • Donor’s distance from results and activity on the ground yet a need for

accountability for taxpayer money. How do we learn across 200+ programmes, across 30 countries, with a

huge range of delivery partners? How can we be assured of the quality and consistency of reporting across

the portfolio? • ICF, by its nature, aims to test innovative approaches, which requires more MEL

activities than traditional approaches, to learn if it is working and why or why not • Large scope and multiple objectives means that no one indicator is a good

indication of achievement. Need indicators for mitigation, forestry, adaptation, leverage, etc.

• Transformation – donors potentially choose higher risk programmes (as they have higher transformational potential) but may not produce as high results in other areas as more conventional approaches.

• Harmonisation of results frameworks with other MDBs and donors. How do we ensure that our KPIs record comparable results to those by other donors and MDBs?

MEL and programme management

International Climate Fund – New Starter Pack 5

Strong programme management function with MEL embedded into process creates a number of benefits:

1. MEL considered early (in Business

Cases)

2. Annual reviews use robust analysis

(KPI) – resource efficiencies and better quality

reviews!

3. MEL activity feeds directly into

programme and portfolio decision

making cycles.

Presenter
Presentation Notes
Not an add on. Always there

3 Levels of MEL

International Climate Fund – New Starter Pack 5

Level Activity Purpose

PORTFOLIO Aggregated KPIs Portfolio evaluation – Compass contract

Monitoring & accountability Learning & accountability

PROGRAM Logframe monitoring Results collection against KPIs Prioritised evaluations activity

Published annual report and assessment of programme Annual report and portfolio evaluations Future investment decisions, annual reports, accountability (verification of monitoring), case studies

PROJECT Project level monitoring run by fund manager Project level evaluation activity run fund manager

Feeds into programme level Feed into programme level Provides tangible case studies

Climate Change Compass – Portfolio level MEL

International Climate Fund – New Starter Pack 5

Monitoring - Review of KPIs to determine if methodologically fit for purpose; - Use and usability - Harmonisation with other funds Evaluation - Strategic learning questions selected by stakeholders across the ICF. - All learning questions take the form of: What works, for whom, in what circumstances, how and

why? Rather than just trying to measure impact. - Evidence used to answer learning questions is taken from across ICF portfolio’s published

evaluations and published documents from other MDBs, donors. Learning - Facilitation and learning experts help with consultation and engagement through monitoring

and evaluation processes - Develop internal intranet to share lessons learned & documents across ICF portfolio. - Communications and graphic designers available to help - Stakeholder mapping done to understand potential audiences needs – i.e. who needs to learn

what and how do they learn best?

Presenter
Presentation Notes
Don’t expect learningv to jusr happen, takes resource and commitment

Concluding Remarks • Quality of climate finance matters as much as its quantity. ICF was

established to learn more about what works and does not work for the benefits of the international community. The results are hugely valuable for accountability, and learning – providing a key project management tool.

• This can only be achieved by comprehensive and rigorous MEL. Key to

success is embedding results collection into the project management cycle (yearly process).

• Reporting across a portfolio is difficult and requires dedicated analytical

resource. Monitoring and reporting is most effective when it is combined with evaluation and learning activities. The Compass programme will allow us to learn about MEL

• Publication is key! Allowing greater comparability, building the

international communities skills, and for accountability/transparency.