evaluation optimising evidence for accountability and learning … · 2018-06-12 · evaluation –...

Evaluation –Optimising Evidence for Accountability andLearning in NRM Programmes

Prof Eureta Rosenberg (Rhodes

University), Nosiseko Mtati (NLEIP

and Rhodes) and Vhutshilo Mudau

(AWARD and Rhodes)

Biodiversity Research and Evidence Indaba 17 August 2017

2

Resilience in the Olifants(RESILIM-O) – Limpopo Province, AWARD & USAID

Ntabalanga-Laleni Ecological Infrastructure program (NLEIP) -Eastern Cape, DEA & Rhodes

Two NRM Programmes with Innovative MEAR:

Photo Credits: NLEIP and AWARD

3

If we want Monitoring, Evaluation & Reporting to optimise accountability and learning, we need:

1. Complementarity of multi-methods

2. Reporting with built-in reflection

3. Social & educational protocols forcitizen monitoring

1. Complementarity of Multi-Methods

• On its own an indicator is just suggestive.

• On its own, a story is just anecdotal.

• Indicators plus narratives can add up to

robust evidence.

Complementarity of Multi-Methods

Indicator based monitoring (e.g. # of wetlands restored, # of training days) +

Open-ended narrative

monitoring +

Focussed evaluation

case studies +

Meta-evaluation = generalizable

insights

2. Reporting with Built In Reflection:

• Action-reflection cycles

• In complex,

stochastic systems =

• Strategic adaptive

management

Plan

Take action

Get feedback

Reflect

2. Reporting with Built In Reflection:

• B2O Back to Office reports

• Teams compile monthly reports

• Evaluation Champs & Coordination

• Reflection may require training

• Need not be more onerous!Research: Mudau, Thulare, Kotschy, Burt, Rosenberg

3. Citizen Monitoring can be valuable

• For NRMPs• For citizens

Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg

3. Citizen Monitoring protocols:

• Scientific• Social• Educational

Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg

Conclusion: Some NRM programmes are collecting evidence through new MEAR

frameworks which have potential to increase learning and accountability.

Research investigating such claims is underway. How do we make this work into the national system?

Plan

Act

Evaluate