developing evaluation capacity jean langlois, msc, mba
TRANSCRIPT
![Page 1: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/1.jpg)
Developing Evaluation Capacity
Jean Langlois, MSc, MBA
![Page 2: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/2.jpg)
www.naturecanada.ca
Outline
Intro Nature of the work NGO funding model Motivating people Leading questions
![Page 3: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/3.jpg)
www.naturecanada.ca
Introduction
The world according to Jean Langlois…
Challenges in developing evaluation capacity at an ENGO Nature of the work NGO funding model Motivating people
![Page 4: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/4.jpg)
www.naturecanada.ca
Nature of the work - Challenges
Advocacy: Diffuse causality Causality attribution
Direct Conservation: Measurable vs.
Important biases Durability of
outcomes Defining outcomes
and impacts
![Page 5: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/5.jpg)
www.naturecanada.ca
Nature of the work
What works: Invest time in the
logframe at the outset
Articulate and track tangible results
Articulate, don’t track, intangibles
What’s needed: Shared comfort with
unmeasured intangible benefits
![Page 6: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/6.jpg)
www.naturecanada.ca
Nature of the work - Questions
How do we combat the biases of the measurable vs. the important?
Is it useful to articulate intangible benefits that will not be measured?
For advocacy campaigns, is there a better model than the dotted-line-logframe?
![Page 7: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/7.jpg)
www.naturecanada.ca
NGO funding model - Challenges
Not enough money, ever www.naturecanada.ca
Reporting to multiple funders Multiple evaluation frameworks Varying degrees of buy-in to rigorous evaluation
Propensity to provide “positive” reports
![Page 8: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/8.jpg)
www.naturecanada.ca
NGO funding model
What works: Invest time in
logframe at the outset
Consistent deliverables across grant proposals
What’s needed: Shared expectations Comfort reporting
and learning from failure
![Page 9: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/9.jpg)
www.naturecanada.ca
NGO funding model - Questions
How do we create an environment where people are comfortable sharing and learning from “failure”?
![Page 10: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/10.jpg)
www.naturecanada.ca
Motivating people - Challenges
“The effectiveness of our program will be measured by the degree to which the outputs and outcomes identified in the logical framework are achieved.”
- NOT Martin Luther King Jr
![Page 11: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/11.jpg)
www.naturecanada.ca
Motivating people - Challenges
“Evaluation is a time drain” “It’s not my job” “I’d get more work done if I didn’t have to
report on everything I do”
- Anonymous Colleagues
![Page 12: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/12.jpg)
www.naturecanada.ca
Motivating people
What works: Adapt the language
to the audience Always relate to
mission Tough love: invest in
logframe at the outset
What’s needed: Positive experiences
with evaluation Project-to-project
application of lessons learned
![Page 13: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/13.jpg)
www.naturecanada.ca
Motivating people - Questions
How can we create short-term wins (i.e. positive experiences with evaluation)?
How can we design evaluation approaches that produce useful results that are easily applicable to multiple future projects?
![Page 14: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/14.jpg)
www.naturecanada.ca
Leading questions How do we combat the biases of the measurable vs.
the important? Is it useful to articulate intangible benefits that will
not be measured? For advocacy campaigns, is there a better model
than the dotted-line-logframe? How do we create an environment where people are
comfortable sharing and learning from “failure”? How can we create short-term wins (i.e. positive
experiences with evaluation)? How can we design evaluation approaches that
produce useful results that are easily applicable to multiple future projects?
![Page 15: Developing Evaluation Capacity Jean Langlois, MSc, MBA](https://reader034.vdocuments.site/reader034/viewer/2022051614/551c4cf9550346b1458b4b3c/html5/thumbnails/15.jpg)
Merci