“evaluating sustainable development” · rita o’sullivan (tbc) empowerment evaluation...
TRANSCRIPT
WELCOME to the webinar
“Evaluating Sustainable
Development”
This Live Webinar will start at 10:30 AM, New York time.
All microphones & webcams are disabled.
You will not hear any sound until the webinar begins.
Evaluating Sustainable
Development
Live Webinar
5th April 2011
Webinars on Emerging Practices on Development Evaluation: Speakers Title When
Zenda Ofir, Former President, African Evaluation
Association
Shiva Kumar, Independent Consultant from India
Developing Countries Perspective on Emerging
Practices in Development Evaluation
13 October 2010
Fred Carden, International Development
Research Center (IDRC)
Good Practices in Evaluating Policy Influence
16 November 2010
Jared Raynor, Consultant of TCC group
Evaluating Networks and Partnerships
7 December 2010
Peter Morgan, Independent Consultant
Evaluating Capacity Development
January 2011
Charles Lusthaus, Universalia, Associate
Professor in the Department of Administration
and Policy Studies, McGill University; & partner in
Universalia Management Group; Faculty Advisor
to the Centre for Educational Leadership, McGill
University
Evaluating Organizational Performance
February 2011
Steve Rochlin, Director and AccountAbility's US
Representative
Evaluating Innovation
March 2011
Alastair Bradstock, Business Development
Director of the International Institute for
Environment and Development (IIED) and
Steve Bass, Head of Sustainable Markets, also
of IIED
Evaluating Sustainable Development
April 2011
Webinars on National evaluation capacity development
Saraswathi Menon
Finbar O’Brien
The Role of the United Nations in Fostering
National Ownership and Capacities in
Evaluation
22nd June 2010
Michael Quinn Patton
Marco Segone
Future trends in evaluation.
Moving from policies to results by
developing national capacities for country-
led monitoring and evaluation systems
1st July 2010
Caroline Heider
Craig Russon
Evaluating policies and their results
The role of policy analysis in over-coming
the implementation challenge
16th September 2010
Belen Sanz Luque
Florence E. Etta
Human Rights and gender in evaluation
22nd October 2010
Linda G. Morra Imas
Robert Picciotto
Jean Quesnel
The professionalization of
evaluation
30th November 2010
Oscar A. Garcia
Angela Bester
Joint evaluation of the role and contribution
of the UN system in South Africa. Lessons
learned
14th December 2010
Michael Bamberger
Institutionalizing impact evaluation. A key
element in strengthening country-led
monitoring and evaluation systems
January 2011
Hallie Preskill
Alexey Kuzmin
Exploring effective strategies for facilitating
evaluation capacity development
Use of evaluation training in evaluation
capacity building
February 2011
Michael Quinn Patton
Utilization-focused evaluations
March 2011
David Fetterman
Rita O’Sullivan (TBC)
Empowerment evaluation
Collaborative evaluation. Creating
environments to engage stakeholders in
evaluation
April 2011
Indran Naidoo
The monitoring and evaluation in South
Africa. Many purposes, multiple system
May 2011
Manuel Fernando Castro
Diego Dorado (TBC)
Building a results-based management and
evaluation system in Colombia
June 2011
Velayuthan Sivagnanasothy
National monitoring and evaluation system
in Sri Lanka. Experiences, good practices,
challenges and the way forward
July 2011
David Rider Smith
Policies, institutions and personalities.
Lessons from Uganda’s experience in
monitoring and evaluation
September 2011
Webinars on National evaluation capacity development
Agenda 10h30 – 10h35 Welcome
Abigail Taylor Knowledge Management Specialist, UNICEF
Evaluation Office
10h35 – 10h40 Introduction
Stewart Donaldson, Dean & Chair of Psychology School of
Behavioral & Organizational Sciences, Claremont Graduate University
10h40 – 11h00 Evaluating Sustainable Development
Alastair Bradstock, Business Development Director,
International Institute for Environment and Development (IIED)
11h00 – 11h25 Questions and Answers
Moderated by Stewart Donaldson, Claremont Graduate University
11h20 – 11h30 Closing and Wrap-up
Stewart Donaldson
Steve Bass, Head, Sustainable Markets Group
Alastair Bradstock, Business Development Director,
IIED
Keynote Speakers
Evaluating Sustainable
Development:
capturing the challenges and
lessons
Rockefeller Foundation
April 2011
Alastair Bradstock and Steve Bass, IIED
www.iied.org
We have rapid economic growth …
…which is breaching ecological limits...
...yet many people do not benefit
The MDGs and their env foundations are insecure:
1: Eradicate poverty and hunger – sustainable NRM…
2: Universal primary education – sanitation / water / fuelwood
3: Gender equality and empower women – NR access / IAPoll
4: Reduce child mortality – sanitation / water / IAPollution
5: Improve maternal health – water / fuelwood / IAPollution
6: Combat major diseases – wat-san / biodiversity / climate
7: Ensure env sustainability – env info / rights / accountability
8: Global partnership – manage global public goods (BD, CC)
How to assess SD at country level?
SD institutional ‘products’ to date can be evaluated 1. SD conventions – Biodiversity, Climate, Desertification…
2. SD plans/strategies – national, local, sectoral
3. SD fora and councils – CSD, national, city, sector
4. SD legal principles – polluter pays, precaution, consent…
5. SD ‘triad’ partnerships – govt, civil society, business
6. SD codes of practice – esp in resource-intensive sectors
7. SD ‘wonk’ community – not yet mainstream
8. SD frameworks – are confusing…
Many micro-level SD ‘projects’ can also be
evaluated
Micro-finance for solar, Bangladesh
Organopónicos, Cuba
Plant Oil Stove, Indonesia
Eden Project, UK
Eco-sanitary pads, Rwanda
Some Challenges of Measuring
Overall Progress towards SD
SD’s complexity: it integrates (a) many objectives over (b)
multiple time scales and (c) local to global geographic levels –
but trade-offs rather than indivisible links are more apparent
(‘3 pillars’ rather than ‘3 interlinked strands – triple helix)
SD has not been a real policy priority in practice: thus
deficit of baselines, impact information, monitoring systems,
evaluation frameworks & accountability mechanisms
Much that we want to evaluate has no integral SD
process/targets/indicators e.g. ‘poverty programme’, ‘fiscal
reform’, industrialisation policy’...
Easier to identify what’s unsustainable than what’s
sustainable
Some SD metrics and frameworks
Metrics: Need to cover the three strands (soc, env,
econ) provide an overarching framework from
which to evaluate SD at macro & micro levels
Frameworks:
Reference frameworks at the input/process level
Indicator based frameworks at outcome and impact
level
Narrative approaches to explain multi-factor change
Reference Frameworks at the Input/Process Level
OECD-DAC (2001) has developed 12
principles of good practice for SD
processes
Indicators could be developed based on
these principles to assist SD process
evaluation
Indicator Based Assessments
Chapter 40 of Agenda 21 urged progress assessment of SD
UN Commission on SD – many SD indicators covering economic, environment, social, institutional
Indicator formulation flexible so they accurately reflect local context
Problems associated with aggregating indicators to gain a holistic view of SD performance
At national level, the SDS (often inspired by Agenda 21) usually provides the framework
Narrative Approaches
Good where quantitative data sporadic / unavailable
Complementary even when quantitative data exist. Can provide insights into different causal factors
Important to marshal the mix of indicators that summarises SD’s direction of travel for context
Some ways to conduct SD evaluations
1. Learning groups: IIED using this in 5 developing
countries – all activities that contributed to SD
outcomes over 20 y. Only as good as its members
2. Peer reviews: popular for specific SD initiatives.
Invites people from other countries to review.
France SDS a good example
3. Public expenditure reviews: to assess financial
allocations to SD in every sector. TZ example
Some ways...(cont) 4. Logical framework analysis
16 box matrix; outlines a causal logic that describes the
results chain
5. Theory based evaluation
Similar to LFA but more emphasis on describing the
results chain and the assumptions underpinning the logic
6. Public engagement
Interest is growing in the use of websites to chart the
performance of authorities towards SD. The Netherlands
is a good example
4-5 in particular can suffer from inability to capture spill-
over effects or impacts over longer time periods
Evaluation should support a new SD era: SD efforts should move on
from:
…and do more of:
Fig-leaf comprehensive SD
plans
Investment and accountability
Privileging economic growth Wellbeing of people and nature
SD led by wonks Society-led transformations
International SD conditionalities Local accountability systems
Separate, niche SD initiatives Mainstream SD/systems
Generalised pleading Specific economic/political
cases
Scattered, incomplete SD
assessments
Continuous integrated SD
assessment
Questions and Answers
1
3
2