developmental evaluation why we do it how we are using it a way to contribute
TRANSCRIPT
Developmental Evaluation
Why we do itHow we are using itA way to contribute
Intractable social issues
“In an increasingly complex world,sometimes old questions require new answers”
Developmental Evaluation (DE)
(Patton, 2011)
Innovative, design-oriented initiatives
Strategies, Partnerships,& Outcomes can all beemerging
Unfolding in complex contexts
The Good, the Bad and the Ugly of Evaluation
All evaluation should support learning
Developmental evaluation is different because learning, reflection and ongoing discussion about how to do things is central to the process
Solving social issues can be a tricky, messy place
Provide Education & Training
Workshops
Support the Sharing of Learning &
Knowledge within Hamilton and
across Communities
ASCY – Save the Day for Play Logic Model
Earl
y Le
arni
ng P
rofe
ssio
nals
Early Learning Child Care Centres
OELF Principles Realized in Practice
The early years of Ontario children are catalyst to the development of social, emotional, communication, cognitive and physical skills fundamental to life-long learning and health.
Envi
ronm
ents
Prepared by The O’Halloran Group www.theohallorangroup.ca, October 2011
More Welcoming
Enriched to Spark Curiosity & Exploration
Better Reflect Unique Needs &
Diversity
More Space and Time for Play Based
Learning
Communities
Increased Mentorship
Greater Collaboration
Stronger Networks
More Integrated Child Care System focused on the OELF Principles
Greater Valuing & Sharing Between Early Learning Programs
ASCY
Deeper Knowledge & Understanding of OELF
Greater Skill for & Valuing of Play Based Learning
Increased Resources for Supporting \
Sustainability
Increased Reflection to Inform Planning
Increased Creativity, Experimentation &
Building More of Their Own Solutions
More AmenableView of the Child
More Common Professional
LanguageIncreased Skill for
Observing & Documenting Play
Facilitate Readiness for Curriculum
Change
Provide Mentoring & Coaching
Support Leadership Development
Strategic Planning, Program Logic Models, Policies & Procedures
better reflect OELF/Save the Day for Play
Improved Continuum of Development; Observation & Documentation
Greater engagement of the director as a collaborator in learning
In a developmental evaluation, imposing a logic model can feel something like this…
#BeFearless
Making mistakes
Going back & redesigning your process
When DE Makes Sense
Initiative is emerging in a complex context
Direction and outcomes are unknown
Partners and collaborators may change & grow
There is openness to engagement & reflection
There can be comfort with ambiguity and shifting processes
Role of the evaluator
Ask
Design
Do
Share
Listen
What I would do in a typical evaluation
Ask
Listen
DistillShare
Reflect
What I do in a DE context
Never Stop Questioning
• What, So What, Now What?• What were the critical decisions
that were made?• How has learning informed the
development of activities?• Where are we now? Where do
we want to go next?• To what extent and in what ways
are we working with others?
A good evaluation – developmental or otherwise – reflects the conditions of that
which it is attempting to evaluate
Social Prosperity Wood Buffalo Theory of Change
Complexity
Momentum
Sustainability
Stakeholder Groups
• To examine and characterize the contribution and outcomes of Social Prosperity Wood Buffalo as a systems-level intervention designed to achieve social change
Learning
Knowledge transfer
Stakeholder Engagement
Complementary Research Strategies
Social Prosperity Wood BuffaloEvaluation Plan
Phases
• Laying the Ground Work
• Learning as We Go
• Reflecting on What We Achieved
• Looking Forward
Evaluation Questions
1. What is the contribution to capacity & innovation?
2. How do activities change?
3. What are the lessons learned?
4. What supports innovation?
5. What supports resiliency?
6. What is the impact on relationships and networks?
7. What is the impact on capacity?
8. What are the outcomes of innovation?
Social Prosperity Wood BuffaloEvaluation Plan
Methods & Tools
Activity Tracking
Community Asset Map
Feedback Surveys
Key Informant Interviews
Capacity Assessment
Social Prosperity Wood BuffaloEvaluation Plan
…so far
Innovation
Capacity Building
Capacity Assessment Measure
• To assess capacity for delivering responsive programs and services.
• The development of supports• The development of benchmarks and capacity
indicators
• Available online• As a pdf on the Social Prosperity & Sector
Link websiteshttp://socialprosperity.cahttp://nonprofitsectorlink.com
• Open from now until end of June• Goal is 100 completed
