developing sea change’s evaluation plan annual members’ meeting track a november 10, 2011
TRANSCRIPT
![Page 1: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/1.jpg)
Developing SEA Change’s Evaluation Plan
Annual Members’ Meeting Track A
November 10, 2011
![Page 2: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/2.jpg)
Purpose of the Session
• To develop parts of an evaluation plan for the second year of SEA Change
• To provide participants with a participatory M&E planning experience
![Page 3: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/3.jpg)
Agenda• Review the stages of M&E and the steps for
M&E planning• Conduct a stakeholders’ analysis• Define the purpose of the evaluation• Develop key evaluation questions• Identify data sources and collection methods• Discuss next steps
![Page 4: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/4.jpg)
Collect InformationReport & Use
the Results
Plan the Evaluation
Analyze & Interpret Information
Stages of M&E
Engage Stakeholders
Engage Stakeholders
![Page 5: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/5.jpg)
Reasons for Participatory Evaluation• Obtain better quality data• Because the evaluation will be more relevant,
more likely to have the results used• Foster greater ownership• Develop evaluation capacity
![Page 6: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/6.jpg)
An evaluation plan is your roadmapAn evaluation plan is your roadmap
(University of Wisconsin-Extension, Program Development & Evaluation)(University of Wisconsin-Extension, Program Development & Evaluation)
![Page 7: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/7.jpg)
Steps to M&E Planning1. Describe the project2. Identify major stakeholders and their information
needs and uses3. Define the M&E purpose(s)4. Formulate M&E questions and indicators5. Identify sources of information and data collection
methods6. Determine ways to analyze the M&E data7. Decide how to report and facilitate the use of the
M&E results
![Page 8: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/8.jpg)
Step 2: Evaluation Stakeholder Analysis
Major StakeholderGroups
What information do they need from the evaluation?
How will they use the results of the evaluation?
![Page 9: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/9.jpg)
Step 3: Define the Purpose(s) of the Evaluation
How will the information be used?
![Page 10: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/10.jpg)
Underlying purpose =Underlying purpose =
![Page 11: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/11.jpg)
Common Purposes for M&E To be accountable and report to:• Donors• Program participants and community members• Government
To improve program (re)design, planning and implementation
To obtain additional resources To advocate for particular issues To acknowledge and celebrate our successes Other ???
![Page 12: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/12.jpg)
Step 3: Define Our Evaluation Purposes In your work groups, write a purpose statement:
“We are conducting an evaluation of SEA Change in order to obtain information that will be used to:
– – – –
![Page 13: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/13.jpg)
Steps to M&E Planning Describe the project Identify major stakeholders and their information
needs and uses Define the M&E purpose(s)1. Formulate M&E questions and indicators2. Identify sources of information and data collection
methods3. Determine ways to analyze the M&E data4. Decide how to report and facilitate the use of the
M&E results
![Page 14: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/14.jpg)
Step 4: Formulate Evaluation QuestionsWhat are Evaluation questions?
• Information needs stated as questions• State what aspects or topic of the project will
be addressed in the evaluation
Provide:FocusClarity
![Page 15: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/15.jpg)
Time to focus, focus, focus . . .
(University of Wisconsin-Extension, Program Development & Evaluation)(University of Wisconsin-Extension, Program Development & Evaluation)
![Page 16: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/16.jpg)
Step 4: Formulate Evaluation Questions
What are typical types of evaluation questions?
Use the Logic Model
• What project activities have been implemented? Have they been implemented as planned? If not, why not?
• To what extent have expected outcomes been achieved?
![Page 17: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/17.jpg)
Step 4: Formulate Evaluation Questions
Other types of evaluation questions:
• Efficient use of resources?• Effective in achieving project objectives? • Is the project relevant?• Are the activities and/or outcomes
sustainable?• To what extent has the project achieved
its expected impact?
![Page 18: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/18.jpg)
Step 5: Decide Sources of Information and Data Collection Methods
Where will the information come from to answer the evaluation questions?
What methods will be used to collect that information?
![Page 19: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/19.jpg)
Data Collection PlanProject Element or Topic Evaluation Question Data Source and
Collection Method
![Page 20: Developing SEA Change’s Evaluation Plan Annual Members’ Meeting Track A November 10, 2011](https://reader035.vdocuments.site/reader035/viewer/2022062520/5697c0081a28abf838cc6d07/html5/thumbnails/20.jpg)
Next Steps
• Sign up for the Evaluation Committee, if you’re interested
• How should be share this with the rest of the CoP?
• How should we share this with Track B?