www.ifrc.org saving lives, changing minds. cbhfa spac cbhfa pmer update actualización de pmer en...
TRANSCRIPT
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CBHFA SPAC
CBHFA PMER updateActualización de PMER en
SPAC
November/Noviembre 2013
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
?
What is PMER? What is PMER tool kit? Why?
¿Qué es PMER? ¿Qué es el kit de herramientas PMER? ¿Por qué?
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
PMER
Objectives of this sessionto inform about the PMER toolkit update
process and the updated toolsto have an overview of the toolsto share from evaluations done in Americato analyse situation/needs in PMER and …To define next steps (traducción al español?)
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CBHFA PMER Toolkit
October 2009: CBHFA M&E
workshop
October 2010:AP CBHFA
workshop - Lessons learnt
and M&E
2010: Tools developed
(consultant)Pilot testing the
tools
January 2011:
Launch of toolkit
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CBHFA PMER Toolkit
2011-2012:
Using tools in programming
October 2013:
Update finalized
November 18-21, 2013:
CBHFA workshopPanamá
May-July 2013:
Desk review of reports; conducting
interviews, feed-back through
questionnaires
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
PMER
Erase una vez en América
Once upon a time in América
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Process
Desk review (7 reports from Global/Regional meetings; comments/feed-back received)
Questionnaire (35 completed from NS, IFRC staff/31 using the toolkit)
Interviews (16 interviews with NS CBHFA focal persons, IFRC staff)
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Most and least important tools (N=31)
Herramientas más/menos importantes
Tool: Most Least
PMER Toolkit Overview 1 Planning tools/templates: 4 1 Concept paper template 3 62 Proposal template 1 33 Log frame template 11 14 CBHFA Indicator guide 15 5 M&E plan template 6 16 Plan of action template 3 1Monitoring tools/templates: 4 7 Volunteer record book 7 28 Volunteer’s home visits guide 2 29 Supportive supervision checklist 1 210 Community Health Committee visit
and community satisfaction checklist
1 3
Tool: Most Least
Evaluation tools/templates:
11 Case study guidelines 1 6
12 CBHFA survey (baseline-endline) guide
6 4
13 Survey questionnaire 5 1
Reporting tools/templates: 2
14 Community level monthly report
1
15 Community progress report – reporting back to community
1
16 Branch monthly report 3 1
17 Indicator Tracking Table 5 4
No answer 2 10
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
PMER toolkit overviewHerramientas de PMER (n=29)
Very useful
Useful Not so useful
Useless0
2
4
6
8
10
12
14
16
Usefulness / Utilidad Layout / Diseño
Very clear
Clear Not so clear
Unclear 02468
1012141618
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Indicator guideGuia de Indicadores (n=30)
0
5
10
15
20
Usefulness Utilidad Language/writing Lenguaje/Escritura
02468
1012141618
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Indicator guide (n=30)
Guia de Indicadores
Layout Diseño
Very clear
Clear Not so clear Unclear No answer02468
101214161820
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Volunteer record book (n=22)
Libro de registro del voluntarioUsefulness Utilidad Language/writing Lenguaje/escritura
Very use
ful
Useful
Not so use
ful
Useless
No answer
0
2
4
6
8
10
12
0
2
4
6
8
10
12
14
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
LogframeMatriz (n=31)
Very useful
45%Useful39%
Not so useful
6%
No answer
10%
Usefulness
Very easy to understand
23%
Easy to understand
58%
Not so easy to understand
10%
No answer 10%
Language/Writing
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Baseline/endline questionnaire (n=28)Cuestionario de línea de base/final
Very useful
Useful
Not so useful
Useless
No answer
0 2 4 6 8 10 12 14 16
Usefulness Utilidad
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Baseline/endline questionnaireCuestionario de línea de base/final
Language/writing Lenguaje/ escritura
Very easy to understand
Easy to understand
Not so easy to understand
Hard to understand
No answer
0 5 10 15 20 25
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
?????????
How do you PMER in your national societies?
Como PMER ustedes en sus sociedades nacionales?
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CBHFA PMER KIT OVERVIEWKIT DE PMER: VISION GENERAL
What: basics of setting up and using a monitoring and evaluation system for CBHFA programmes. Clarifies what monitoring and evaluation are How you plan to do M&E, design a system that
helps you monitor and an evaluation process Helps in selecting appropriate indicators for various
CBHFA topics and tools to measure them. Why: Help CBHFA managers to effectively plan,
implement and report community health programmes.
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CBHFA PMER KIT OVERVIEW
Who: This toolkit should be useful to anyone working in CBHFA, who is concerned about the efficiency, effectiveness and impact of the work of the programme
When: CBHFA programmes MOMENTS in planning and designing in preparing logframes in selecting appropriate indicators in setting up monitoring and reporting systems in evaluation (baseline and endline).
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Table of contents 1
0. CBHFA PMER Toolkit Overview 1. Planning tools/templates
1.1 CONCEPT PAPER Template 1.2 Proposal Template 1.3 Logical framework (logframe) template 1.4 CBHFA Indicator Guide 1.5 M&E Plan template 1.6 Plan of action template
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Table of contents 2
2. Monitoring tools/templates:
2.1 A RECORD BOOK FOR COMMUNITY VOLUNTEERS
2.2 Home visit guide 2.3 Supportive Supervision checklist 2.4 Community health committee visit and
community satisfaction checklist
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Table of contents 3
3. Evaluation tools/templates 66 3.1 BASELINE / ENDLINE SURVEY
QUESTIONNAIRE 3.2 Survey data entry
4. Reporting tools/templates 4.1 Community Level Monthly Report 4.2 Community Progress Report – CBHFA 4.3 Branch Monthly CBHFA Report 4.4 Indicator tracking table (ITT)
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Overall changes / Cambios 1
All tools in “one book”/ Todas herramientas en “un manual”
In collaboration with PED / Colaboración con PED
Streamlined with other IFRC PMER tools/ racionalizado con otras herramientas de PMER de FICR
Corrections; consistency / Correcciones; consistencia
Language simplified /Simplificación de lenguaje
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Changes / Cambios 2
Repeated information and annexes removed/ Eliminados anexos e información repetida
Links to tools and reference material inserted/ Enlaces a herram. y material de referencia
Case study guide and survey guide/Guia de estudios de caso y guia de encuestas
Tool for data entry for baseline-endline questionnaire added/ Herram. para entrada de datos del cuestionario de linea de base/
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Changes /Cambios 3
Overview: the “boxes” containing the “what, who,
where, when” kept most of the accompanying text moved to
respective section and/or toola link to the respective tool inserted next to
each “box” links to IFRC reference material inserted
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
1. Planning tools and templates
Concept paper template Proposal template Logframe template Indicator guide M&E plan template Plan of action template
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
CONCEPT PAPER TemplateCommunity Health / CBHFA
Reference #: Date: Project name: (What is the project name?)
Project start & end dates:
Implementing partner (HNS): (Name of the national society that will implement the project?)
Supporting partner (IFRC/PNS): (Which partner(s) will be providing support to the project?)
Project objectives: Goal: (What do you hope to achieve -the long-term results?)
Outcomes: (Which are the primary results in terms of the knowledge, attitudes or practices of the target group the project seeks to achieve?)
Target group(s): (Who will be the target population and why?)
Location (branch/district)
(Where will the project be implemented and which branch will be involved?)
# of communities: (In how many communities will the project be implemented?)
Estimated # of households: (How many households will be involved?)
Estimated # of beneficiaries: Total #: Female #: Male #:
Estimated total budget: (How much will the total budget be that is required to implement the project?)
Resources needed: (What resources will be needed besides money?)
HNS role: (What is the role of the National Society in this project?)
Supporting partner role: (What is the role of the supporting partner?)
Point of contact at HNS: (Who will be the contact person in the National Society?)
Point of contact at supporting partner:
(Who will be the contact person in the supporting National Society/partner?)
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Proposal TemplateCommunity Health / CBHFA
Cover page (1 page) Includes project name, project duration, partners and a photo
Summary table (1 page, similar to the concept paper)
Table of contents (1 page, table)
Abbreviations (1 page, table)
1. Executive summary (1-2 pages) Summarize the entire project. Explain why the project is necessary, what the problem is, who the people affected are and how the project will contribute to the solution. Provide goal and outcomes, a summary of key activities and required resources (human, financial and other). Describe how the project will be monitored and evaluated. Briefly outline the capacity of the national society to implement the project.
2. Background, assessment, finding (2-4 pages) Briefly describe the region/district including population, economic, socio-political, security etc. where the project will be carried out. Outline the main needs, capacities and resources of the target population and the approach used for the assessment. Summarize the nature of the problem; identify the causes of these problems and potential effects or consequences if not addressed.
3. Overview of target area and beneficiary population (1 page) Briefly describe the location of the proposed project and explain why and how this area was chosen. Describe the target population and why they are targeted. Include beneficiary estimates broken down by gender where available. Describe what kind of consultation with or participation of the target population occurred.
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
4. Project objectives (3 pages)
Explain why the goal, outcomes and outputs have been chosen to be tackled by the project. The reasoning should be linked to the needs assessment, situation and problem analysis. Include consultation with or participation of the population if this occurred. Include the project logframe in the annex.
5. HNS and partner(s) roles and responsibilities (2 pages) Describe HNS and partners roles
and responsibilities, the project team, i.e. staff, volunteers, etc.
6. Monitoring, evaluation and reporting (2-3 pages) Outline the main approaches to the
monitoring and evaluation of the project. The M&E plan should outline how data from monitoring and evaluation will be collected, analysed and reported. Follow the six steps to M&E planning described in the in “IFRC Project/programme monitoring and evaluation (M&E) guide” and use the M&E plan template in this toolkit.
7. Capacity Building ( 1/2 page) Describe how this project will contribute to building HNS capacity and any key
capacity building activities necessary to support the implementation of the project.
8. Sustainability (1 page) Describe how key activities will continue after project funding ends OR describe how the
impact of the project will continue after key funding and critical activities end.
9. Coordination/Partnership (1 page) Outline who the different partners are, who reports to who, and
what is the role of each party. Briefly describe how coordination among the various local and international humanitarian / government organizations working in the area will be carried out.
10. Cross-Cutting issues (1 page) e.g. Gender Equity, Accountability to Beneficiaries...
11. Plan of action overview ( 1/2 page)
12. Budget overview ( 1/2 page) Appendices
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
INDICATORS Programme area1 CBHFA General indicators 2 CBHFA Technical indicators 2.1 Basic first aid and injury prevention (Module 4) 2.2 Community mobilisation in major emergencies (Module 5) 2.3 Family planning (Module 6, topic 2) 2.4 Safe motherhood (Module 6, topic 3) 2.4 Care of a newborn (Module 6, topic 4) 2.6 Nutrition (Module 6, topic 5) 2.7 Immunization and vaccination campaigns ( Module 6, topic 6) 2.8 Safe water, hygiene and sanitation (Module 6, topic 7)…2.19 Noncummunicable diseases (Module 8) 2.20 Violence prevention (Module 9)
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Indicator guide
12. # community members who received basic first aid during last year from a volunteer trained in basic first aid.
Basic First Aid is any action according to National Society Basic First Aid Manual or National standards for Basic First Aid. Numerator: Number of people provided any type of basic first aid by trained volunteers during the last year.
CBHFA household survey: Question FA8 with frequency of at least baseline and endline and then possibly other times according to project schedule.
Qualitative methods: Can supplement or replace household survey depending on project capacity. Methods include key informant interviews, community focus group discussions.
Project monitoring/reporting system and/or volunteer report form for activities, project event forms, etc.
Technical indicators
2.1 Basic first aid and injury prevention
Indicator Definition Data collection methods/sources
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
56. % households that report children under 5 years of age slept under an insecticide-treated mosquito net the night prior to the survey. MDG 6.7
Definition: An insecticide-treated mosquito net, or bednet, is a net that has been treated with insecticide within the previous 12 months or has been permanently treated. Numerator: Number of children under 5 years of age who slept under insecticide-treated mosquito net the night prior to the survey. Denominator: All children under 5 years of age covered during survey.
CBHFA household survey: Questions ML6, ML7 with frequency of at least baseline and endline and then possibly other times according to project schedule.
Qualitative methods: Can supplement or replace household survey depending on project capacity. Methods include key informant interviews, community focus group discussions.
Indicator Definition Data collection methods/sources
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
2. Monitoring tools
Volunteer record book Volunteer’s home visit guide Supportive supervision checklist Community health committee visit
and community satisfaction checklist
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Volunteer record book
ActivitiesFrom last
page
Date Date Date
Total
Home visits:How many households have I visited today?
Group meeting:How many group meetings have I conducted today?
First aid:I have provided first aid to ____ people today.
M:F:
M:F:
M:F:
M:F:
M:F:
Referral:I have referred ______ people to the health facility.
M:F:
M:F:
M:F:
M:F:
M:F:
IEC material:I have distributed IEC material to ______ people.
M:F:
M:F:
M:F:
M:F:
M:F:
People reached:How many NEW people have I reached today?
M:F:
M:F:
M:F:
M:F:
M:F:
Time:I have worked for approximately _____hours today
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Core principles of good messagesPrincipios clave para buenos mensajes
Communicate a benefit Comunicar un beneficio
Keep it simple Mensaje sencilloCall to action Invitando a la acción
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Volunteer record book continued
Topics I discussed during household visits and in group meetings:_________________________________________________________________________________________________________I talked to the community about adopting a healthy behavior :___________________________________________________________________________________________________________Who I talked to in the community:__________________________________________________________________________________________________________________________________How I provided support to the community: _______________________________________________________________________________Messages I communicated in the community: _______________________________________________________________________________Topics I discussed when distributing IEC material: _______________________________________________________________________________I need support for: __________________________________________________________________________________________
Great
Nothing special
Things can be improved
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Supportive supervision checklist
Observation Good Average Poor
Activity organized as planned
Comment:
Participants as per expected level
Comment:
Key message delivered correctly
Comment: Volunteer participation
Comment:
Volunteer motivation level
Comment:
Community involvement
Comment:
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
3. Evaluation tools
Survey questionnaire/ Cuestionario Data entry for baseline/endline
questionnaire /Entrada de datos para el cuestionario de linea de base/fin
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
4. Reporting tools
Community level monthly report Community progress report –
reporting back to the community Branch monthly report Indicator Tracking Table
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC
Community Level Monthly Report
Activity 1 Activity 2 Activity 3 Activity 4Date Activity
Objective
Number of participants
Male Female Male Female Male Female Male Female
Additional remarks:Venue
Methods used
Questions raised
Discussions
www.ifrc.orgSaving lives, changing minds.
CBHFA SPAC