www.ifrc.org saving lives, changing minds. cbhfa spac cbhfa pmer update actualización de pmer en...

42
www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

Upload: beryl-oneal

Post on 17-Dec-2015

225 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CBHFA SPAC

CBHFA PMER updateActualización de PMER en

SPAC

November/Noviembre 2013

Page 2: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

?

What is PMER? What is PMER tool kit? Why?

¿Qué es PMER? ¿Qué es el kit de herramientas PMER? ¿Por qué?

Page 3: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

PMER

Objectives of this sessionto inform about the PMER toolkit update

process and the updated toolsto have an overview of the toolsto share from evaluations done in Americato analyse situation/needs in PMER and …To define next steps (traducción al español?)

Page 4: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CBHFA PMER Toolkit

October 2009: CBHFA M&E

workshop

October 2010:AP CBHFA

workshop - Lessons learnt

and M&E

2010: Tools developed

(consultant)Pilot testing the

tools

January 2011:

Launch of toolkit

Page 5: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CBHFA PMER Toolkit

2011-2012:

Using tools in programming

October 2013:

Update finalized

November 18-21, 2013:

CBHFA workshopPanamá

May-July 2013:

Desk review of reports; conducting

interviews, feed-back through

questionnaires

Page 6: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

PMER

Erase una vez en América

Once upon a time in América

Page 7: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Process

Desk review (7 reports from Global/Regional meetings; comments/feed-back received)

Questionnaire (35 completed from NS, IFRC staff/31 using the toolkit)

Interviews (16 interviews with NS CBHFA focal persons, IFRC staff)

Page 8: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Most and least important tools (N=31)

Herramientas más/menos importantes

Tool: Most Least

PMER Toolkit Overview 1 Planning tools/templates: 4 1 Concept paper template 3 62 Proposal template 1 33 Log frame template 11 14 CBHFA Indicator guide 15 5 M&E plan template 6 16 Plan of action template 3 1Monitoring tools/templates: 4 7 Volunteer record book 7 28 Volunteer’s home visits guide 2 29 Supportive supervision checklist 1 210 Community Health Committee visit

and community satisfaction checklist

1 3

Tool: Most Least

Evaluation tools/templates:

11 Case study guidelines 1 6

12 CBHFA survey (baseline-endline) guide

6 4

13 Survey questionnaire 5 1

Reporting tools/templates: 2

14 Community level monthly report

1

15 Community progress report – reporting back to community

1

16 Branch monthly report 3 1

17 Indicator Tracking Table 5 4

No answer 2 10

Page 9: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

PMER toolkit overviewHerramientas de PMER (n=29)

Very useful

Useful Not so useful

Useless0

2

4

6

8

10

12

14

16

Usefulness / Utilidad Layout / Diseño

Very clear

Clear Not so clear

Unclear 02468

1012141618

Page 10: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Indicator guideGuia de Indicadores (n=30)

0

5

10

15

20

Usefulness Utilidad Language/writing Lenguaje/Escritura

02468

1012141618

Page 11: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Indicator guide (n=30)

Guia de Indicadores

Layout Diseño

Very clear

Clear Not so clear Unclear No answer02468

101214161820

Page 12: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Volunteer record book (n=22)

Libro de registro del voluntarioUsefulness Utilidad Language/writing Lenguaje/escritura

Very use

ful

Useful

Not so use

ful

Useless

No answer

0

2

4

6

8

10

12

0

2

4

6

8

10

12

14

Page 13: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

LogframeMatriz (n=31)

Very useful

45%Useful39%

Not so useful

6%

No answer

10%

Usefulness

Very easy to understand

23%

Easy to understand

58%

Not so easy to understand

10%

No answer 10%

Language/Writing

Page 14: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Baseline/endline questionnaire (n=28)Cuestionario de línea de base/final

Very useful

Useful

Not so useful

Useless

No answer

0 2 4 6 8 10 12 14 16

Usefulness Utilidad

Page 15: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Baseline/endline questionnaireCuestionario de línea de base/final

Language/writing Lenguaje/ escritura

Very easy to understand

Easy to understand

Not so easy to understand

Hard to understand

No answer

0 5 10 15 20 25

Page 16: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

?????????

How do you PMER in your national societies?

Como PMER ustedes en sus sociedades nacionales?

Page 17: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Page 18: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CBHFA PMER KIT OVERVIEWKIT DE PMER: VISION GENERAL

What: basics of setting up and using a monitoring and evaluation system for CBHFA programmes. Clarifies what monitoring and evaluation are How you plan to do M&E, design a system that

helps you monitor and an evaluation process Helps in selecting appropriate indicators for various

CBHFA topics and tools to measure them. Why: Help CBHFA managers to effectively plan,

implement and report community health programmes.

Page 19: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CBHFA PMER KIT OVERVIEW

Who: This toolkit should be useful to anyone working in CBHFA, who is concerned about the efficiency, effectiveness and impact of the work of the programme

When: CBHFA programmes MOMENTS in planning and designing in preparing logframes in selecting appropriate indicators in setting up monitoring and reporting systems in evaluation (baseline and endline).

Page 20: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Table of contents 1

0. CBHFA PMER Toolkit Overview 1. Planning tools/templates

1.1 CONCEPT PAPER Template 1.2 Proposal Template 1.3 Logical framework (logframe) template 1.4 CBHFA Indicator Guide 1.5 M&E Plan template 1.6 Plan of action template

Page 21: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Table of contents 2

2. Monitoring tools/templates:

2.1 A RECORD BOOK FOR COMMUNITY VOLUNTEERS

2.2 Home visit guide 2.3 Supportive Supervision checklist 2.4 Community health committee visit and

community satisfaction checklist

Page 22: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Table of contents 3

3. Evaluation tools/templates 66 3.1 BASELINE / ENDLINE SURVEY

QUESTIONNAIRE 3.2 Survey data entry

4. Reporting tools/templates 4.1 Community Level Monthly Report 4.2 Community Progress Report – CBHFA 4.3 Branch Monthly CBHFA Report 4.4 Indicator tracking table (ITT)

Page 23: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Overall changes / Cambios 1

All tools in “one book”/ Todas herramientas en “un manual”

In collaboration with PED / Colaboración con PED

Streamlined with other IFRC PMER tools/ racionalizado con otras herramientas de PMER de FICR

Corrections; consistency / Correcciones; consistencia

Language simplified /Simplificación de lenguaje

Page 24: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Changes / Cambios 2

Repeated information and annexes removed/ Eliminados anexos e información repetida

Links to tools and reference material inserted/ Enlaces a herram. y material de referencia

Case study guide and survey guide/Guia de estudios de caso y guia de encuestas

Tool for data entry for baseline-endline questionnaire added/ Herram. para entrada de datos del cuestionario de linea de base/

Page 25: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Changes /Cambios 3

Overview: the “boxes” containing the “what, who,

where, when” kept most of the accompanying text moved to

respective section and/or toola link to the respective tool inserted next to

each “box” links to IFRC reference material inserted

Page 26: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Page 27: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

1. Planning tools and templates

Concept paper template Proposal template Logframe template Indicator guide M&E plan template Plan of action template

Page 28: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

CONCEPT PAPER TemplateCommunity Health / CBHFA

Reference #: Date: Project name: (What is the project name?)

Project start & end dates:

Implementing partner (HNS): (Name of the national society that will implement the project?)

Supporting partner (IFRC/PNS): (Which partner(s) will be providing support to the project?)

Project objectives: Goal: (What do you hope to achieve -the long-term results?)

Outcomes: (Which are the primary results in terms of the knowledge, attitudes or practices of the target group the project seeks to achieve?)

Target group(s): (Who will be the target population and why?)

Location (branch/district)

(Where will the project be implemented and which branch will be involved?)

# of communities: (In how many communities will the project be implemented?)

Estimated # of households: (How many households will be involved?)

Estimated # of beneficiaries: Total #: Female #: Male #:

Estimated total budget: (How much will the total budget be that is required to implement the project?)

Resources needed: (What resources will be needed besides money?)

HNS role: (What is the role of the National Society in this project?)

Supporting partner role: (What is the role of the supporting partner?)

Point of contact at HNS: (Who will be the contact person in the National Society?)

Point of contact at supporting partner:

(Who will be the contact person in the supporting National Society/partner?)

Page 29: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Proposal TemplateCommunity Health / CBHFA

Cover page (1 page) Includes project name, project duration, partners and a photo

Summary table (1 page, similar to the concept paper)

Table of contents (1 page, table)

Abbreviations (1 page, table)

1. Executive summary (1-2 pages) Summarize the entire project. Explain why the project is necessary, what the problem is, who the people affected are and how the project will contribute to the solution. Provide goal and outcomes, a summary of key activities and required resources (human, financial and other). Describe how the project will be monitored and evaluated. Briefly outline the capacity of the national society to implement the project.

2. Background, assessment, finding (2-4 pages) Briefly describe the region/district including population, economic, socio-political, security etc. where the project will be carried out. Outline the main needs, capacities and resources of the target population and the approach used for the assessment. Summarize the nature of the problem; identify the causes of these problems and potential effects or consequences if not addressed.

3. Overview of target area and beneficiary population (1 page) Briefly describe the location of the proposed project and explain why and how this area was chosen. Describe the target population and why they are targeted. Include beneficiary estimates broken down by gender where available. Describe what kind of consultation with or participation of the target population occurred.

Page 30: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

4. Project objectives (3 pages)

Explain why the goal, outcomes and outputs have been chosen to be tackled by the project. The reasoning should be linked to the needs assessment, situation and problem analysis. Include consultation with or participation of the population if this occurred. Include the project logframe in the annex.

5. HNS and partner(s) roles and responsibilities (2 pages) Describe HNS and partners roles

and responsibilities, the project team, i.e. staff, volunteers, etc.

6. Monitoring, evaluation and reporting (2-3 pages) Outline the main approaches to the

monitoring and evaluation of the project. The M&E plan should outline how data from monitoring and evaluation will be collected, analysed and reported. Follow the six steps to M&E planning described in the in “IFRC Project/programme monitoring and evaluation (M&E) guide” and use the M&E plan template in this toolkit.

7. Capacity Building ( 1/2 page) Describe how this project will contribute to building HNS capacity and any key

capacity building activities necessary to support the implementation of the project.

8. Sustainability (1 page) Describe how key activities will continue after project funding ends OR describe how the

impact of the project will continue after key funding and critical activities end.

9. Coordination/Partnership (1 page) Outline who the different partners are, who reports to who, and

what is the role of each party. Briefly describe how coordination among the various local and international humanitarian / government organizations working in the area will be carried out.

10. Cross-Cutting issues (1 page) e.g. Gender Equity, Accountability to Beneficiaries...

11. Plan of action overview ( 1/2 page)

12. Budget overview ( 1/2 page) Appendices

Page 31: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

INDICATORS Programme area1 CBHFA General indicators 2 CBHFA Technical indicators 2.1 Basic first aid and injury prevention (Module 4) 2.2 Community mobilisation in major emergencies (Module 5) 2.3 Family planning (Module 6, topic 2) 2.4 Safe motherhood (Module 6, topic 3) 2.4 Care of a newborn (Module 6, topic 4) 2.6 Nutrition (Module 6, topic 5) 2.7 Immunization and vaccination campaigns ( Module 6, topic 6) 2.8 Safe water, hygiene and sanitation (Module 6, topic 7)…2.19 Noncummunicable diseases (Module 8) 2.20 Violence prevention (Module 9)

Page 32: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Indicator guide

12. # community members who received basic first aid during last year from a volunteer trained in basic first aid.

Basic First Aid is any action according to National Society Basic First Aid Manual or National standards for Basic First Aid. Numerator: Number of people provided any type of basic first aid by trained volunteers during the last year.

CBHFA household survey: Question FA8 with frequency of at least baseline and endline and then possibly other times according to project schedule.

Qualitative methods: Can supplement or replace household survey depending on project capacity. Methods include key informant interviews, community focus group discussions.

Project monitoring/reporting system and/or volunteer report form for activities, project event forms, etc.

Technical indicators

2.1 Basic first aid and injury prevention

Indicator Definition Data collection methods/sources

Page 33: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

56. % households that report children under 5 years of age slept under an insecticide-treated mosquito net the night prior to the survey. MDG 6.7

Definition: An insecticide-treated mosquito net, or bednet, is a net that has been treated with insecticide within the previous 12 months or has been permanently treated. Numerator: Number of children under 5 years of age who slept under insecticide-treated mosquito net the night prior to the survey. Denominator: All children under 5 years of age covered during survey.

CBHFA household survey: Questions ML6, ML7 with frequency of at least baseline and endline and then possibly other times according to project schedule.

Qualitative methods: Can supplement or replace household survey depending on project capacity. Methods include key informant interviews, community focus group discussions.

Indicator Definition Data collection methods/sources

Page 34: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

2. Monitoring tools

Volunteer record book Volunteer’s home visit guide Supportive supervision checklist Community health committee visit

and community satisfaction checklist

Page 35: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Volunteer record book

ActivitiesFrom last

page

Date Date Date

Total

Home visits:How many households have I visited today?

Group meeting:How many group meetings have I conducted today?

First aid:I have provided first aid to ____ people today.

M:F:

M:F:

M:F:

M:F:

M:F:

Referral:I have referred ______ people to the health facility.

M:F:

M:F:

M:F:

M:F:

M:F:

IEC material:I have distributed IEC material to ______ people.

M:F:

M:F:

M:F:

M:F:

M:F:

People reached:How many NEW people have I reached today?

M:F:

M:F:

M:F:

M:F:

M:F:

Time:I have worked for approximately _____hours today

Page 36: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Core principles of good messagesPrincipios clave para buenos mensajes

Communicate a benefit Comunicar un beneficio

Keep it simple Mensaje sencilloCall to action Invitando a la acción

Page 37: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Volunteer record book continued

Topics I discussed during household visits and in group meetings:_________________________________________________________________________________________________________I talked to the community about adopting a healthy behavior :___________________________________________________________________________________________________________Who I talked to in the community:__________________________________________________________________________________________________________________________________How I provided support to the community: _______________________________________________________________________________Messages I communicated in the community: _______________________________________________________________________________Topics I discussed when distributing IEC material: _______________________________________________________________________________I need support for: __________________________________________________________________________________________

Great

Nothing special

Things can be improved

Page 38: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Supportive supervision checklist

Observation Good Average Poor

Activity organized as planned      

Comment:

Participants as per expected level

     

Comment: 

Key message delivered correctly

     

Comment: Volunteer participation      

Comment: 

Volunteer motivation level      

Comment: 

Community involvement      

Comment: 

Page 39: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

3. Evaluation tools

Survey questionnaire/ Cuestionario Data entry for baseline/endline

questionnaire /Entrada de datos para el cuestionario de linea de base/fin

Page 40: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

4. Reporting tools

Community level monthly report Community progress report –

reporting back to the community Branch monthly report Indicator Tracking Table

Page 41: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC

Community Level Monthly Report

Activity 1 Activity 2 Activity 3 Activity 4Date Activity

Objective

Number of participants

Male Female Male Female Male Female Male Female

Additional remarks:Venue

Methods used

Questions raised

Discussions

Page 42: Www.ifrc.org Saving lives, changing minds. CBHFA SPAC CBHFA PMER update Actualización de PMER en SPAC November/Noviembre 2013

www.ifrc.orgSaving lives, changing minds.

CBHFA SPAC