food and nutrition surveillance and response in emergency session 24 monitoring and evaluation (...

28
Food and Nutrition Food and Nutrition Surveillance and Surveillance and Response in Emergency Response in Emergency Session 24 Session 24 MONITORING AND EVALUATION MONITORING AND EVALUATION ( ( Nutrition Programmes During emergency Nutrition Programmes During emergency Situation) Situation)

Upload: clare-allison

Post on 22-Dec-2015

219 views

Category:

Documents


5 download

TRANSCRIPT

Food and Nutrition Food and Nutrition Surveillance and Response in Surveillance and Response in

EmergencyEmergency

Session 24Session 24

MONITORING AND EVALUATIONMONITORING AND EVALUATION( ( Nutrition Programmes During emergency Situation)Nutrition Programmes During emergency Situation)

The purpose of covering the topicTo equip learners with the knowledge that can can enable them to:

• Design an M&E system for a nutrition Programme

• Conduct M&E• Effectively use a M&E data base to monitor

progress in Programme implementation

M&E cont.M&E cont.

• The M&E session covers the following areas:– Purpose of M&E in programming.– Components of an M&E plan /framework for

a nutrition Programme– Conducting M&E activities– M&E indicators– Evaluation of nutrition programmes in

emergency situations

Monitoring and EvaluationMonitoring and Evaluation

• Monitoring: what is it?It is the ongoing collection and review of information on project implementation,

coverage and utilization that is reported and acted on, on on-going basis.

M&E contM&E cont..

• Why do monitoring?– To improve intervention programmes by identifying

aspects that are working as planned and those that need correction.

– To modify Programme as per identified need.

– To ensure that all needy cases are reached:General food ration reaches all targeted personsBy maximising on inclusion of deserving cases

and exclusion of undeserving cases in special targeting I.e severely malnourished

– To track ( and demonstrate) results at the program or population level.

Monitoring cont.Monitoring cont.

• Thus monitoring is used to determine how well a Programme is being implemented– At different levels– At what cost– Also tracks the changes occurring due to

interventions being implemented(positive or negative

M&E contM&E cont

Evaluation: What is it?• A process of data collection designed to assess

the effectiveness of the project in attaining its

originally stated objectives and the extent to which observed changes are attributable to the project.

• Done at the end of the project but could be planned at strategic periods during during the life of the projects;inform of reviews e.g. mid- term reviews, or biennial reviews.Evaluation can use rigorous study designs e.g., experimental design or quasi-experimental-involving control groups.

M&EM&E

• M&E happens only after the decision to implement a certain intervention has been made

• Both monitoring and evaluation need– clearly stated goals– clearly stated objectives.

Components of M&EComponents of M&E

• Usually four components are considered– Inputs – Processes– Outputs– Outcomes

ComponentsComponents

• Inputs are the set of resources dedicated to a Programme:• They include human and financial resources, physical facilities, equipment and operational policies that enable services to be delivered,I.e.,

– Personnel– Facilities– Space: storage, room for admitting children onTFP, for

conducting SFP and space for guardians.– Equipment– Supplies

ComponentsComponents

• Process refers to the set of activities in which Programme inputs are utilized in pursuit of the results from the Programme

• process refer to multiple activities that are carried out to achieve the objectives of the projects– Service delivery operations (food distribution)– Management oriented activities– Training, IES, research, etc.

ComponentsComponents

• Outputs are the results obtained at the Programme level through execution of activities using its resources (inputs):

Outputs cont.Outputs cont.

• Outputs– Could be staff performing better as a result of

having been trained– As a result of clear policy environment– Staff better informed about policies- better in

taking decisions.

ComponentsComponents

• Outputs classified into three levels:

• Functional outputs: number of nutrition IEC talks, food preparation demonstration, people trained

• Service outputs:e.g, number benefiting/accessing TFP,SFP, quality of service, acceptability/ image

• Service utilization: number using the service(collecting rations, visiting ANC clinics for supplements)

OutcomesOutcomes

• Outcome: the set of results expected to occur at the population level due to Programme activities and generation of Programme outputs. The intermediate effects are often behavioral and result directly from project outputs. They may be necessary to achieve a desired impact.

Outcomes cont.Outcomes cont.

• Outcomes may be divided into two components:Intermediate outcomes and long-term outcomes.

• Immediate outcomes:are set of results at the population level that are closely and clearly linked to the Programme activities.

• Long-term outcomes: refer to set of results at the population level that are long- term in nature and are produced through action of immediate outcomes.

Outcomes cont.Outcomes cont.

• There is generally a considerable time lag 5-10 years between inception and change in long range outcomes.Good health, reduced mortality rates.

ComponentsComponents

• Outcomes- two levels• Intermediate outcomes

Occur at population level and are closely associated with Programme inputs(drop in prevalence of severe cases of malnutrition, anemia).

• Long range outcomesRefer to results at population level that are long term in nature and come through action of intermediate outcomes (drop in overall prevalence of malnutrition, deaths, better health)

Outcomes cont.Outcomes cont.

• Six key outcomes for nutrition– Exclusive breastfeeding– Appropriate complementary feeding,– Adequate iron intake– Adequate vitamin A intake– Adequate iodine intake– Adequate nutritional care during illness and

severe malnutrition

Elements of M&EElements of M&E

Indicators• Indicators are variables that measure the

different aspects of a given Programme. – The inputs, processes, outputs and outcomes.

• An indicator can be assigned a numeric value, a percentage, a mean value, a ranking, an absolute number of yes/ no score e.g., presence verses absence.

Indicators contIndicators cont

• Selection of indicatorsIndicators must be selected to provide evidence that defines the extent to which project interventions are successful in achieving the set objectives.

Indicators cont.Indicators cont.

Criteria for selection of indicators• Validity: It measures what it is intended to• Sensitivity: its changes reflect desired changes• Reliable: It produces the same results when repeated• Uni-dimensional: it measures only one phenomenon• Operational: it is measurable• Objective: it is not subject to Measurer’s biases• Practical: its data collection is reasonably feasible• Comparability (from time to time/ place to place)

Policy environment (indicators)Policy environment (indicators)

• Existence of a policy development plan• Number of appropriately disseminated policy

analysis• Number of policy awareness raising events

targeted at leaders• Quality of Programme leadership• Extent of commercial sector participation

Components of M&E planComponents of M&E plan

• Introduction: The country region and background of what the project is addressing

• Conceptual framework-maps the linkages inputs-processes-outputs-outcomes

M&E plan contM&E plan cont..

• Data types• Mechanisms for M&E

– Data collection methods– Establishing baseline– Data storage/analysis– Management of collection, who collects, when?– Routine review of data– How does evaluation fit in.

M&E plan cont.M&E plan cont.

• Indicators for M&E• Use of data/dissemination to result in regular

adjustments of activities for enhanced effect.

M&E planM&E plan

• Work plan needed to implement the plan• Work plan lists:

– Activities– Time they shall be conducted– Targeted numbers– Milestones e.g. by-after 18 months– Implementation- what is expected in terms of

achievements (objectives)

BibliographyBibliography

• Bertrand J.T. et al (1996). Evaluating FP programs. USAID.• Medicins Sans Frontiers (1995).Registration and

Monitoring/Evaluation of Feeding Programmes, In:Nutrition Guidelines(Nutritional programmes in Emergency Situations).1st Ed.Paris.

• Sphere project (2004). Humanitarian Charter and Minimum Standards in Disaster Response.ISBN 9291390976.

• UNAIDAS(2000).National AIDS Programmes.A Guide to Monitoring and Evaluation.Geneva.

• Veneya and Kaluzny (1984). Evaluation and Decision Making for Health Services Programmes.

• WHO,BASICS and UNICEF (1999).Nutrition Essentials.A Guide for Health Managers.