indicator performance tracking table (adapted from fanta ii) m&e capacity strengthening workshop...
TRANSCRIPT
Indicator Performance Tracking Table (adapted from FANTA II)M&E Capacity Strengthening Workshop Addis Ababa4 to 8 June 2012
Arif Rashid, TOPS
What is IPTT?
“The indicator performance tracking table (IPTT) …includes performance indicators (at the impact, outcome and output levels) linked to the food aid program proposal’s objectives, and baseline and target values for each indicator (estimated)”
Source: http://www.usaid.gov/our_work/humanitarian_assistance/ffp/ffpib_09.06.pdf Slide # 1
Slide # 2
Purpose of IPTT
Criteria for reviewing an IPTT to help ensure that it
• helps you to improve your program• helps you to meet your reporting
requirements and • helps you conduct M&E in ways that
are not too costly or burdensome.
Slide # 3
How will you use your IPTT?
Slide # 4
How will you use IPTT? – 15 minutes• Identify two volunteers in your group. • The first volunteer: take a copy of your IPTT and do the
following:• Choose one indicator and explain to your group how you will
use it to report to Food for Peace.• Choose a different indicator and explain how you will use it to
improve your program. • Choose a different indicator and explain how you will use it to
“tell your story” (to tell other organizations, other funders, communities or beneficiaries about your project).
• The second volunteer should repeat the same.
Slide # 5
As a group, please select one section of your IPTT.Then look over each indicator in that section and LABEL
each indicator as helping you to:• Fulfill reporting requirements• Improve your program• Tell your story.• NONE OF THE ABOVE.
JUST LABEL, DON’T MAKE REVISIONS YETPlease take 15 minutes for this exercise.
How will you use IPTT? – 15 minutes
Slide # 6
How will you use IPTT? – 15 minutes
Tell your group members: • One thing that you found out about indicators
or your IPTT that you didn’t know before.• One thing you plan to do differently as a result
of what you’ve learned.
Slide # 7
How are RF and Indicator levels related?
Strategic Objective 1
StrategicObjective 2
Overarching
Goal
Intermediate Result 1.1
Intermediate Result 1.2
Activities:a)b)c)
Activities:a)b)c)
Activities:a)b)c)
Intermediate Result 2.1
Outputs
Processes
Inputs
Medium/ ImmediateOutcome Indicators
Impact Indicators/Higher Outcome Indicators
Slide # 8
Need indicator at every level
Production of non-traditional crops increased
Activities
IR
SO Farm incomes increased
Project trained 50 farmers on non traditional crops, and distributed seeds and fertilizer
Goal
20 Farmers planted the new crop and followed the intercultural practices learned from the project
Slide # 9
Linking Indicators to RF• In small groups take the activity assigned to you
and create 3 indicators to measure the causal chain the activity is part of, one at each level, output, outcome, impact: – Activity 1: Training on proper hand washing
techniques– Activity 2: Training farmers on improved crop
management techniques– Activity 3: Training on crop storage systems
• You have 15 minutes- 5 minutes per indicator! Use the worksheet in the binder
• Be prepared to share your indicators with the rest of the participants
Slide # 10
Develop Indicators at Each Level Activity assigned to your working group:
Level of the Indicator (result)
General Guideline Your Proposed Indicator
Impact (SO level) The change in the condition or situation of the populationMeasures the highest level of change your project is responsible for bringing about
Outcome (IR level) Very often this is a behavior (acting, practicing) or knowledge change, but not always. There are higher and lower level outcomes, i.e. the higher level outcome could be increases in production while a lower level outcome would be the practices that a beneficiary uses.
Output (activity level)
Direct product of the implementer’s activities
Slide # 11
IPTT Checklist Criteria
What to ask yourself when developing or assessing your IPTT
Slide # 12
What jobs can your indicator do?Does each indicator serve at least one of the following purposes: • reporting, • telling your story or • improving your program?
• For example: does it provide other interesting information– i.e. information that indicates whether the food security situation is improving? whether communities and beneficiaries are making progress? how well we are doing in implementing?
Slide # 13
Strategic Objective 1
StrategicObjective 2
Overarching
Goal
Intermediate Result 1.1
Intermediate Result 1.2
Activities:a)b)c)
Activities:a)b)c)
Activities:a)b)c)
Intermediate Result 2.1
Outputs
Processes
Inputs
Medium/ ImmediateOutcome Indicators
Impact Indicators/Higher Outcome Indicators
Does each indicator measure a specific result?
Slide # 14
Which is more precise?1. “% of children malnourished”
OR2. “% of children 6-59 months in the
target population who are underweight (weight-for-age Z score < -2)”
Is each indicator precise and well defined enough to give the reader
a clear idea of what is being measured?
IPTT Checklist Criteria
Slide # 15
IPTT Checklist Criteria Is it FEASIBLE to collect and analyze the data for
each indicator?
Slide # 16
Some suggested questions to ask about each indicator:
• Can you collect its data through either a population-based household survey, annual survey of beneficiaries or from program records?
• Does your program have the expertise, resources and the staff needed to measure this indicator?
• Does it make sense to collect data for this indicator at the time of year you plan to do so (e.g. baseline, annual and final surveys)?
• Can you get a big enough sample size to produce reliable data?
IPTT Checklist Criteria Is it FEASIBLE to collect and analyze the data for
each indicator?
Slide # 17
• An IPTT should not have too MANY or too FEW indicators. A BALANCED set of indicators that captures all three aspects – reporting, telling your story and improving program management is expected.
IPTT Checklist Criteria Is it FEASIBLE to collect and analyze the data for
each indicator?
Slide # 18
IPTT Checklist Criteria Does the IPTT include gender-sensitive
indicators appropriate to your RF?
• Your IPTT should include gender sensitive indicators that: – Go beyond disaggregation by sex and are not just about
women– Are based on the social context and gender relations (i.e. What
role does gender play in the results the MYAP wants to achieve; Do mean and women get equal benefits from the project activities; Who put more labor to carryout activities promoted by the project?
• Examples:– Men’s knowledge about exclusive breastfeeding– Men’s participation in helping woman get to pre-natal visits– Ratio of women’s to men’s use of inputs OR increased yields
Slide # 19
IPTT ChecklistAre indicators numbered clearly? Each indicator should have
a unique identifying number so they are easy to refer to
Is each required indicator labeled as such? Required indicators must be included in the IPTT and it’s helpful if the group requiring the indicator is mentioned, i.e. (Mission), (FFP), (Government)
Is the wording for each indicator neutral? (E.g. “% of children exclusively breastfed until 6 months” NOT “increase in the “% of children exclusively breastfed until 6 months)
PROGRAM GOAL: Reduce Food Insecurity of Vulnerable Populations in Western Province
SO 1: Improved livelihood capacities of vulnerable households
Impact 1.1 Average Household Dietary Diversity Score (FFP)
(+)
Outcome 1.2 Percent of trained beneficiaries scoring 70% or above on post-test scores
(+)
Slide # 20
PROGRAM GOAL: Reduce Food Insecurity of Vulnerable Populations in Western Province
SO 1: Improved livelihood capacities of vulnerable households
Impact 1.1 Average Household Dietary Diversity Score (FFP)
(+)
Outcome 1.2 Percentage of households with access to an improved sanitation facility
(+)
• Are all the targets in the right place (“Annual” vs. “Baseline, Mid-term Evaluation and Final Evaluation”)
IPTT Checklist
Slide # 21
• Can you reasonably expect to reach the target? Is it ambitious enough to make a difference to your beneficiaries?
• Can you justify your targets? For example is the target based on your organization’s past experience with a Title II program or another similar program?
IPTT Checklist CriteriaIs each target reasonable?
Slide # 22
IPTT Checklist
• Are targets clearly defined as cumulative or not?
• Do all targets match their indicator in units? Targets are in same format as the indicator (i.e. indicator says “Number of …” but target says “50%”)
This presentation was made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents are the responsibility of Save the Children and do not necessarily reflect the views of USAID or the United States Government.