from data to decision-making: utilizing evaluations … · 2019. 12. 19. · justin lawrence, feed...

34
Photo Credit Goes Here Photo credit: Name/Organization FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS AND REPORTING TO INFORM STRATEGY Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD)

Upload: others

Post on 30-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Photo Credit Goes Here

Photo credit: Name/Organization

FROM DATA TO DECISION-MAKING:

UTILIZING EVALUATIONS AND REPORTING TO INFORM

STRATEGY

Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD)

Page 2: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

AGENDA

Project One: Learning from E

• Challenge

• Approach

• Resilience Findings

• Landscape Changes

Project Two: Learning from M

• Challenge

• Approach

• Resilience Findings

• Landscape Changes

Group Discussion

Page 3: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

How have you observed FFP BFS or other

donor use evaluations? Monitoring data?

(Be brutally honest)

Page 4: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

RESULTS FRAMEWORK

Page 5: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

1) What interventions improve the ability of vulnerable households to withstand (stable consumption and protected assets) common and extreme shocks affecting their economic activities? In what ways?

2) What interventions strengthen the ability of vulnerable households to recover (regain consumption levels and rebuild lost assets) from common and extreme shocks?

3) To what extent do different interventions to promote market access (such as promoting access to markets with lower risks and lower entry barriers) generate the participation of poorer households?

4) What interventions on both the “Push” (social protection) and “Pull” (value chain deepening) sides improve the participation of the poor in value chain activities?

5) Do safety net programs promote greater participation of poorer households in prudent risk taking and more remunerative economic activities?

6) Have interventions changed risk-reduction strategies pursued by men and women to cope with shocks (health-related, agro-climatic, economic, socio-political)?

7) Have FTF strategies to generate overall economic growth improved livelihoods of the poorest and most vulnerable populations? What are the most effective economic growth strategies for incorporating the poor and vulnerable?

Page 6: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:
Page 7: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

CHALLENGE 1

Collecting and Analyzing the Universe of Evaluations

Page 8: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:
Page 9: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

TOOLS

• Used qualitative analysis tool Dedoose

• Similar to NVIVO and other qualitative analysis packages -

coding and analysis functionality

• Collaborative, cloud based and relatively inexpensive

Page 10: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

• Learning Agenda is a matter of independent and dependent

variables. Created distinct codes for each variable

• “To what extent do different interventions to promote market access (such as promoting access to markets with lower risks and lower entry barriers) generate the participation of poorer households?

• Parent and Child Codes. Example:

• Resilience (Parent)

• Safety Nets (Child)

CODING APPROACH

Page 11: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:
Page 12: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

KNOWLEDGE

DRIVEN

FEED THE FUTURE

AGRICULTURAL DEVELOPMENT PROJECT

Page 13: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

FINDINGS

Page 14: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

41 evaluations examined how

productivity interventions

affect resilience. Access to

markets a necessary

component to lead to excess

yields to income.

Photo: David Mutua, USAID

Page 15: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Market access requires

social cooperation,

such as Village

Savings and Loan

Associations (VSLA),

but building social

capital is a necessary

component.

Photo: Gina van Schalkwyk, USAID/SATH

Page 16: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

New stress-tolerant

varieties help farmers

diversify economic stream

in crops unable to be used

before

Photo: Hector Santos

Page 17: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Photo: Umesh Shrestha,

Hariyo Ban Program, CARE Nepal

Page 18: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Training is key to

building trust and

capacity. It is

critical to

participation of the

poor.

Photo: Partner-CRS Credit-AShaw

Page 19: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

A program in Kenya included farmers in value chains and engaged CBOs to increase employment. In this project, the formation of farmer groups into business organizations enabled poor dairy producers to increase their bargaining power. Through the CBO, “more than 1,000 jobs, [were created] 200 of them permanent.”

Page 20: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

CHALLENGE 2

Using Feed the Future Monitoring to inform Feed the Future programs.

Page 21: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:
Page 22: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

1. Project Summary (One short paragraph listing project context, geographic location (for BFS

mechanisms), purpose, scope, key approaches, and goals. Mention the main beneficiaries and key

stakeholders/partners—one option is to modify/update the OP narrative.)

2. FY15 Performance (Discuss significant FY15 results and key FY15 actions. Describe the main

beneficiaries. Why are the results important?)

3. Successes (What were the key resources, actions, or environments that enabled your successes? How

is the IM adapting to capitalize on these successes? How will successes lead to desired outcomes?)

4. Challenges (What posed the greatest obstacles to achieving desired outcomes? These might include

internal challenges (e.g., project management issues) or external challenges (e.g., country context). Please

strive to be honest and thorough in your assessment of challenges, so that other projects might learn from

your experiences.)

6. Description of Expected FY2016 Activities (Only required for BFS IMs. Describe FY16 activities from

the activity work plan, FY16 indicator targets, and relate to project goals.)

Page 23: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

CODING STRUCTURE

Four main “root codes”: interventions

(how), results (what), beneficiaries

(who), factors (why)

Page 24: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

INTERVENTIONS, RESULTS

• Interventions by the Results

Framework, then more child codes

with frequent interventions.

• Results tied to framework and the

more common whole of government

indicators.

• Usage of weighting: success,

inconclusive, challenge.

Page 25: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

BENEFICIARIES, FACTORS

• Beneficiaries key stakeholder types

• Weighted by decimal magnitude

• Factors are reasons that explain

success or set-backs. Can be

country or management.

Page 26: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

“The biggest success that xxx has

achieved in FY 15 is reaching out to

more farmers 14,519) using a more

coordinated extension method, in

which facilitators were placed to

provide farmers with extension

services.”

Page 27: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Capacity Building

Farmers Receiving US Assistance

Increase Yields

Extreme Poor

Extension

Market Development

Drought

Coordination

Smallholder Farmers

Farmers

Page 28: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

Farmers Receiving US Assistance- Success

Extension

Coordination

Farmers- weighted 5

“The biggest success that xxx has achieved in FY 15 is reaching out to more farmers 14,519) using a more coordinated extension method, in which facilitators were placed to provide farmers with extension services.”

Page 29: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

• Policy and Research interventions absent from RF • Low instances of nutrition results as success • Low instances of intervention reaching the vulnerable • Increase opportunities for expanding and strengthening public-private partnerships • Confusion around FTF programming and flexibility • Youth not visible • Integrate nutrition intervention––which is mostly targeted at women––with overall

beneficiaries • Still unclear how FTF country “graduates” Develop more explicit guidance around Mission

engagement in the design phase to improve upon Mission and Central mechanism coordination

• Create resources that better communicate mechanisms available and how each office can strategically contribute to Feed the Future countries

Page 30: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

“This section specifies that it is in the

U.S. national security interest to promote

global food security, resilience, and

nutrition…”

- Global Food Security Act

Page 31: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

RESULTS FRAMEWORK

Page 32: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:
Page 33: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

GROUP DISCUSSION

• What type of information would you like to see from this data set?

(example: What projects have promising models around trade facilitation in

East Africa)?

• What is the most useful way to package this information (briefs, raw excel

data)?

Page 34: FROM DATA TO DECISION-MAKING: UTILIZING EVALUATIONS … · 2019. 12. 19. · Justin Lawrence, Feed the Future Knowledge Driven Agricultural Development (KDAD) AGENDA Project One:

www.feedthefuture.gov