Transcript

If You Evaluate It, They Will Fund:

Program Evaluation Essentials

Cecilia Harry

Special Thanks To Our Sponsors

A Proud Sponsor of NonprofitWebinars.com

Helping ordinary people raise extraordinary amounts for nonprofits is all we do, and we love it.

Today’s Speaker

Hosting:

Sam Frank, Synthesis Partnership

Cecilia Harry Economic Development Coordinator,

Leavenworth County Development Corporation

Assisting with chat questions: April Hunt, Nonprofit Webinars

If You Evaluate It, They Will FundProgram Evaluation Essentials

Cecilia Zappa Harry, MSW

Key Points

• Program evaluation is a necessary step in program development to ensure quality programing and to maximize funding opportunities.

• There are hidden benefits to incorporating program evaluation into your program, and can help you evaluate much more than just the outcomes of your program.

What you will learn

• Why program evaluation is worth the effort

• What makes a strong program

• How to use a logic model

• Types of evaluations techniques

What you will NOT learn

• What makes your program strong or less strong

• What evaluation techniques are best for your programming

• How to conduct different evaluation techniques

Why Include Program Evaluation?• Stronger programming

• Better grant proposals

– More funding opportunities

• More feedback for even stronger programming

• Even more funding opportunities

Other Reasons for Program Evaluation• Required

• Efficacy of new interventions

• Accountability

What Makes a Strong Program?

What Makes a Strong Program?

• Evidence-based foundation

• Adequate staffing

• Appropriate budget

• Stable funding

• Clear service philosophy - identity

• Ongoing or finite presence

• Conceptual/theoretical foundation

• Empirical evaluation of services

The Logic Model

Resources

Inputs

ActivitiesOutputs

Client Outcomes

The Logic Model

Resources Activities OutputsShort-Term

Outcomes

Impact/Long-

Term Outcomes

(Goals Revisited)

What is needed to

accomplish the

activities?

What needs to be

done to accomplish

objective(s)?

What

events/products

can we record or

count to monitor

our activities?

What changes do

we expect to see in

the short-term?

What changes do

we expect to

eventually see in

the long-term?

• Staff• Materials• Client

population

• Classes• Counseling• Programming

• Attendance• Surveys• Level of

interaction• Occurrences of

improved activity

• Increasedknowledge

• Changed patterns of behavior

• Self-reports

• Longer-termdemonstrations of short-term outcomes

• Will look similar to goals/ objectives

DISCLAIMER• The logic model IS NOT a form of evaluation

• The logic model IS a framework to help shape programming and ensure evaluation is considered

– Spells out assumptions

– “If ______, then _____.”

Limitations• Representation, not reality

• Focus is on expectations

• Cause/effect relationship uncertain

• Won’t know if it’s successful until you try

The Logic Model

Resources Activities OutputsShort-Term

Outcomes

Impact/Long-

Term Outcomes

(Goals Revisited)

What is needed to

accomplish the

activities?

What needs to be

done to accomplish

objective(s)?

What

events/products

can we record or

count to monitor

our activities?

What changes to

we expect to see in

the short-term?

What changes do

we expect to

eventually see in

the long-term?

• Staff• Materials• Client

population

• Classes• Counseling• Programming

• Attendance• Surveys• Level of

interaction• Occurrences of

improved activity

• Increasedknowledge

• Changed patterns of behavior

• Self-reports

• Longer-termdemonstrations of short-term outcomes

• Will look similar to goals/ objectives

EVALUATION

EVALUATION

Evaluation Types• Needs assessment

• Qualitative

• Quantitative

• Mixed methods (Qualitative & Quantitative)

• Formative/process evaluation

• Client satisfaction

• Cost-effectiveness/analysis

Ethical Considerations• Participants must be volunteers

• Disclosure of risks/discomforts to participants

• Do no harm

• Protection of sensitive information

Vulnerable Populations• Children

• Mental Capacity Considerations

• Prisoners

Again, Why Program Evaluation?• Funding applications

• Ongoing evaluation

• Funding reports

• Membership fundraising

• New funding opportunities

• Board reports

• Mission drift prevention & strategic planning

• Multiple goals with multiple objectives

• Who is the client? You decide!

Resources

• Program Evaluation: An Introduction by Royse, Thyer & Padget, 5th Edition, 2010

• University of Wisconsin Extension– http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html

• W.K. Kellogg Foundation Logic Model Development Guide – http://www.wkkf.org/knowledge-center/resources/2006/02/WK-

Kellogg-Foundation-Logic-Model-Development-Guide.aspx

Questions? Comments?

• Webinar feedback

• Cecilia Zappa Harry, MSW

[email protected]

– http://about.me/ceciliaharry

– Twitter: @cecilia_harry

Find the listings for our current season of webinarsand register at

NonprofitWebinars.com

Chris [email protected]

707-812-1234

Special Thanks To Our Sponsors


Top Related