ellen iverson, mesi graduate assistant director of evaluation at the science education resource...

20
Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties - MESI 2014 - Ellen Iverson

Upload: dominic-floyd

Post on 14-Jan-2016

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Ellen Iverson, MESI Graduate AssistantDirector of Evaluation at the Science Education Resource Center (SERC) at Carleton College

1Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 2: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic ModelTheory of ChangeTheory of ActionProgram Theory

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

2Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 3: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic Model

Theory of Change

Theory of Action

Program Theory

How a given program, project, strategy, or policy is understood to influence or contribute to specific outcomes

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

3Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 4: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic Model A systematic and visual way to show relationships among the resources of a program, project, strategy, or policy as well as the activities and the intended results

Theory of Change

Theory of Action

Program Theory

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

4Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 5: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

http://serc.carleton.edu/cismi/2011_hhmi_prop.html

5Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 6: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

http://serc.carleton.edu/isme/workshop2012/framework.html

6Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 7: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic Model

Theory of Change

How change comes about and what are the central processes/drivers for change in a given program, project, strategy, or policy

Theory of Action

Program Theory

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

7Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 8: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

8Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 9: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

9Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 10: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic Model

Theory of Change

Theory of Action

What the program, project, strategy, or policy does (activities and level of success needed) to influence or contribute to outcomes

Program Theory

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

10Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 11: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Plan program or strategies

*Define scope

*Visualize complexity to anticipate uncertainties

*Facilitate a shared understanding

*Engage stakeholders

*Document perceptions

*Disseminate more broadly

*Identify evaluation opportunities and monitor progress

11Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 12: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Logic Model

Theory of Change

Theory of Action

Program Theory

How a given program, project, strategy, or policy is understood to influence or contribute to specific outcomes

12Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 13: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Articulate “mental models” of key stakeholders

*Analyze via artifacts (documents, reports, forms)

*Infer through observation of program including interviewing staff and participants

Funnell and Rogers, 2011

13Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 14: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Visioning*Describe how you now serve clients?

*What specific improvements have been made?

*What are people saying about the program now?

*What problems have been solved?

*What specific outcomes have been achieved?

*How are people behaving differently?

Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco

14Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 15: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Visioning*Write individual responses

*Compare with partner

*Compare with another partner

*Facilitate discussion

Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco

15Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 16: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Focus Group (Bens, page 22)*Reflective listening

*Getting the right people to the table (even if “virtually”)

*Iterate

*Return and revise

*Disseminate

Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco

16Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 17: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*Snow Cards (Keystone, page 15)

*Brainstorm Pre-Conditions*What change?

*For whom?

*How good?

*By when

Bens, I. (2012). Facilitating with ease! Jossey-Bass: San Francisco

17Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 18: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*What would a simple logic model look like?

*What might a theory of change look like?

*What might the models miss?

*What outside forces might influence the program?

*What might be some unexpected outcomes (positive/negative)

*What questions would you have about the program and program theory?

18Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 19: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

Funnell and Rogers, 2011, W.K. Kellogg Foundation’s Logic Model Development Guide

19Logic Models for Smarties - MESI 2014 - Ellen Iverson

Page 20: Ellen Iverson, MESI Graduate Assistant Director of Evaluation at the Science Education Resource Center (SERC) at Carleton College 1 Logic Models for Smarties

*W.K. Kellogg Foundation’s Logic Model Development Guide

http://www.wkkf.org/resource-directory/resource/2006/02/wk-kellogg-foundation-logic-model-development-guide

Funnell, S. C. & Rogers, P. J. (2011). Purposeful program theory: Effective use of theories of change and logic models. San Francisco, CA: Jossey-Bass.

Keystone. (2009). Developing a Theory of Change from http://www.keystoneaccountability.org/sites/default/files/2%20Developing%20a%20theory%20of%20change.pdf

McLaughlin, John A., & Jordan, Gretchen B. (1999). Logic models: A tool for telling your program’s performance story. Evaluation and Program Planning, 22(1), 65-72.

Milstein, Bobby, & Chapel, Tom. (N.D.). Developing a Logic Model or Theory of Change. The Community Toolbox. Retrieved 12 March 2014, from http://ctb.ku.edu/en/tablecontents/sub_section_main_1877.aspx

20Logic Models for Smarties - MESI 2014 - Ellen Iverson