barbara sims dean fixsen karen blase caryn ward national sisep center national implementation...

Barbara SimsDean FixsenKaren BlaseCaryn Ward

National SISEP CenterNational Implementation Research Network

FPG Child Development CenterUniversity of North Carolina at Chapel Hill

Lake Geneva WI

October 2014

Building Implementation Capacity Innovation and

Implementation Conference II

EBPs

Students cannot benefit from interventions they do not receive.

WHY: Educationally

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

WHYEducationally

Significant Outcomes

WHATEffective

Innovations

WHEREEnabling Contexts

Formula for Success

Students cannot benefit from

instruction they do not

experience

Active Implementation Frameworks

WHO

Teams

WHEN

Stages

HOW

Drivers

HOW

Cycles

WHAT

UsableInterventions

WHY: Educationally

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

USABLE INTERVENTIONS

An intervention needs to be teachable, learnable, doable, and be readily assessed in practice.

UsableInterventions

Usable Interventions

Operational Definitions

ClearDescription

FidelityAssessment

EssentialFunctions

Implications for Sustainability and Scalability

We tend to over-estimate how well defined “it” is We find out when we start to Install

“it”

Help Schools and Districts choose wisely based on: Needs of students Best evidence Fit and Resources Required Readiness and resources for

replication

Usable Interventions

Implications for Sustainability and Scalability

Help Schools and Districts “operationalize” the WHAT Practice Profiles

Help Schools and Districts “make space” for the new work Supportive policies and practices

Usable Interventions

Usable InterventionsTools You Can UseHexagon Tool Practice Profiles

UsableInterventions

Try It Now! Usable Interventions

Select 3-5 Indicators

Consider the following factors:What will it look like if this indicator is being implemented with fidelity?What is an acceptable variation of this in early stages of implementation?Identify any red flags that indicate unacceptable variations

SupportingNew Ways of Work

WHY: Educationally

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

IMPLEMENTATION TEAMS

Organized, expert assistance to develop and sustain an accountable and effective structure

Implementation TeamNo Implementation Team

80%3 Years

14%17

Years

To “Making it Happen”From “Letting it Happen”

Sources: Fixsen, Blase, Timbers, & Wolf, 2001Balas & Boren, 2000 Green & Seifert, 2005Saldana & Chamberlain, 2012

Improvement inIntervention Outcomes

Implications for Sustainability and Scalability

Teaming Structure Accountable Implementation Science informed Lasting – Key to Sustainability Linked – Key to Scalability

Why Individual champions come and go Structures host functions Intentional use of data,

improvement cycles

Implementation Teams

WHY: Socially

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

IMPLEMENTATION STAGES

Purposeful matching of critical implementation activities to the stage of the process

Implementation Stages

Exploration Installation Initial Implementation

FullImplementation

2-4 Years

• Assess needs• Examine

intervention components

• Consider Implementation Drivers

• Assess Fit• Build

sustainability

• Acquire Resources

• Prepare Organization

• Prepare Implementation Drivers

• Prepare Staff• Build

sustainability

• AdjustImplementation Drivers

• Manage Change• Deploy Data

Systems• Initiate

Improvement Cycles

• Build sustainability

• Monitor & Manage Implementation Drivers

• Achieve Fidelity & Outcome Benchmarks

• Further Improve Fidelity & Outcomes

• Sustainability

Implementation StagesTools You Can UseDistrict Initiative Inventory Stages of Implementation AnalysisImplementation Action Plan

District Initiative Inventory

The HexagonAn EBP Exploration Tool

NEED

FIT

RESOURCES

EVIDENCE

CAPACITY

READINESS

Fit with current Initiatives• School, district , state priorities• Organizational structures

Community values

Need in school, district, state• Academic & socially significant Issues• Parent & community perceptions of need• Data indicating need

Resources and supports for:• Curricula & Classroom• Technology supports (IT dept.)• Staffing• Training• Data Systems• Coaching & Supervision• Administration & system

Evidence• Outcomes – Is it worth it?• Fidelity data• Cost – effectiveness data• Number of studies• Population similarities• Diverse cultural groups• Efficacy or Effectiveness

Capacity to Implement• Staff meet minimum qualifications• Able to sustain Imp Drivers

• Financially • Structurally

• Buy-in process operationalized• Practitioners • Families

Readiness for Replication• Qualified purveyor• Expert or TA available• Mature sites to observe• Several replications• How well is it operationalized?• Are Imp Drivers operationalized?

The “Hexagon” can be used as a planning tool to evaluate evidence-based programs and practices during the Exploration Stage of Implementation.

Download available at:www.scalingup.org/tools-and-resources

EBP:

5 Point Rating Scale:High = 5; Medium = 3; Low = 1.Midpoints can be used and scored as a 2 or 4.

High Med Low

Need

Fit

Resource Availability

Evidence

Readiness for Replication

Capacity to Implement

Total Score

© 2009 Karen Blase, Laurel Kiser, & Melissa Van Dyke Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland

Try It Now! Implementation Stages

Early Implementers: use the Hexagon Tool to assess potential program under consideration

Ongoing Implementation: Use the Stages of Implementation Analysis tool to identify gaps and next steps in your implementation

SupportingNew Ways of Work

IMPROVEMENT CYCLES

Changing on purpose to support the new way of work

Rapid Cycle Problem Solving

Improvement Cycles

Plan

DoStudy

Act

Usability TestingImprovement Cycles

Plan

DoStudy

Act Plan

DoStudy

Act Plan

DoStudy

Act

Implementation Team

DistrictManagement

Team

TeachersInnovations

Students

Su

stai

nab

ilit

y

Pra

ctic

e In

form

s P

olic

yP

olic

y E

na

ble

s

Pra

ctice

Practice-Policy Communication Cycle

IMPLEMENTATION DRIVERS

Common features of successful supports to help make full and effective use of a wide

variety of innovations

Fidelity Assessment

Coaching

Training

Technical

Systems Intervention

Facilitative Administration

Decision Support Data System

Com

pete

ncy

Driv

ers

Com

pete

ncy

Driv

ers

Organization D

rivers

Organization D

rivers

Implementation Drivers

© Fixsen & Blase, 2008Leadership

Selection

Adaptive

Competency Drivers

Develop, improve and sustain competent

and confident use of the innovation through

Careful selection of new and lead staff

Design and employ effective training

plans

Design and support coaching system

Routine use of fidelity assessment to

inform the process

Implementation Drivers

Com

pete

ncy

Driv

ers

WHY: Educationally

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

Organization Drivers

Change Organizations and Systems

Create and sustain hospitable organizational and system environments for effective services

Develop functional data systems that can be used to inform decision-making

Implementation Drivers

Organization D

rivers

Decision Support Data SystemsPurposes Monitor and improve student outcomes through

data-based decisions

Provide information to assess effectiveness of intervention and prevention practices

Analyze the relationship of fidelity to outcomes

Guide further program development Detect discrete issues as well as systemic issues

Engage in continuous quality improvement Of the Intervention and the Drivers

Celebrate success

Be accountable to parents, Board of Education taxpayers, and other funders

Implementation Drivers

Organization D

rivers

Facilitative AdministrationPurposes

Driving change within your direct sphere of influence

Creates an internally hospitable environment for the new way of work – at the level of the “agency” (e.g. school, District)

Facilitates the installation, implementation, and improvement of the Drivers for each innovation

Looks for ways to make the direct work of practitioners (e.g. teachers, school staff) and administrators more effective and less “burdensome”!!

Implementation Drivers

Organization D

rivers

Facilitative Administration Strategies

Schedule changes

Policy revision

Practice revision

Communication protocols

Change responsibilities

Revise priorities

Implementation Drivers

Organization D

rivers

Systems InterventionPurposes Driving change outside your direct sphere of

influence

Identify and “lift up” systemic barriers and facilitators to the next level to improve support for the new way of work

Create an externally “hospitable” environment for the new way of work

Embed facilitators and strengths

Contribute to cumulative learning in multi-site projects

Implementation Drivers

Organization D

rivers

Systems InterventionStrategies Communication protocols

Stakeholder groups

Community involvement

Public communication

Implementation Drivers

Organization D

rivers

Performance Assessment(Fidelity)

Coaching

Training

Technical

Systems Intervention

Facilitative Administration

Decision Support Data System

Com

pete

ncy

Driv

ers

Com

pete

ncy

Driv

ers

Organization D

rivers

Organization D

rivers

Facilitative Administration

Enabling Context

© Fixsen & Blase, 2008Leadership

Selection

Adaptive

Integrated & Compensatory

Implementation DriversTools You Can UseStrategic Analysis of Drivers Drivers Action PlanImplementation Drivers: Implementation Drivers:

Team Review & Planning Best Practices

Implementation Drivers: Team Review & Planning

Create a hospitable system with linked communication and problem-solving protocols to support the effective WHAT

Ensure that practice informs policy, and policy enables better practice

Operationalize success

Prevent the institutionalization of errors

Enabling Context Implications for Sustainability and Scalability

Try It Now! Implementation Drivers

Competency Drivers Consider how the district is

attending to these indicators Consider how your vendors attend

to these indicators

Organization Drivers Identify strategies you will use to

support building staff in implementation of your program

SupportingNew Ways of Work

WHY: Educationally

Significant Outcomes

WHAT: Effective &

Usable Practices and

Programs

WHO & HOW:Effective

Implementation Methods

WHERE:Enabling Contexts

Formula for Success

AI Hub

Get Connected!

www.scalingup.org

SISEP @SISEPcenter

For more on Implementation Sciencehttp://nirn.fpg.unc.edu

www.implementationconference.org

©Copyright Dean Fixsen and Karen Blase

This content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work.  Any of the above conditions can be waived if you get permission from the copyright holder.

http://creativecommons.org/licenses/by-nc-nd/3.0