ho part 3 support strategies...part 2 tactics & tools for supporting implementation part 3 mss...
TRANSCRIPT
7/25/12
1
3 Dimensions of Effective GO Use
Tactics & tools for Supporting
Implementation
Big Ideas about Supporting Implementation
Leadership Support for MSS Implementation
Casual vs. Fidelity implementation Saboteurs vs. Runners
Why bother?
Part 1
Critical Features
Planning & Teaching Using
GOs
Part 2 Tactics & Tools for
Supporting Implementation
Part 3
MSS Walk-Thru Observation
TM
Makes Sense Strategies Toolkit © Edwin Ellis, PhD (205) 394-‐5512
Assessment
WHY GOs? Leadership
Support Tactics
Frequently communicate value
for MSS;
Create & protect blocks of time for teachers
to work together to plan and dialogue specifically
about using MSS
Frequently ask teachers what they
need to help them use MSS
Collaboratively develop long range vision for
increasing use of MSS
Strive for balance b/w fidelity & flexibility
On-going goal-setting / planning
Teachers using MSS are encouraged, recognized
& reinforced
Inquire about barriers to implementation teachers may be experiencing
Adequate resources PCs – Windows 7+
MACs - OSX
Adobe Reader Microsoft Word
“STEPS” action plans
Assess MSS Implementation
Implementation Survey
Fidelity Matrix
MSS Walk-Thrus
“STEPS” goal setting 7 action planning
A tool for enhancing commitment to fidelity implementation of innovations
STEPS Goal SeCng / AcFon Planning Select something to change / implement
Scale up - How could it look in _____ months?
Project how it can look in _____ months (doable)
Tell it like it is now
Envision the ideal
CYCLE
Target date:
STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Name: Date:
Select something to change / implement
Scale up - How could it look in _____ months?
Project how it can look in _____ months (doable)
Tell it like it is now
Envision the ideal
CYCLE
Target date:
STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20
Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes
Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.
ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.
Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.
2 Oct 10
Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.
6
CYCLE #
1 Select something to change / implement
Scale up - How could it look in _____ months?
Project how it can look in _____ months (doable)
Tell it like it is now
Envision the ideal
CYCLE
Target date:
STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20
Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes
Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.
ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.
Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.
2 Oct 10
Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.
6
1
After 2 month period (or sooner), team enters 2nd CYCLE
2
The team revises vision based on what they learned during the initial cycle
7/25/12
2
Select something to change / implement
Scale up - How could it look in _____ months?
Project how it can look in _____ months (doable)
Tell it like it is now
Envision the ideal
CYCLE
Target date:
STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20
Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes
Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.
ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.
Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.
2 10/20/08
Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.
6
2 New vision reflects…
* Less superficiality
* Greater understanding of implementation nuances
* Increased confidence
Select something to change / implement
Scale up - How could it look in _____ months?
Project how it can look in _____ months (doable)
Tell it like it is now
Envision the ideal
CYCLE
Target date:
STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Oct. 20
Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes
Course of study standards are linked to specific Smart Sheets. We use a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in a range of scaffolded activities & assignments, esp. “Y’all do it” activities. Smart Sheet use is celebrated / reinforced. Students self-select best Smart Sheet for a given task. Smart Sheets are incorporated as assessment tools. We are conducting action research to assess Smart Sheet impact. We are implementing with high levels of fidelity.
All writing assignments (in all classes) will require students to use a Frame GO & PLANS writing strategy. We use same rubric to asses writing. Each of us will continue using Organizers, but also use at least 1 EU or Vocab Smart Sheet in class once per week. Student Smart Sheet work posted on classroom walls & changed frequently.
We share ideas & experiences using Smart Sheets and brainstorm potential Smart Sheets for LA, SS, Science, & Math standards during weekly team meetings The Implementation Matrix is used to guide us, but we’re not using it to collect data.
6
2
2 12/20
SS – 3 MI Frame GO once wk for guided note-taking / Science – Frame GO or Cause/Effect occasionally / Math - none / L.A. – Frame GO & PLANS on-going. Very limited use of other Smart Sheets. Limited range of applications. Students like them.
Each of us is implementing a range of Organizer, EU, & Vocab Smart Sheets in multiple ways (pre-assess, teach, review). SS & Science essay questions require students to use a Frame GO or simple Matrix. Homework includes a Smart Sheet assignment at least once a week in each class. Grades include assessment of ability to complete Smart Sheets. Weekly class time allocated for meta-dialogues/reflections @ strategic learning w/students. We’re using the Implementation Matrix to assess fidelity. Once a month, each of us observe another teach a classusing a Smart Sheet & discuss observations afterward.
Thus, STEPS is used as an on-going goal-setting & action planning tool
STEPS Goal SeCng / AcFon Planning
At be beginning of each cycle, previous STEPS goals are reviewed and revised
Reflects a continuous, realistic approach to facilitating meaningful change
STEPS Goal SeCng
STEPS Goal SeCng
STEPS Goal SeCng
7/25/12
3
Leadership Support Tactics
Frequently communicate value for
MSS;
Create & protect blocks of time for teachers
to work together to plan and dialogue specifically
about using MSS
Frequently ask teachers what they
need to help them use MSS
Collaboratively develop long range vision for
increasing use of MSS
On-going goal-setting / planning
Teachers using MSS are encouraged, recognized
& reinforced
Inquire about barriers to implementation they may be experiencing
Adequate resources PCs – Windows 7
MACs - OSX
Adobe Reader Microsoft Word
“STEPS” action plans
Fidelity Matrix Fidelity Matrix
Strive for balance b/w fidelity & flexibility
Assess MSS Implementation
Implementation Survey
MSS Walk-Thrus
Fidelity Matrix
A tool for enhancing commitment to fidelity implementation of innovations
This is a “conversation” tool, not an accountability assessment tool
The ImplementaFon Fidelity Matrix
Addresses 4 key dimensions of fidelity Multiplicity Range Integrity Diligence
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Number of different curriculum areas the tool is being applied
Identify the different curriculum areas the tool is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Multiplicity Specific innovative tools or tactics used
Main-Idea Frame
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Range Different curriculum areas (class preparations) the tool or routine is being applied
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
Integrity Quality of instruction provided when tool/tactic is implemented
7/25/12
4
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence
MSS Smart Sheets and/or instructional routines being employed
Identify a specific MSS Smart Sheet or Instructional Routine
Number of different curriculum areas the tool is being applied
Identify the different curriculum areas the tool is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
Integrity Rubric 4 = Highly effective implementation
Students know what to do or how / few mistakes Scaffolding provided as needed
Smart Sheet is developmentally appropriate for students
Information depicted is essential to know
Purpose of Smart Sheet or activity is readily apparent to students
Smart Sheet selected is effective match with nature of information being taught
Students in active learning mode most of the time
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence
MSS Smart Sheets and/or instructional routines being employed
Identify a specific MSS Smart Sheet or Instructional Routine
Number of different curriculum areas the tool is being applied
Identify the different curriculum areas the tool is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
Integrity Rubric 0 = Superficial implementation
Students seem confused about what to do or how / many mistakes are made
Absence of scaffolded assistance
Smart Sheet too advanced for students - OR -
Smart Sheet too simplistic for students
Information depicted not useful
Purpose of Smart Sheet or activity not readily apparent to students
Smart Sheet selected does not match nature of information being taught
Students in passive learning mode most of the time
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
Integrity Quality of instruction provided when tool/tactic is implemented
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
Diligence How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
3 3 1
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) 2
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
3
2
4
1
2
3
The social studies teacher * Has been employing 4 innovations
1
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) 2
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
3
2
4
1
2
3
The social studies teacher * Needs to become more skillful when using the
innovations during direct instruction
1
7/25/12
5
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) 2
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
3
2
4
1
2
3
The social studies teacher * Is pretty skillful when employing the innovations at the
beginning & ending of lessons
1
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) 2
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
3
2
4
1
2
3
The social studies teacher * Frequently uses Frames, so students are likely to
become skillful with them
1
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) 2
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
3
2
4
1
2
3
The social studies teacher * “Once & done” -- only used these tools once, so not
much of an impact on developing students skills using them
1
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame Language Arts (Wells)
4
3
The language arts teacher * Excellent job integrating the Frame GO into writing
instruction on a consistent basis
… but is only Implementing Frames
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame Science (Harbon)
1
Matrix w/conclusions
Social Studies
Science
1
1
1
The science teacher * Attempted to employ two innovations
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame Science (Harbon)
1
Matrix w/conclusions
Social Studies
Science
1
1
1
The science teacher * Attempted to employ two innovations
… but employed them very ineffectively
7/25/12
6
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame Science (Harbon)
1
Matrix w/conclusions
Social Studies
Science
1
1
1
The science teacher * Attempted to employ two innovations
… but employed them very ineffectively
… “once & done”
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Implementation score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3
How well is the team implementing overall?
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3
Multiplicity score Total number of tools and/or routines implemented
4
How well is the team implementing overall? Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
4
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3
Range score Total number of curriculum areas (class preparations)
3
How well is the team implementing overall?
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
4
3 Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3
Integrity score
Total number of Integrity points
17
How well is the team implementing overall? Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
4
3
17
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3
Diligence score Total number of Diligence points
10
How well is the team implementing overall?
7/25/12
7
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
4
3
17
10
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
3 3 1
2 1
4
1 1
2
1 3 34
How well is the team implementing overall?
Overall Implementation score Total of all points
Implementation Fidelity Assessment Matrix
©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies
TM
Total of Diligence scores
Total number of tools implemented (# Multiplicity items)
Total number of courses (#Range items)
Total of Integrity scores
Implementation Score
Multiplicity score
Attach additional pages as needed; include scores from other pages
Team or teacher implementing Makes Sense Strategies
+
+ +
Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed
Different curriculum areas (class preparations) the tool or routine is being applied
To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well
How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily
8th grade Dolphin Team
Main-Idea Frame
Social Studies (Creek) Language Arts (Wells) Science (Harbon)
2 4 1
4
3
17
10
3 3 1
2 1
4
1 1
2
1 3
Matrix w/conclusions
CROWN Reflective Review
Pre-asses via Smart Sheet
Social Studies
Social Studies
Social Studies
Science
How well is the team implementing overall?
Overall Implementation score Total of all points
34
34
Does an overall score of 34 reflect high, medium or low fidelity?
Remember...
The Fidelity is a conversation tool for supporting implementation
… not an accountability tool
Leadership Support Tactics
Frequently communicate value for
MSS;
Create & protect blocks of time for teachers
to work together to plan and dialogue specifically
about using MSS
Frequently ask teachers what they
need to help them use MSS
Collaboratively develop long range vision for
increasing use of MSS
On-going goal-setting / planning
Teachers using MSS are encouraged, recognized
& reinforced
Inquire about barriers to implementation they may be experiencing
Adequate resources PCs – Windows 7
MACs - OSX
Adobe Reader Microsoft Word
“STEPS” action plans
Fidelity Matrix
Strive for balance b/w fidelity & flexibility
Assess MSS Implementation
Implementation Survey
MSS Walk-Thrus
Implementation Survey
Fidelity Matrix
ImplementaFon Survey
28-question survey
Reveals teachers’ perceptions of… Value / investment using MSS to increase student outcomes Confidence / competence using MSS Time, energy, & difficulty using MSS Leadership expectations / support for using MSS Degree to which teachers collaborate and support each other
ImplementaFon Survey
Best practices…
Administered 3 times a year
Beginning of year Sends an important message about leadership expectations & support
End of 1st semester
Sets the stage for setting goals / making plans
Takes “temperature” / reiterates message Provides important data for focusing support efforts for 2nd semester
End of 2nd semester Sets stage for summer planning
7/25/12
8
ImplementaFon Survey
Best practices…
Administered anonymously Can use with “Survey Monkey” or other on-line survey services
3 Dimensions of Effective GO Use
Tactics & tools for Supporting
Implementation
Big Ideas about Supporting Implementation
Leadership Support for MSS Implementation
Casual vs. Fidelity implementation Saboteurs vs. Runners
Why bother?
Part 1
Critical Features
Planning & Teaching Using
GOs
Part 2 Tactics & Tools for
Supporting Implementation
Part 3
MSS Walk-Thru Observation
TM
Makes Sense Strategies Toolkit © Edwin Ellis, PhD (205) 394-‐5512
Assessment
Quality of the GO & info on it Quality of the GO instruction
Sustained Applications STEPS
goal setting / action plans
Implementation Fidelity Matrix
Implementation Survey
Strategic Approach to Implementing Innovation