ho part 3 support strategies...part 2 tactics & tools for supporting implementation part 3 mss...

8
7/25/12 1 Tactics & tools for Supporting Implementation Big Ideas about Supporting Implementation Leadership Support for MSS Implementation Tactics & Tools for Supporting Implementation Part 3 TM Makes Sense Strategies Toolkit ©Edwin Ellis, PhD (205) 3945512 Assessment Leadership Support Tactics Frequently communicate value for MSS; Create & protect blocks of time for teachers to work together to plan and dialogue specifically about using MSS Frequently ask teachers what they need to help them use MSS Collaboratively develop long range vision for increasing use of MSS Strive for balance b/w fidelity & flexibility On-going goal-setting / planning Teachers using MSS are encouraged, recognized & reinforced Inquire about barriers to implementation teachers may be experiencing Adequate resources PCs – Windows 7+ MACs - OSX Adobe Reader Microsoft Word “STEPS” action plans Assess MSS Implementation Implementation Survey Fidelity Matrix MSS Walk-Thrus “STEPS” goal setting 7 action planning A tool for enhancing commitment to fidelity implementation of innovations STEPS Goal SeCng / AcFon Planning Select something to change / implement Scale up - How could it look in _____ months? Project how it can look in _____ months (doable) Tell it like it is now Envision the ideal CYCLE Target date: STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies TM Name: Date: Select something to change / implement Scale up - How could it look in _____ months? Project how it can look in _____ months (doable) Tell it like it is now Envision the ideal CYCLE Target date: STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies TM Name: Date: 8 th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20 Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes. ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments. Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings. 2 Oct 10 Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects. 6 CYCLE # 1 Select something to change / implement Scale up - How could it look in _____ months? Project how it can look in _____ months (doable) Tell it like it is now Envision the ideal CYCLE Target date: STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies TM Name: Date: 8 th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20 Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes. our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in 2 Oct 10 Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects. 6 1 After 2 month period (or sooner), team enters 2nd CYCLE 2 The team revises vision based on what they learned during the initial cycle

Upload: others

Post on 03-Aug-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

1  

3 Dimensions of Effective GO Use

Tactics & tools for Supporting

Implementation

Big Ideas about Supporting Implementation

Leadership Support for MSS Implementation

Casual vs. Fidelity implementation Saboteurs vs. Runners

Why bother?

Part 1

Critical Features

Planning & Teaching Using

GOs

Part 2 Tactics & Tools for

Supporting Implementation

Part 3

MSS Walk-Thru Observation

TM  

Makes Sense Strategies Toolkit ©  Edwin  Ellis,  PhD          (205)  394-­‐5512  

Assessment    

WHY GOs? Leadership

Support Tactics

Frequently communicate value

for MSS;

Create & protect blocks of time for teachers

to work together to plan and dialogue specifically

about using MSS

Frequently ask teachers what they

need to help them use MSS

Collaboratively develop long range vision for

increasing use of MSS

Strive for balance b/w fidelity & flexibility

On-going goal-setting / planning

Teachers using MSS are encouraged, recognized

& reinforced

Inquire about barriers to implementation teachers may be experiencing

Adequate resources PCs – Windows 7+

MACs - OSX

Adobe Reader Microsoft Word

“STEPS” action plans

Assess MSS Implementation

Implementation Survey

Fidelity Matrix

MSS Walk-Thrus

“STEPS” goal setting 7 action planning

A tool for enhancing commitment to fidelity implementation of innovations

STEPS  Goal  SeCng  /  AcFon  Planning  Select something to change / implement

Scale up - How could it look in _____ months?

Project how it can look in _____ months (doable)

Tell it like it is now

Envision the ideal

CYCLE

Target date:

STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Name: Date:

Select something to change / implement

Scale up - How could it look in _____ months?

Project how it can look in _____ months (doable)

Tell it like it is now

Envision the ideal

CYCLE

Target date:

STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20

Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes

Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.

ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.

Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.

2 Oct 10

Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.

6

CYCLE #

1 Select something to change / implement

Scale up - How could it look in _____ months?

Project how it can look in _____ months (doable)

Tell it like it is now

Envision the ideal

CYCLE

Target date:

STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20

Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes

Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.

ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.

Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.

2 Oct 10

Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.

6

1

After 2 month period (or sooner), team enters 2nd CYCLE

2

The team revises vision based on what they learned during the initial cycle

Page 2: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

2  

Select something to change / implement

Scale up - How could it look in _____ months?

Project how it can look in _____ months (doable)

Tell it like it is now

Envision the ideal

CYCLE

Target date:

STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Aug. 20

Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes

Social studies & Science- use outlines for guided note-taking weekly & use webs occasionally (once every 2 weeks). Lang. Arts emphasizes webs for pre-writing. Quality of webs not assessed in any classes.

ALL our classes employ a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in activities & assignments.

Each of us will be using a Frame GO for guided note-taking and/or in-class reading activity at least once per week. We share ideas & experiences using Frames during weekly team meetings.

2 10/20/08

Each of us is implementing a range of Organizer Smart Sheets. We are coordinating activities/assignments/use of Smart Sheet & rubrics across classes so students learn to use same Smart Sheet in variety of ways, contexts, & subjects.

6

2 New vision reflects…

* Less superficiality

* Greater understanding of implementation nuances

* Increased confidence

Select something to change / implement

Scale up - How could it look in _____ months?

Project how it can look in _____ months (doable)

Tell it like it is now

Envision the ideal

CYCLE

Target date:

STEPS Goal Setting © 2009 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Name: Date: 8th grade DOLPHIN TEAM – Perdido Bay Middle School Oct. 20

Integrated use of Organizer, Essential Understanding, & Vocab Smart Sheets across classes

Course of study standards are linked to specific Smart Sheets. We use a range of Organizer, EU, & Vocab Smart Sheets at least twice per week in a range of scaffolded activities & assignments, esp. “Y’all do it” activities. Smart Sheet use is celebrated / reinforced. Students self-select best Smart Sheet for a given task. Smart Sheets are incorporated as assessment tools. We are conducting action research to assess Smart Sheet impact. We are implementing with high levels of fidelity.

All writing assignments (in all classes) will require students to use a Frame GO & PLANS writing strategy. We use same rubric to asses writing. Each of us will continue using Organizers, but also use at least 1 EU or Vocab Smart Sheet in class once per week. Student Smart Sheet work posted on classroom walls & changed frequently.

We share ideas & experiences using Smart Sheets and brainstorm potential Smart Sheets for LA, SS, Science, & Math standards during weekly team meetings The Implementation Matrix is used to guide us, but we’re not using it to collect data.

6

2

2 12/20

SS – 3 MI Frame GO once wk for guided note-taking / Science – Frame GO or Cause/Effect occasionally / Math - none / L.A. – Frame GO & PLANS on-going. Very limited use of other Smart Sheets. Limited range of applications. Students like them.

Each of us is implementing a range of Organizer, EU, & Vocab Smart Sheets in multiple ways (pre-assess, teach, review). SS & Science essay questions require students to use a Frame GO or simple Matrix. Homework includes a Smart Sheet assignment at least once a week in each class. Grades include assessment of ability to complete Smart Sheets. Weekly class time allocated for meta-dialogues/reflections @ strategic learning w/students. We’re using the Implementation Matrix to assess fidelity. Once a month, each of us observe another teach a classusing a Smart Sheet & discuss observations afterward.

Thus, STEPS is used as an on-going goal-setting & action planning tool

STEPS  Goal  SeCng  /  AcFon  Planning  

At be beginning of each cycle, previous STEPS goals are reviewed and revised

Reflects a continuous, realistic approach to facilitating meaningful change

STEPS  Goal  SeCng  

STEPS  Goal  SeCng  

STEPS  Goal  SeCng  

Page 3: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

3  

Leadership Support Tactics

Frequently communicate value for

MSS;

Create & protect blocks of time for teachers

to work together to plan and dialogue specifically

about using MSS

Frequently ask teachers what they

need to help them use MSS

Collaboratively develop long range vision for

increasing use of MSS

On-going goal-setting / planning

Teachers using MSS are encouraged, recognized

& reinforced

Inquire about barriers to implementation they may be experiencing

Adequate resources PCs – Windows 7

MACs - OSX

Adobe Reader Microsoft Word

“STEPS” action plans

Fidelity Matrix Fidelity Matrix

Strive for balance b/w fidelity & flexibility

Assess MSS Implementation

Implementation Survey

MSS Walk-Thrus

Fidelity  Matrix  

A tool for enhancing commitment to fidelity implementation of innovations

This is a “conversation” tool, not an accountability assessment tool

The  ImplementaFon    Fidelity  Matrix  

Addresses 4 key dimensions of fidelity Multiplicity Range Integrity Diligence

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Number of different curriculum areas the tool is being applied

Identify the different curriculum areas the tool is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Multiplicity Specific innovative tools or tactics used

Main-Idea Frame

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Range Different curriculum areas (class preparations) the tool or routine is being applied

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

Integrity Quality of instruction provided when tool/tactic is implemented

Page 4: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

4  

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence

MSS Smart Sheets and/or instructional routines being employed

Identify a specific MSS Smart Sheet or Instructional Routine

Number of different curriculum areas the tool is being applied

Identify the different curriculum areas the tool is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

Integrity Rubric 4 = Highly effective implementation

Students know what to do or how / few mistakes Scaffolding provided as needed

Smart Sheet is developmentally appropriate for students

Information depicted is essential to know

Purpose of Smart Sheet or activity is readily apparent to students

Smart Sheet selected is effective match with nature of information being taught

Students in active learning mode most of the time

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence

MSS Smart Sheets and/or instructional routines being employed

Identify a specific MSS Smart Sheet or Instructional Routine

Number of different curriculum areas the tool is being applied

Identify the different curriculum areas the tool is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

Integrity Rubric 0 = Superficial implementation

Students seem confused about what to do or how / many mistakes are made

Absence of scaffolded assistance

Smart Sheet too advanced for students - OR -

Smart Sheet too simplistic for students

Information depicted not useful

Purpose of Smart Sheet or activity not readily apparent to students

Smart Sheet selected does not match nature of information being taught

Students in passive learning mode most of the time

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

Integrity Quality of instruction provided when tool/tactic is implemented

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

Diligence How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

3 3 1

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) 2

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

3

2

4

1

2

3

The social studies teacher * Has been employing 4 innovations

1

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) 2

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

3

2

4

1

2

3

The social studies teacher * Needs to become more skillful when using the

innovations during direct instruction

1

Page 5: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

5  

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) 2

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

3

2

4

1

2

3

The social studies teacher * Is pretty skillful when employing the innovations at the

beginning & ending of lessons

1

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) 2

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

3

2

4

1

2

3

The social studies teacher * Frequently uses Frames, so students are likely to

become skillful with them

1

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) 2

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

3

2

4

1

2

3

The social studies teacher * “Once & done” -- only used these tools once, so not

much of an impact on developing students skills using them

1

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame Language Arts (Wells)

4

3

The language arts teacher * Excellent job integrating the Frame GO into writing

instruction on a consistent basis

… but is only Implementing Frames

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame Science (Harbon)

1

Matrix w/conclusions

Social Studies

Science

1

1

1

The science teacher * Attempted to employ two innovations

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame Science (Harbon)

1

Matrix w/conclusions

Social Studies

Science

1

1

1

The science teacher * Attempted to employ two innovations

… but employed them very ineffectively

Page 6: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

6  

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame Science (Harbon)

1

Matrix w/conclusions

Social Studies

Science

1

1

1

The science teacher * Attempted to employ two innovations

… but employed them very ineffectively

… “once & done”

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Implementation score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3

How well is the team implementing overall?

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3

Multiplicity score Total number of tools and/or routines implemented

4

How well is the team implementing overall? Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

4

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3

Range score Total number of curriculum areas (class preparations)

3

How well is the team implementing overall?

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

4

3 Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3

Integrity score

Total number of Integrity points

17

How well is the team implementing overall? Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

4

3

17

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3

Diligence score Total number of Diligence points

10

How well is the team implementing overall?

Page 7: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

7  

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

4

3

17

10

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

3 3 1

2 1

4

1 1

2

1 3 34

How well is the team implementing overall?

Overall Implementation score Total of all points

Implementation Fidelity Assessment Matrix

©2007 Edwin Ellis, All Rights Reserved Published by Makes Sense Strategies, LLC, Lillian, AL www.MakesSenseStrategies.com Makes Sense Strategies Makes Sense Strategies

TM

Total of Diligence scores

Total number of tools implemented (# Multiplicity items)

Total number of courses (#Range items)

Total of Integrity scores

Implementation Score

Multiplicity score

Attach additional pages as needed; include scores from other pages

Team or teacher implementing Makes Sense Strategies

+

+ +

Integrity Multiplicity Range Diligence MSS Smart Sheets and/or instructional routines being employed

Different curriculum areas (class preparations) the tool or routine is being applied

To what extent is the tool applied in a quality manner? 1 = superficial 4 = extremely well

How often is the tool used? 1 = once 2 = about once a week 3 = 2-3 times per week 4 = daily

8th grade Dolphin Team

Main-Idea Frame

Social Studies (Creek) Language Arts (Wells) Science (Harbon)

2 4 1

4

3

17

10

3 3 1

2 1

4

1 1

2

1 3

Matrix w/conclusions

CROWN Reflective Review

Pre-asses via Smart Sheet

Social Studies

Social Studies

Social Studies

Science

How well is the team implementing overall?

Overall Implementation score Total of all points

34

34

Does an overall score of 34 reflect high, medium or low fidelity?

Remember...

The Fidelity is a conversation tool for supporting implementation

… not an accountability tool

Leadership Support Tactics

Frequently communicate value for

MSS;

Create & protect blocks of time for teachers

to work together to plan and dialogue specifically

about using MSS

Frequently ask teachers what they

need to help them use MSS

Collaboratively develop long range vision for

increasing use of MSS

On-going goal-setting / planning

Teachers using MSS are encouraged, recognized

& reinforced

Inquire about barriers to implementation they may be experiencing

Adequate resources PCs – Windows 7

MACs - OSX

Adobe Reader Microsoft Word

“STEPS” action plans

Fidelity Matrix

Strive for balance b/w fidelity & flexibility

Assess MSS Implementation

Implementation Survey

MSS Walk-Thrus

Implementation Survey

Fidelity  Matrix  

ImplementaFon  Survey  

28-question survey

Reveals teachers’ perceptions of… Value / investment using MSS to increase student outcomes Confidence / competence using MSS Time, energy, & difficulty using MSS Leadership expectations / support for using MSS Degree to which teachers collaborate and support each other

ImplementaFon  Survey  

Best practices…

Administered 3 times a year

Beginning of year Sends an important message about leadership expectations & support

End of 1st semester

Sets the stage for setting goals / making plans

Takes “temperature” / reiterates message Provides important data for focusing support efforts for 2nd semester

End of 2nd semester Sets stage for summer planning

Page 8: HO Part 3 Support Strategies...Part 2 Tactics & Tools for Supporting Implementation Part 3 MSS Walk-Thru Observation TM& Makes Sense Strategies Toolkit ©EdwinEllis,PhD (205)3945512

7/25/12  

8  

ImplementaFon  Survey  

Best practices…

Administered anonymously Can use with “Survey Monkey” or other on-line survey services

3 Dimensions of Effective GO Use

Tactics & tools for Supporting

Implementation

Big Ideas about Supporting Implementation

Leadership Support for MSS Implementation

Casual vs. Fidelity implementation Saboteurs vs. Runners

Why bother?

Part 1

Critical Features

Planning & Teaching Using

GOs

Part 2 Tactics & Tools for

Supporting Implementation

Part 3

MSS Walk-Thru Observation

TM  

Makes Sense Strategies Toolkit ©  Edwin  Ellis,  PhD          (205)  394-­‐5512  

Assessment    

Quality of the GO & info on it Quality of the GO instruction

Sustained Applications STEPS

goal setting / action plans

Implementation Fidelity Matrix

Implementation Survey

Strategic Approach to Implementing Innovation