Building Effective Coaches to Building Effective Coaches to Expand & Sustain PBIS Expand & Sustain PBIS

ImplementationImplementation

Marla Dewhirst, Illinois PBIS Network; Susan Barrett, Sheppard Pratt Health System, Maryland Karyn Renneberg, Howard County Public Schools, Maryland  

Big picture …..How do you change individual behavior in schools?

How do you create school environments that sustain change?

What system-level mechanisms and infrastructure are necessary to sustain and bring to scale interventions that create desired change?

What does NOT WORKWhat does NOT WORKExcellent evidence for what does not work

•Implementation by edict does not work

•Implementation by “ following the money” does not work

•Implementation without changing supporting roles and functions does not work

Paul Nutt (2003) Why decisions fail

PBS Systems Implementation LogicPBS Systems Implementation Logic

Leadership Team

FundingVisibility Political

Support

Training Coaching Evaluation

Active Coordination

Local School Teams/Demonstrations

Frequently Asked QuestionsFrequently Asked Questions

How do you select coaches ?How do you select coaches ?

Where does the funding come from?Where does the funding come from?

How many schools per coach?How many schools per coach?

How do you train coaches?How do you train coaches?

How do you provide ongoing technical How do you provide ongoing technical assistance for coaches?assistance for coaches?

•An evidence-based program is one thing

•Implementation of an evidence based program is a very different thing

Dean Fixsen National Implementation Research Network http://nirn.fmhi.usf.edu/

ImplementationImplementation

Core Implementation ComponentsCore Implementation Components

Staff Selection (organizing a team)Staff Selection (organizing a team)

Staff TrainingStaff Training

Staff CoachingStaff Coaching

Evaluation and Fidelity Evaluation and Fidelity

Four Main Roles of CoachFour Main Roles of CoachSpouse 2001Spouse 2001

•Supervision

•Teaching while engaged in practice activities

•Assessment and feedback

•Provision of emotional support

Newly-learned behavior is crude compared to Newly-learned behavior is crude compared to performance by a master practitioner. performance by a master practitioner.

Newly-learned behavior is fragile and needs to Newly-learned behavior is fragile and needs to be supported in the face of reactive consumers be supported in the face of reactive consumers and others in the service setting.and others in the service setting.

Newly-learned behavior is incomplete and will Newly-learned behavior is incomplete and will need to be shaped to be most functional in a need to be shaped to be most functional in a service setting. service setting.

Coaches need training and supportCoaches need training and support

Joyce and Showers (2002) Leadership, organizational culture, labor relations, interpersonal relationships and engagement in participatory planning all impact the availability and effectiveness of coaching.

In addition, coaches need to be trained and coached to provide specialized coaching functions for teachers and requires more organizational leadership and more resources (Marks&Gerston, 1998)

Coaching starts at the initial trainingCoaching starts at the initial training

Showers & Joyce (1996) recommended that coaching relationships should start during the training so parts of the training experience (practice new skills, receive feedback, re-practice) can facilitate the development of the coaching relationship

Training alone, no Training alone, no matter how well done, matter how well done, does notdoes not lead to lead to successful successful implementationimplementation

Training AloneTraining Alone Coaching AloneCoaching Alone

- Content/topic focusedContent/topic focused- Efficient Efficient

dissemination of dissemination of informationinformation

- Cost effectiveCost effective- Develop skill Develop skill

foundationfoundation- Skill acquisition and Skill acquisition and

fluency fluency (initial learning)(initial learning)

- Formative evaluationFormative evaluation

- Process focusedProcess focused- On-going supportOn-going support- Implementation Implementation

fidelityfidelity- Skill maintenance Skill maintenance

and generalizationand generalization(advanced learning)(advanced learning)

- Process evaluationProcess evaluation- AccountabilityAccountability

Systems ApproachSystems Approach(Training – Coaching Combined)(Training – Coaching Combined)

- Common Common foundational skillsfoundational skills

- Individualized supportIndividualized support- Sustained Sustained

implementationimplementation- Increased efficiencyIncreased efficiency

- Formative, process, Formative, process, and summative and summative evaluationevaluation

- Improved contextual-Improved contextual-fitfit

- Increased Increased organizational organizational capacitycapacity

- AccountabilityAccountability

Coaching at ALL LevelsCoaching at ALL Levels

School (teachers, team)School (teachers, team)

Leadership (“Executive Coaching” for Leadership (“Executive Coaching” for building level and district level admin)building level and district level admin)

CoachesCoaches

CoordinatorsCoordinators

Oh my!Oh my!

465

590

0

283

383

178

64 118

14 34

368263

42 61

133183

8130

0

100

200

300

400

500

600

700

FY 99 FY 00 FY 01 FY 02 FY 03 FY 04 FY 05 FY 06 FY07(Projected)

Schools Trained Coaches Trained

Behavior Support CoachesBehavior Support Coaches383 Behavior Support Coaches383 Behavior Support Coaches– Itinerant positions/funded by LSS Itinerant positions/funded by LSS

Meet 5 times/yearMeet 5 times/year– NetworkingNetworking– Regional MeetingsRegional Meetings– WorkgroupsWorkgroups

Coaches ReceptionCoaches ReceptionCoaches Newsletter/Coaches Coaches Newsletter/Coaches CalendarCalendarCoach = RecruiterCoach = Recruiter

8 LSS Coordinators8 LSS Coordinators

Roles of CoachRoles of Coach

Sustainability & AccountabilitySustainability & AccountabilityHands-on technical assistanceHands-on technical assistanceGuide problem solvingGuide problem solvingLocal trainingLocal trainingTeam start-up & sustainabilityTeam start-up & sustainabilityPublic relations/communicationsPublic relations/communications

Support local leadershipSupport local leadershipLocal coordination of resourcesLocal coordination of resourcesProvide prompts & reinforcersProvide prompts & reinforcers

Behavior Support Coach ActivitiesBehavior Support Coach ActivitiesFTE allocated to complete tasksFTE allocated to complete tasksConsistently attend team meetingsConsistently attend team meetingsAssist team with data-based decision-making, Assist team with data-based decision-making, planning, and implementationplanning, and implementationAttend Regional/State Coaches Attend Regional/State Coaches meetings/trainingsmeetings/trainingsSend information to PBIS State/District Send information to PBIS State/District Coordinator (e.g., checklists, action plans, etc.)Coordinator (e.g., checklists, action plans, etc.)Assist with dissemination activities (e.g., Assist with dissemination activities (e.g., presentations, case studies, articles, etc.)presentations, case studies, articles, etc.)

Colorado’s Coach Job DescriptionColorado’s Coach Job Description

How do you select coachesHow do you select coaches

District DiscretionDistrict Discretion

Job DescriptionJob Description

Commitment AgreementCommitment Agreement

Pre-requisites: Pre-requisites: – PBIS team memberPBIS team member– WIIFMWIIFM– On-going trainingOn-going training

Where does the funding come fromWhere does the funding come from

Education Fund..# 1 (make it permanent)Education Fund..# 1 (make it permanent)Short Term Grants: Safe and Drug Free Short Term Grants: Safe and Drug Free Schools, Character Counts, Violence Schools, Character Counts, Violence Prevention, Safe Schools Healthy ChildrenPrevention, Safe Schools Healthy ChildrenRe-allocation of local dollars – Key!Re-allocation of local dollars – Key!State and Federal Title Grants:State and Federal Title Grants:– School improvementSchool improvement– Staff developmentStaff development– Safe and Drug Free SchoolsSafe and Drug Free Schools– Innovative initiativesInnovative initiatives– IDEA prevention %IDEA prevention %

How many schools per coachHow many schools per coach

Good Question!!!Good Question!!!– It depends…. It depends…. – 1.0 for 10-15 schools/districts??1.0 for 10-15 schools/districts??– Universal verses Secondary and Tertiary Universal verses Secondary and Tertiary

SupportSupport– Large Urban District or Small Rural Large Urban District or Small Rural – What is your capacity?What is your capacity?– In Illinois, most Coordinators have 60 In Illinois, most Coordinators have 60

buildings 10-15 Districtsbuildings 10-15 Districts

How do you train coachesHow do you train coaches

Previous experiencePrevious experience

Train with teamTrain with team

On-going network meetingsOn-going network meetings

On-going technical assistanceOn-going technical assistance

Initial training seriesInitial training series

Advanced training seriesAdvanced training series

Continuous regeneration (Rob Horner)Continuous regeneration (Rob Horner)

How do you provide ongoing How do you provide ongoing technical assistance for coachestechnical assistance for coaches

Put on data base for all information that Put on data base for all information that comes out statewidecomes out statewide

Specific Coaches TrainingSpecific Coaches Training– See Coaches Series DescriptionsSee Coaches Series Descriptions– Have recognized need for internal and Have recognized need for internal and

external coaches training – taking training up external coaches training – taking training up a step in 2008a step in 2008

Practical ApplicationPractical Application

Internal Coach Job DescriptionInternal Coach Job Description

External Coach Job DescriptionExternal Coach Job Description

Coaches Self-AssessmentCoaches Self-Assessment

Data Based Decision MakingData Based Decision Making– Phases and SWIS Data ActivityPhases and SWIS Data Activity

Coaching Towards Full DistrictCoaching Towards Full DistrictImplementationImplementation

Howard County Public Schools

Ellicott City , Maryland

Suburban Community Suburban Community Baltimore-Washington CorridorBaltimore-Washington Corridor

71 Schools71 Schools– 38 Elementary38 Elementary– 1 Pre-K to 81 Pre-K to 8– 18 Middle18 Middle– 12 High12 High– 2 Special Schools2 Special Schools

48, 221 Students48, 221 Students

The PBIS VoyageThe PBIS Voyage

Joined PBIS Training in 2000Joined PBIS Training in 2000

3 Elementary Schools3 Elementary SchoolsDasher GreenDasher Green

ElkridgeElkridgePhelps LuckPhelps Luck

HCPSS Coaches Not DeterminedHCPSS Coaches Not Determined

608

108

46 7732 22

0

100

200

300

400

500

600

700

ODR suspension

Dasher Green Elementary: PBIS Data

1999-012000-012001-02

Sophisticated Coaching Sophisticated Coaching SystemSystem

KarynAnne

20022002--0303

Dasher Green ElementaryDasher Green Elementary

Owen Brown MiddleOwen Brown Middle

Wilde Lake HighWilde Lake High

20032003--0404

Cradlerock (Dasher Green/Owen Brown)Cradlerock (Dasher Green/Owen Brown)

Laurel Woods ElementaryLaurel Woods Elementary

Wilde Lake HighWilde Lake High

3 Is Not A Crowd!3 Is Not A Crowd!

NEEDED TO GET THE MESSAGE OUT NEEDED TO GET THE MESSAGE OUT THERE……….THERE……….

From GRASS ROOTS To………From GRASS ROOTS To………

Grand Scheme!Grand Scheme!

Triangle TeamTriangle Team

Director of Student Services

Behavior Specialist Facilitator for School Psychologists

Director Of Student ServicesDirector Of Student Services– Point Of Contact/Connection To School AdministrationPoint Of Contact/Connection To School Administration– Community AgenciesCommunity Agencies– Chairs The HCPSS PBIS Leadership TeamChairs The HCPSS PBIS Leadership Team

Behavior SpecialistBehavior Specialist– Support/Training For CoachesSupport/Training For Coaches– Provided TA For Yellow/Red Zone StrategiesProvided TA For Yellow/Red Zone Strategies– SWIS FacilitatorSWIS Facilitator

– Attend State Leadership MeetingsAttend State Leadership Meetings

Facilitator For School PsychologistsFacilitator For School Psychologists– Writes And Develops Grants To Fund TrainingWrites And Develops Grants To Fund Training– Develops BudgetDevelops Budget– Data Review, Focus On Disproportionality IssuesData Review, Focus On Disproportionality Issues– Attend State Leadership MeetingsAttend State Leadership Meetings

HCPSS PBIS Leadership TeamHCPSS PBIS Leadership Team

Consists Of:Consists Of:

Triangle TeamTriangle Team

– PBIS Principals, CoachesPBIS Principals, Coaches

– County AdministratorsCounty Administrators

– County Data SpecialistCounty Data Specialist

– Community Agencies (Mental Health, Community Agencies (Mental Health, Juvenile JusticeJuvenile Justice

Goal 2 Safe and Nurturing Environments

Valuing Diversity and Commonality

SHARED VISION AND VALUES

Academic Achievement for All Students

Safe & Nurturing Environments

Culturally

Proficient

Positive B

ehavioralS

upports

Effective P

roblem S

olving Team

s

School, F

amily

& C

omm

unity P

artnerships

Pillar I Pillar II

Pillar III

Pillar IV

Spreading The WordSpreading The Word

20042004– Student, Family and Student, Family and

Community ServicesCommunity Services– Office Of Special Office Of Special

EducationEducation

20052005– Principals/AP MeetingPrincipals/AP Meeting– HCPSS Administrators HCPSS Administrators

Summer Institute Summer Institute – Student ServicesStudent Services

2006 2006 – Principals/AP MeetingPrincipals/AP Meeting– Department Of Department Of

Student ServicesStudent Services– Board Of EducationBoard Of Education– Board Member Board Member

Attends Spring ForumAttends Spring Forum

20072007– Board Of EducationBoard Of Education– Board Members Board Members

Attend New Team Attend New Team TrainingTraining

Bellows Spring ES

Folly Quarter MS

Bollman Bridge ES Glenwood MS

Clemons Crossing ES

Hammond MS

Cradlerock Deep Run ES Mount View MS

Laurel Woods ES

Guilford ES Murray Hill MS

Wilde Lake HS

Hammond ES Oakland Mills MS

Guilford ES Ilchester ES Patapsco MSBryant Woods ES

Cradlerock Longfellow ES Jeffers Hill ES Patuxent Valley MS

Dayton Oaks ES

Laurel Woods ES

Bollman Bridge ES

Laurel Woods ES

Wilde Lake MS Elkridge ES

Wilde Lake HS

Deep Run ES Lisbon ES Atholton HS Forest Ridge ES

Guilford ES Hammond MS Longfellow ES Centennial HSSwansfield ES

Longfellow ES Murray Hill MS

Phelps Luck ES

Howard HS Talbott Springs ES

Bollman Bridge ES

Hammond ES Rockburn ES Long Reach HS

Triadelphia Ridge ES

Deep Run ES Wilde Lake MS

Running Brook ES

Reservoir HSVeteran's ES

Dasher Green (Cradlerock)

Hammond MS Oakland Mills MS

St. Johns ES Wilde Lake HS

Waterloo ESDasher Green

ESDasher Green

ESDasher Green

ESOBMS

(Cradlerock)Murray Hill

MSRockburn ES Stevens Forest

ESCedar Lane Bonnie Branch

MSPhelps Luck

ESPhelps Luck ES (inactive)

Owen Brown MS

Laurel Woods ES

Cedar Lane (inactive)

Stevens Forest ES

Dunloggin MS Cradlerock Harpers Choice MS

Elkridge ES Elkridge ES (inactive)

Laurel Woods ES

Wilde Lake HS

Homewood (inactive)

Howard HS Elkridge Landing MS

Homewood Center

2000 2001 2002 2003 2004 2005 20072006

NEW

2007

School Level Percentages

Elementary 53%Middle 23%High 13%Other 6%

53%23%

13%

6%

47 Schools

64% of All HCPSS

ConsideringConsideringInternal/External Coaching SystemInternal/External Coaching System

Use Skilled Staff Use Skilled Staff Within The BuildingWithin The Building

Time Time

Knowledge Of Knowledge Of Staffing/OperationStaffing/Operation

Staff RelationshipsStaff Relationships

Coordination Of Coordination Of Problem Solving Problem Solving TeamsTeams

Independent Independent Relationship With Relationship With StaffStaffOutside PerspectiveOutside PerspectiveMultiple School Multiple School AccessAccessFlexible ScheduleFlexible ScheduleBehavioral Expertise Behavioral Expertise For Red/Yellow For Red/Yellow ZonesZones

INTERNAL COACH EXTERNAL COACH

52 PBIS COACHES

school psychologist 42%

school counselors 21%

alternative education 15%

teachers 9%

special education staff 6%

administrators 6%

42%

21%

15%

9%

6%6%

52 coaches

What Do Coaches Do?What Do Coaches Do?

Analyze School DataAnalyze School DataSet Up Team Set Up Team MeetingsMeetingsDelegate/Share or Delegate/Share or Burn OutBurn OutSet Goals With TeamSet Goals With TeamAssist With Assist With Coordination of Coordination of EventsEventsShare Data With StaffShare Data With Staff

Technical Assistance Technical Assistance To Teams/CoachesTo Teams/Coaches

Serve on Local And Serve on Local And State Leadership State Leadership TeamTeam

Coordinate SWIS, Coordinate SWIS, SET’s And Staff SET’s And Staff DevelopmentDevelopment

INTERNAL COACH EXTERNAL COACH

Help The Schools To OrganizeHelp The Schools To Organize

Coaching InformationCoaching Information

MeetingsMeetings

ArticlesArticles

Outside ExamplesOutside Examples

Conference Information Conference Information

School Information:School Information:

Based On SET-Based On SET--Expectations-Expectations

-Teaching-Teaching

-Rewards-Rewards

-Behavior Violations-Behavior Violations

-Decision Making-Decision Making

-Management-Management

-District Support-District Support

2 Notebooks

HCPSS Coaches TrainingHCPSS Coaches Training

Howard CountyHoward County

– Coaches MeetingsCoaches Meetings

– SWISSWIS

– Staff DevelopmentStaff Development

– Returning Team Returning Team Summer InstituteSummer Institute

StatewideStatewide

– Coaches MeetingsCoaches Meetings

– School Visits (level)School Visits (level)

– New Team New Team Summer InstituteSummer Institute

– SETSET

2006-07 Staff Development2006-07 Staff Development

Dr. Reinke - Johns Hopkins UniversityDr. Reinke - Johns Hopkins University

The Classroom Checkup:The Classroom Checkup:

An Assessment/Intervention Tool For An Assessment/Intervention Tool For Improving Classroom ManagementImproving Classroom Management

Susan Barrett/Elsa Velez - Maryland PBISSusan Barrett/Elsa Velez - Maryland PBIS

BEP:Behavior Education ProgramBEP:Behavior Education Program

103 Participants103 Participants

Returning Team TrainingReturning Team TrainingCentral Region 2Central Region 2

First Year for Counties Conducting Own First Year for Counties Conducting Own Summer InstituteSummer Institute

Central Region - 4 CountiesCentral Region - 4 Counties700 Participants From 4 Counties700 Participants From 4 Counties

170 Howard County Team Members170 Howard County Team Members20 Breakout Sessions:20 Breakout Sessions: School-wideSchool-wide

ClassroomClassroomIndividualIndividual

CelebrationsCelebrations

16 Schools Met Criteria For Maryland PBIS 16 Schools Met Criteria For Maryland PBIS Recognition Awards!!Recognition Awards!!

8 Exemplar8 Exemplar

7 Banner7 Banner

1 Green Ribbon1 Green Ribbon

Data CelebrationsData Celebrations

The first and second year of PBIS implementation results The first and second year of PBIS implementation results in a in a 15-20% reduction in office discipline referrals15-20% reduction in office discipline referrals each each year.year.

During the same two years the “During the same two years the “Green Zone”Green Zone” for PBIS for PBIS schools ranged from 75-90% of the school population (this schools ranged from 75-90% of the school population (this parallels national data trends). parallels national data trends).

In turn, there In turn, there is a significant cost benefitis a significant cost benefit of time gained for of time gained for both instructional time and administrative leadership in both instructional time and administrative leadership in each school.each school.

Coaching CelebrationCoaching Celebration

End Of Year Showcase/CelebrationEnd Of Year Showcase/Celebration

Breakfast For All CoachesBreakfast For All Coaches

Raffle For Gift Cards Based on Raffle For Gift Cards Based on

““Tickets”Tickets”

TicketsTicketsAttended 2 Statewide Coaches TrainingAttended 2 Statewide Coaches Training

Attended the Feb. 23rd Professional Dev.Attended the Feb. 23rd Professional Dev.

Data In On Time Each MonthData In On Time Each Month

Submitted School for Recognition AwardSubmitted School for Recognition Award

Became A SET TrainerBecame A SET Trainer

Completed More Than One SETCompleted More Than One SET

Your School Obtained a SET of 90% Your School Obtained a SET of 90%

Assisted With Board of Ed PresentationAssisted With Board of Ed Presentation

Your School Already Registered for Summer Your School Already Registered for Summer Institute!!Institute!!

ChallengesChallenges

Giving The “Right” Amount Of SupportGiving The “Right” Amount Of Support

TimeTime

MoneyMoney

High SchoolsHigh Schools

Sustaining The Energy And SupportSustaining The Energy And Support

Ongoing Training Ongoing Training

Favorite Tools for CoachesFavorite Tools for Coaches

www.pbssurveys.orgwww.pbssurveys.orgBOQ (Florida)BOQ (Florida)Coaches Self AssessmentCoaches Self AssessmentImplementation Phase InventoryImplementation Phase Inventorywww.pbismaryland.orgwww.pbismaryland.org– Coach tab, click coaches resourcesCoach tab, click coaches resources

Checklist for Returning Team TrainingChecklist for Returning Team TrainingCoaches Meeting AgendaCoaches Meeting AgendaCoaches Calendar (Colorado, New Hampshire)Coaches Calendar (Colorado, New Hampshire)

For Future ReferenceFor Future Reference

mdwrapil@aol.com (Marla Dewhirst)mdwrapil@aol.com (Marla Dewhirst)

www.pbisillinois.orgwww.pbisillinois.org

sbarrett@pbismaryland.org sbarrett@pbismaryland.org

Karyn_Renneberg@hcpss.orgKaryn_Renneberg@hcpss.org

www.pbismaryland.orgwww.pbismaryland.org