problem-solving/rti: application to students with emotional/behavior disorders david wheeler, ph.d....

94
Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University of South Florida FASP 2007

Upload: abigayle-phillips

Post on 27-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders

David Wheeler, Ph.D.George Batsche, Ed.D.

José Castillo, M.A.

University of South Florida

FASP 2007

Page 2: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Rule 6A-6.03016, FAC

(1) Definition. Students with an emotional / behavioral disability (EBD). A student with an emotional/ behavioral disability has persistent (is not sufficiently responsive to implemented evidence-based interventions) and consistent emotional or behavioral responses that adversely affect performance in the educational environment that cannot be attributed to age, culture, gender, or ethnicity.

Page 3: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Assumptions

• Students with emotional/behavioral disabilities demonstrate behaviors that are intense and severe– Intensity - deviation of the behavior (frequency, duration) from general

expectations and peer/cultural/setting norms– Severity - the behaviors continued non-response to evidence-based

interventions delivered with increasing intensity and consistency

• Some students with behavior problems have an emotional/behavioral disability

• Some students with behavior problems display behaviors that are intrusive and disruptive without having an emotional/behavioral disability

Page 4: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Criteria for Special Education Eligibility

• Significant gap exists between student and benchmark/peer performance

• The Response to Intervention is insufficient to predict attaining benchmark

• Student is not a functionally independent learner

• Complete comprehensive evaluation

Page 5: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

“Change is the law of life and those who only look to the past or present

are certain to miss the future.” John F. Kennedy

Page 6: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Paradigm Shift

• Eligibility– Diagnostic/Test &

Place Model

• Improving student outcomes – Problem Solving/

Response to Intervention Model

Page 7: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

IDEA 2004 - 20 U.S.C. § 1400(c)(5)

30 years of research has demonstrated that the education of children with disabilities can be made more effective by . . . providing incentives for whole-school approaches, scientifically based early reading programs, positive behavioral interventions and supports, and early intervening services to reduce the need to label children as disabled in order to address the learning and behavioral needs of such children

Page 8: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

State Board Rule 6A-6.0331

District’s responsibility to address through appropriate interventions and, to the extent possible, resolve a student’s learning or behavioral areas of concern in the general education environment.

Page 9: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

“Every student needs something special in education BUT not every student needs special education.”

Jim Tucker

Page 10: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Getting “help” without labeling children as disabled

• Problem-solving approach

• Multiple tiers of intervention service delivery

• An integrated system of assessment & data collection that informs decisions at each tier

Page 11: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Response to Intervention

Response to Intervention is a multi-tiered, problem-solving approach to providing instruction and intervention to students, at increasing levels of intensity, based on progress monitoring and data analysis.

Page 12: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Three-Tier Model of Behavioral Intervention/Support

Tier III: Intensive, Individual Interventions

Tier II: Targeted Group Interventions

Tier I: Universal Interventions/Supports

80 - 90%

10-15%

1-5%

Page 13: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

How Does it Fit Together?Standard Treatment Protocol

Addl.DiagnosticAssessment

InstructionResults

Monitoring

IndividualDiagnostic

IndividualizedIntensive

weekly

All Students at a grade level

ODRsMonthlyBx

Screening

Bench-Mark

Assessment

AnnualTesting

Behavior Academics

None ContinueWithCore

Instruction

GradesClassroomAssessments

Yearly Assessments

Step 1Step 2 Step 3 Step 4

Supplemental

1-5%

5-10%

80-90%

Core

Intensive

StandardProtocol

Small GroupDifferentiatedBy Skill

2 times/month

Page 14: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem-solving Process

• Problem identification - What is the problem?• Problem analysis - Why is it occurring?• Intervention development & implementation -

What are we going to do?• Response to intervention (evaluation of

effectiveness through progress monitoring) - How effective is the intervention?

Page 15: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

I

II

III

Problem Identification

Problem Analysis

Intervention Design

Responseto

Intervention

Tiers of Problem Solving

Page 16: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Categories of school-based behavior problems

• Problems that respond to interventions – Not eligible for special education

• Problems that do not respond to intensive interventions AND do not constitute a recognized emotional/behavioral disability – Not eligible for special education but require intervention

• Problems that do not respond to intensive interventions AND constitute a recognized emotional/ behavioral disability– Eligible for special education

Page 17: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Importance of emotional/behavioral intervention within an RtI model

• Promotes social/emotional health for all students• Improves school climate and culture • Focus on early intervention/prevention• Assessment linked to intervention• Reduces the number of students “needing” placement• Disproportionality - minorities and males• Maintains students in least restrictive environment

Adapted from E. Runkel’s presentation on Behavioral Assessment & RTI at the NASP 2007 Annual Conference

Page 18: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Three Tier Model of Behavioral Intervention & Positive Support

• Tier I: Universal: School-wide interventions and support

• Tier II: Targeted Group Interventions

• Tier III: Intensive Individual Interventions

Page 19: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Three-Tier Model of Behavioral Intervention/Support

Tier III: Intensive, Individual Interventions

Tier II: Targeted Group Interventions

Tier I: Universal Interventions/Supports

80 - 90%

10-15%

1-5%

Page 20: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Tier I

• Question: How effective is school-wide program?

• Assessment: – Office discipline referrals (ODR)– Disproportionality data & school climate surveys– Screening (mental health & behavior)

• Hypotheses: – Lack of instruction – Lack of positive behavior supports – Inconsistent discipline policy

• Interventions– Identify common behavioral issues & develop school-wide (or whole

class) interventions– Introduce positive behavior supports– Teach prosocial behaviors

Page 21: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

10 - 15%

Tier I: Behavioral Intervention/Support

80 - 90%

Tier I - Assessment Discipline Data (ODR)

Benchmark AssessmentSchool Climate Surveys

Universal Screening

Tier I - Core Interventions School-wide Discipline

Positive Behavior SupportsWhole-class Interventions

Page 22: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

TIER 1: School-Wide Discipline Programs:

Positive Behavior SupportProsocial Discipline Programs

School-wide Discipline CommitteeAttendance Programs

Page 23: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Identifying students at-risk

• Universal screening for social skill competencies/social behaviors/mental health

• Systematic Screening for Behavior Disorder (SSBD)• School Wide Information System (SWIS)• School Archival Records Search (SARS)• BASC Emotional Screening System (BESS)• Classroom observation/Teacher nomination• Parent reported child risk factors• Student reported risk factors/self-identification

Page 24: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Universal Screening - Identifying students at-risk

• Sources of screening data – Academic performance– Discipline data (ODR)– Records – Observation

• Screening Instruments/Systems– School Wide Information System (SWIS)– School Archival Records Search (SARS) – Systematic Screening for Behavior Disorder (SSBD)– BASC Emotional Screening System (BESS)– Social Skills Improvement System (SSIS) Performance

Screening

Page 25: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

10

30

38

30 31

24

30

54

26

18

86

17 16 16

26

29

32

0

10

20

30

40

50

60

August

September

OctoberNovember December

January February

MarchApril May

Month

Number of ODRs

2005-2006 2006-2007

Page 26: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Referral Analysis

• 42% Noncompliance• 30% Off-Task/Inattention• 12% Physical/Verbal

Aggression• 6% Relational

Aggression• 10% Bullying 0

5

10

15

20

25

30

35

40

45

1stQtr

2ndQtr

3rdQtr

4thQtr

NoncomplianceOff TaskAggressionRel AggressionBullying

Page 27: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Building-Level Behavior Data

Behavior Referral Analysis

0

10

20

30

40

50

60

70

80

90

MaleFemale White

HispanicAfrican Am

OtherLow SES

Building

Referred

% Building

% Referred

Male 50% 80%

White 72% 54%

Hispanic 12% 20%

African American 15% 24%

Other 1% 2%

Low SES 25% 50%

Page 28: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Tier II

• Question: How is student functioning compared to expectations? peers?

• Assessment: – Baseline data (intensity of behavior - frequency, duration)– Peer group comparison– Gap analysis

• Hypotheses: – Student has not been taught the skill– Expected behavior is not reinforced in the learning environment

• Interventions– Classroom-based behavioral interventions– Small-group, targeted interventions

Page 29: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Tier II: Behavioral Intervention/Support

Tier II - Targeted InterventionsTargeted Group Interventions

Social Skills TrainingSmall Groups

Tiered Discipline Programs

80 - 90%

10-15%

Tier II - AssessmentBehavioral Observations

Intervention Data (peer group comparison)

Tier I - Core InterventionsTier I Assessment

Page 30: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

TIER 2: StrategicStrategic/Supplemental Behavior Programs:

• Small Group SST• Anger Control Training

• Peer/adult mentoring program• Tiered discipline program

(e.g., positive rehearsal, time out)

Page 31: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

0

10

20

30

40

50

60

70

80

90

100

Jan Feb Mar Apr May

% Wait for Turn

Benchmark75%

30 %

42%

74%

58%

Baseline

33%

37% 37%40%

42%

Class-Wide Social Skills Training

49%

65%62%

67%

70%

62%

79%75%

73%

79%82%

86% 85%

90%92%

(+3%) (+4%)

(+0%) (+3%)

(+2%)

Page 32: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Outcome?

• Rate of Peer Performance?– 82-58= 58/24 or 2.42

• Rate of Target Student Performance?– 42-27= 27/15 or 1.80

• Type of Response to Intervention?– Peer??– Student??

• Intervention Effectiveness Decision?

Page 33: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Raphael's Compliance

0

10

20

30

40

50

60

70

80

90

100

% of on task behavior

78.3%

61.6%

81.6%

31.6

Jan

Baseline

Benchmark

Feb March April May

RTI -5% per wk.

RTI + 4.8% per wk

Tier One

Aimline

RTI +2.7% per wk.

89%

75%

96.%

42.5

RTI + 2.6%per wk.

Page 34: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Tier III

• Question: What is the student’s response to evidence-based interventions?

• Assessment: – Functional Behavior Assessment - prior to interventions– Response to Intervention data with graph

• Hypotheses: – Focus on child-specific issues in problem-solving

• Interventions– Behavior intervention plan - based on FBA– Assessing quality/intensity of interventions

Page 35: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Tier III of Behavioral Intervention/Support

Tier II Targeted Interventions

80 - 90%

10-15%

1-5%

Tier I Core InterventionsTier I Assessments

Tier II Assessments

Tier III: Individualized InterventionsBehavior Intervention Plan

Individual CounselingSelf-Monitoring

In-school Alternative Education

Tier III: AssessmentsFBA

Progress Monitoring Graph

Page 36: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

TIER 3: INTENSIVE Behavior Programs

• Individual counseling/therapy• Individual Behavior Plan

• Rapid Response • In-school alternative education

• Frequent, daily mentoring

Page 37: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Academic Systems Behavioral Systems

1-5%

Tier 3: Comprehensive and Intensive InterventionsIndividual Students or Small Group (2-3)Reading: Scholastic Program,

Reading,Mastery, ALL, Soar to Success, Leap Track, Fundations

1-5%

Tier 3: Intensive InterventionsIndividual CounselingFBA/BIPTeach, Reinforce, and Prevent (TRP)Assessment-basedIntense, durable procedures

5-10%Tier 2: Strategic InterventionsStudents that don’t respond to the core curriculumReading: Soar to Success, Leap Frog, CRISS strategies, CCC Lab Math: Extended DayWriting: Small Group, CRISS strategies, and “Just Write Narrative” by K. Robinson

5-10% Tier 2: Targeted Group InterventionsSome students (at-risk)Small Group CounselingParent Training (Behavior & Academic)Bullying Prevention ProgramFBA/BIP Classroom Management Techniques, Professional Development Small Group Parent Training ,Data

80-90%Tier 1: Core CurriculumAll studentsReading: Houghton MifflinMath: HarcourtWriting: Six Traits Of WritingLearning Focus Strategies

80-90% Tier 1: Universal InterventionsAll settings, all studentsCommittee, Preventive, proactive strategies, School Wide Rules/ Expectations Positive Reinforcement System (Tickets & 200 Club) School Wide Consequence System School Wide Social Skills Program, Data (Discipline, Surveys, etc.) Professional Development (behavior)Classroom Management Techniques,Parent Training

Three Tiered Model of School Supports:Anclote Elementary-Pasco County

Students

Page 38: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Intervention Support

• Intervention plans should be developed based on student need and skills of staff

• All intervention plans should have intervention support • Principals should ensure that intervention plans have

intervention support • Teachers should not be expected to implement plans

for which there is no support

Page 39: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Critical Components of Intervention Support

• Support for Intervention Integrity

• Documentation of Intervention Implementation

• Intervention and Eligibility decisions and outcomes cannot be supported in an RtI model without these two critical components

Page 40: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Intervention Support

• Pre-meeting– Review data– Review steps to intervention– Determine logistics

• First 2 weeks– 2-3 meetings/week– Review data– Review steps to intervention– Revise, if necessary

Page 41: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Intervention Support

• Second Two Weeks– Meet twice each week

• Following weeks– Meet at least weekly– Review data– Review steps– Discuss Revisions

• Approaching benchmark– Review data– Schedule for intervention fading– Review data

Page 42: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 43: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem-Solving Process Applied to E/BD

Page 44: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem solving - levels of analysis

• Student

• Class

• School

• District

• State

I

II

III

Page 45: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem-solving protocol

• Identify target & replacement behavior• Identify peer group for comparison

– Collect baseline & progress monitoring data (frequency, duration)

– Gap analysis - compare student to peer group and expectation

• Determine function of the behavior (FBA)• Develop/Implement interventions based on FBA (BIP)• Monitor/Evaluate/Modify interventions based on data

– Document response to intervention – Problem solving continues based on response to

intervention

Page 46: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Documenting response to intervention

• Benchmark/Expectation

• Student’s level of performance

• Peer performance

• Aimline

• Trendline

Page 47: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

0

10

20

30

40

50

60

70

80

90

100

Sept Oct Nov Dec Jan Feb

% Compliance

35%

Benchmark75%

= Peer Group = Aim Line

BASELINE

Page 48: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Evaluating the response to intervention - GAP Analysis

• What is the deficit in initial level?

• What is deficit in slope or rate of progress?

• How does the student compare to peers (students of similar age, gender, culture, & ethnicity)?

Page 49: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Tier 1 —Universal Interventions

25 2328

3540

45

0

10

20

30

40

50

60

70

80

90

100

Sept Oct Nov Dec Jan Feb

% Compliance

• School-Wide Positive Behavior Support

• Grade Level Social Skill Training

35%

50%

55%

60%

Benchmark75%

= Peer Group

= Target Student

= Aim Line

= Trend Line

Page 50: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Types of responses to intervention

• Positive response– Gap closing at acceptable rate

• Questionable response– Gap maintained or is closing at unacceptable rate

• Poor response– Gap widens

Page 51: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Intervention decisions based on RtI

• Positive response– Continue intervention– Modify intervention intensity or fade

• Questionable response– Increase intensity of intervention - freq/time/focus– Monitor more frequently (at least weekly)

• Poor response– Revisit problem solving– Significantly modify current or develop new intervention

Page 52: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Evaluating the effectiveness of the intervention

• Is the intervention evidence-based?

• How “intense” is the intervention?

• What can we “expect” the intervention to do?

• Was the intervention implemented as planned?

• How effective is this intervention with students from similar backgrounds?

Page 53: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 54: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Data Issues

• Data collection– What is collected? Who is responsible for collecting? – How frequently is data collected? How is the data used?

• Data display - necessary to evaluate RtI– Graph - Benchmark, Aimline, Trendline– Disaggregate - grade, gender, race, ELL, SES

• Data Management – AIMS-WEB, Wireless Generation– Local Programs– Chart Dog

Page 55: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 56: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 57: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 58: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Case example . . . Victor

Page 59: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Problem Identification - Baseline data

Benchmark Level 75%

Current Level 27%

Peer Level 42%

Page 60: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 61: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Assess effectiveness of universal supports

• Gap analysis– Student and benchmark: 75/27 = 2.8– Student and peers: 42/27 = 1.5

• Effectiveness of core supports– Not effective for male peers

• Intervention decision: focus on Tier I– Grade-level social skills training 2x weekly

Document effectiveness of Tier I interventions & supports before moving to Tier II

Page 62: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 63: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Assess effectiveness of universal behavior supports at Tier I• Gap analysis

– Gap between student and benchmark: 75/11 = 6.8– Gap between student and peers: 71/11 = 6.5

• Effectiveness of core interventions– Is the gap closing?– Response to intervention?

• Intervention decision: move to Tier II interventions– Hypothesis - Victor is not complying to teacher requests

because he lacks social skills– Intervention - small group social skills training for 30 minutes

a day

Page 64: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 65: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Assess effectiveness of targeted group interventions at Tier II• Gap analysis

– Student and benchmark: 75/43 = 1.7– Student and peers: 80/43 = 1.9

• Effectiveness of targeted group intervention– Is the gap closing? – Response to intervention?

• Intervention decision: move to Tier III interventions– Multiple Hypotheses – ICES by RIOT– Interventions - Tier I + II + III

Page 66: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 67: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Assess effectiveness of intensive individual interventions at Tier III

• Gap analysis– Student and benchmark: 75/69 = 1 – Student and peers: 85/69 = 1.2

• Effectiveness of intensive individual interventions– Is the gap closing?– Response to intervention?

• Intervention decision– Does Victor require special education services?

Page 68: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

IDEA Eligibility Evaluation

• IDEA definition of “evaluation” (§300.15) - procedures used to determine whether a child has a disability AND the nature and extent of special education needs

• What constitutes an evaluation? CFR §300.305– Review of existing evaluation data

• Evaluations and information provided by the parent• Current classroom-based, district, or state assessments, and

classroom-based observations • Observations by teachers and related service providers

– Identify what additional data (if any) are needed to determine if the student is a student with a disability and to determine the educational needs

Page 69: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

IDEA Evaluations - §300.304

• Evaluation Procedures – Use variety of assessment tools and strategies – Not use any single measure as the sole criteria for

determining eligibility– Use technically sound instruments

• District responsibility– Not discriminatory (selection & administration) – Used for purposes for which the assessment is valid and

reliable– Administered by trained and knowledgeable personnel– Administered in accordance with publisher’s instructions

Page 70: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Where is requirement for RtI?

• Rule 6A-6.0331– Interventions must include a progress monitoring plan and

pre/post measures of intervention effects.– Parent conferences must include discussion of student’s

responses to interventions.• E/DB Rule

– Persistent defined in RtI language - not sufficiently responsive to evidence-based interventions

• Draft Administrative Rules• RtI embedded in NCLB and IDEA 2004

– Student outcomes– Data-driven accountability– Use of evidence-based interventions

Page 71: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

When should an eligibility evaluation be initiated?

• There is evidence of effective core supports– 90 - 95% of students successful in Tier I/II

• There is evidence of effective targeted and individual interventions– Interventions effective with 70% of students at Tier II/III

• The intensity of behaviors persist given evidence-based, individual interventions implemented with fidelity (Tier III)

• Purpose of evaluation is to assist in determining – whether behaviors constitute an emotional/behavioral

disability and – the educational needs of the student

Page 72: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University
Page 73: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Tier III of Behavioral Intervention/Support

Tier II Targeted InterventionsTargeted Group Interventions

Social Skills TrainingSmall Groups

80 - 90%

10-15%

1-5%

Tier I Core InterventionsSchool-wide Discipline

Positive Behavior SupportsWhole-class Interventions

Tier I AssessmentsDiscipline Data (ODR)

Benchmark AssessmentUniversal Screening

Tier II AssessmentsBehavioral Observations

Intervention Data Gap Analysis

Tier III: Individualized InterventionsBehavior Intervention Plan

Individual CounselingSelf-Monitoring

Tier III: AssessmentsFBA

Progress Monitoring Graph/RtI(Eligibility Assessment)

Page 74: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

RIOT/ICEL Matrix

Review Interview Observe Test

Instruction(Intervention)

Curriculum(School-wide Program)

Environment

Learner

Page 75: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

RIOT

• Review - looking at records & products

• Interview - talking to people who know the student

• Observe - watching what occurs in the instructional setting

• Test - having students perform skills in structured format

Page 76: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

ICEL

• Instruction - how content is presented (teaching)

• Curriculum - what is taught (content)

• Environment - physical setting where instruction occurs

• Learner - student variables

Page 77: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

RIOT/ICEL Matrix Applied to E/BD

Review Interview Observe Test

Instruction(Intervention)

Curriculum(School-wide Program)

Environment

Learner

Page 78: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

80 - 90%

10 - 15%

1 - 5%

Tier III of Behavioral Intervention/Support

Tier II Targeted InterventionsTargeted Group Interventions

Social Skills TrainingSmall Groups

80 - 90%

10-15%

1-5%

Tier I Core InterventionsSchool-wide Discipline

Positive Behavior SupportsWhole-class Interventions

Tier I AssessmentsDiscipline Data (ODR)

Benchmark AssessmentUniversal Screening

Tier II AssessmentsBehavioral Observations

Intervention Data Gap Analysis

Tier III: Individualized InterventionsBehavior Intervention Plan

Individual CounselingSelf-Monitoring

Tier III: AssessmentsFBA

Progress Monitoring Graph/RtI(Eligibility Assessment)

Page 79: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Universal Screening

• Sources of screening data – Academic performance– Discipline data (ODR)– Records – Observation

• Screening Instruments/Systems– School Wide Information System (SWIS)– School Archival Records Search (SARS) – Systematic Screening for Behavior Disorder (SSBD)– BASC Emotional Screening System (BESS)– Social Skills Improvement System (SSIS) Performance

Screening

Page 80: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Multi-dimensional E/BD Assessment

• Multiple methods– Observation– Interview– Standardized Rating Scales

• Multiple sources– Parent– Teacher– Student

• Multiple settings– School (within school)– Home

Page 81: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Components of E/BD Evaluation (SP&P)

• Functional behavioral assessment - general ed interventions (Tier II/Tier III)

• Psychological evaluation

• Social-developmental history

• Educational evaluation

• Medical evaluation - when determined necessary by ESE Director or designee

Page 82: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Functional Behavioral Assessment

• Description of target/replacement behavior (Problem identification)

• Identification of environmental factors that may contribute to the behavior (Problem analysis)

• Determination of function of behavior (Problem analysis)

• Development of hypotheses regarding the function or purpose of the behavior (Problem analysis)

• Development of positive interventions in a written plan (BIP) - (Intervention design/implementation)

• Evaluation (Progress monitoring/RtI)

Page 83: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

FBA Assessment Tools

• Architext - Pearson • Conducting School Based Functional Behavioral

Assessments - Watson & Steege, 2003• Four-Step Model Functional Behavioral Assessment

Skiba, et al., NASP Communiqué, May 1998 • Functional Assessment Interview Form (FAI) - O’Neill

et al., 1997• Functional Assessment and Intervention System

(FAIS) - Stoiber, 2004• Functional Behavioral Assessment and Behavioral

Intervention Plans - FLDOE, 1999 TAP (FY 1999-3)

Page 84: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Psychological Evaluation

• Assessment procedures identifying the internal or external factors that constitute an emotional/behavioral disability– Behavioral observations– Clinical interview– Assessment of emotional/behavioral functioning

• Information on developmental functioning and skills as needed - an intellectual evaluation is not required

• Identify the evidence-based interventions implemented and the criteria used to evaluate the student’s response to intervention

Page 85: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Observation Systems

• Academic Engaged Time Code (AET-SSBD) • Behavioral Observation of Students in Schools

(BOSS)• Direct Observation Form (DOF) - ASEBA• State-Event Classroom Observation (SECOS)• Student Observation System (SOS) - BASC-II

Portable Observation Program

Volpe, et al. (2005) Observing Students in Classrooms: A Review of Seven Coding Schemes. School Psychology Review.Hintze et al. (2002). Best Practices in the Systematic Direct Observation of Student Behavior. Best Practices in School Psychology IV.

Page 86: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Clinical Interviews

• Children’s Interview for Psychiatric Syndromes (ChIPS)

• Semi-structured Clinical Interview for Children and Adolescents (ASEBA)

• Semi-structured Parent Interview and Structured Diagnostic Interview for Parents (McConaughy)

• Social-Developmental History (BASC-2)

McConaughy (2005). Clinical Interviews for Children and Adolescents.

Page 87: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Rating Scales

• Achenbach System of Empirically Based Assessment (ASEBA)

• Beck Youth Inventories, Second Edition (BYI-II)• Behavior Rating Inventory of Executive Function (BRIEF)• Behavior Assessment System for Children, Second Edition

(BASC-II)• Clinical Assessment of Behavior (CAB)• Emotional Disturbance Decision Tree (EDDT)• Personality Inventory for Children, Second Edition (PIC-2)

& (PIY)• Social Skills Rating System (SSRS)

Page 88: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Social-developmental History

• Structured interview with parent • Appraisal of interpersonal, familial, and environmental

factors impacting learning & behavior – Family composition and dynamics– Educational history– Health and developmental history– Emotional and behavioral status– Environment and cultural influence

• Address factors that extend beyond the school setting

Page 89: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Educational Evaluation

• Review educational history and current academic performance (e.g., state & district assessments, progress monitoring data, classroom performance, previous educational assessments)

• Address relationship between academic performance and emotional/behavioral disability

• Complete a formal academic evaluation if there is insufficient information or if academic performance data is not current

Page 90: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Behavioral Assessment and Diagnostic Issues

• Validity and reliability of instruments

• Differential diagnosis

• Base rates

• Sensitivity

• Specificity

Page 91: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

The eligibility evaluation must document:

• Response to evidence-based interventions implemented with fidelity (intensity/severity of the behavior)

• Behaviors constitute an emotional/ behavioral disability (meet criteria for recognized emotional and/or behavior disability)

• Exclusionary factors do not explain emotions/behavior• Need for special education & related services

Page 92: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Intervention Implementation with IEP

• Continue progress monitoring (RtI) and problem solving

• Intervention implementation on IEP should identify:– The most effective interventions (not simply those that are

“available” or tied to a particular setting (e.g., EBD “room”)– Least Restrictive Environment (LRE) in which those

interventions will be successful– Personnel qualified to deliver the interventions– Setting(s) which offers the greatest potential for integration

with typical peers.

Page 93: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Web Resources

• Florida Problem-Solving/Response to Intervention Project http://www.floridarti.usf.edu/

• Florida Positive Behavior Support Project http://flpbs.fmhi.usf.edu/

• Intervention Central www.interventioncentral.org• Managing On-site Discipline for Effective Learning

http://www.modelprogram.com/• OSEP Technical Assistance Center on Positive Behavior

Supports http://www.pbis/• The National Association of School Psychologists

www.nasponline.org• The IRIS Center http://iris.peabody.vanderbilt.edu/

Page 94: Problem-Solving/RtI: Application to Students with Emotional/Behavior Disorders David Wheeler, Ph.D. George Batsche, Ed.D. José Castillo, M.A. University

Other resources

• Practitioner’s edition on promoting behavioral competence. Psychology in the Schools, Vol 44 (1) 2007.

• School Psychology Forum: Research in Practice. Vol 1 (2) 2007.

• Mini-Series: Current Perspectives on School-based Behavioral interventions. School Psychology Review, Vol 33 (3) 2004.

• Mini-Series: Direct observation assessment of student Behavior. School Psychology Review, Vol 34 (4) 2005.

• Howell & Nolet (2000). Curriculum-based evaluation (Chap 13 - Social Skills).

• Rutherford, Quinn, & Mathur (Eds.) (2004). Handbook of research in emotional and behavioral disorders.