getting organized for data reporting technical assistance for school based teams and coaches series
TRANSCRIPT
Getting Organized for Data Reporting
Technical Assistance for School based Teams and Coaches Series
Objectives
Review the data that is collected on the PBIS Data Collection System
Identify steps for your team to prepare for mid year data collection
PBIS Data Collection System Formal reporting process to obtain outcome and
fidelity data from PBIS schools statewide.
Data is used to assess the status of implementation on a State and AEA level
AEAs are provided with comprehensive data summary and individual school data submitted
Statewide Data Collection
Two reporting periods
Midyear January 2 – 15 Beginning of school –
Dec. 31
End of year May 15 – June 30 Full year
Data Sources
Student Outcome Data
Systems Response Data
Fidelity Data
Definitions Installation/planning
Schools in the first year of training for Tier 1 (2012-13)
Do NOT report in January DO report baseline data in May/June
Implementing Schools trained in 2011-12 and earlier
Taught expectations Defined consequences Applied acknowledgement system Collect and analyze data
Definitions – Con’t
Implementing Tiers 2/3 Trained in essential features of Tier 2 and have
established targeted interventions
Trained in essential features of Tier 3 and have established intensive interventions
Tip #1: Know what you need
Student Outcomes
• # Major ODRs• Triangle Data• ODRs by Subgroups &
IEP• OSS
# of Days # of Events # of Students
• Most frequent location• Most frequent problem
behavior
Systems Response Data
Tier 2• CICO # accessing # responding
Tier 3• Wraparound Services
with SIMEO # accessing # responding
Tip #2:
Don’t agonize…
organize!
Products Book Notebook containing information related to PBIS
implementation in your school Data and artifacts
Templates available http://pbisiowa.wetpaint.com/page/Products+Book
Data Sources in Products Book:School ProfileCohort – group of schools
that were trained in Tier 1 Universal implementation during a specific year
2012-13 2011-12 2010-11 2009-10 2008-09 2002-08
Data is analyzed by cohort
Measure progress and impact over time
Year Month Days Count Referral Count Avg Referrals
2012 Aug 8 0 0.00
2012 Sep 20 1 0.05
2012 Oct 18 22 1.22
2012 Nov 20 0 0.00
2012 Dec 15 0 0.00
2013 Jan 20 0 0.00
2013 Feb 15 0 0.00
2013 Mar 21 0 0.00
2013 Apr 18 0 0.00
2013 May 18 0 0.00
2013 Jun 6 0 0.00
2013 Jul 0 0 0.00
Totals 179 23
Data Sources in Products Book:Big 5 Reports – Avg. ODR /Day/Month
Report thru Dec.
Data point:Total major
ODR
Data Sources in Products Book: Big 5 Reports
Report most frequent thru Dec
Data point:Most frequent
Problem Behavior
Data Sources in Products Book: Big 5 Reports
Report most frequent thru Dec
Data point:Most frequent
Location
Data Sources in Products Book: Big 5 Reports
Data point:Triangle Data
Will require calculating % for each tier.
Data Sources in Products Book:
# All % All # Major % Major # Minor % Minor
Students with 0 Referrals 302 94.38 % 304 95.00 % 316 98.75 %
Students with 1 Referrals 9 2.81 % 9 2.81 % 4 1.25 %
Students with 0 or 1 Referrals 311 97.19 % 313 97.81 % 320 100.00 %
Students with 2-5 Referrals 9 2.81 % 7 2.19 % 0 0.00 %
Students with 6+ Referrals 0 0.00 % 0 0.00 % 0 0.00 %
Students with 9+ Referrals 0 0.00 % 0 0.00 % 0 0.00 %
Data point:Triangle Data
Data Sources in Products Book:
Events Days Students Contributing
In School Suspensions 5 4.00 4
Out of School Suspensions 4 2.00 3
Expulsions 0 0 0
Data point: OSS
Data Sources in Products Books:Other Reports – Ethnicity Table (SWIS)Number of Enrolled
StudentsNumber of Students With Referrals
Percentage of Students Within Ethnicity With Referrals
Am Ind/ Native
5 0 0.00 %
Asian 5 1 20.00 %
Black/ Af Am
56 2 3.57 %
Hisp/ Latino
35 0 0.00 %
Haw/ Pac Isl
3 0 0.00 %
White 166 13 7.83 %
Unknown 0 0 0.00 %
Not Listed 0 0 0.00 %
Multi-racial 50 0 0.00 %
Totals 320 16
13 166 7.8 %
ODR by Subgroup
The number of students with office discipline referrals from each ethnic group is divided by the number of enrolled students in that ethnic group. This allows comparison of rates of referrals across ethnic groups in the school, and provides identification of any ethnic group that is experiencing a proportionally higher rate of referrals.
Also includes students with IEPs who have ODRs.
Can your Data Collection system… Provide a total number of major referrals from
Aug, (beginning of the school year)-Dec. 31?
Yes I don’t know
Can your Data Collection system… Provide triangle data which is the % of
students with 0 – 1, 2 – 5 and 6 or more referrals for Aug – Dec?
Yes I don’t know
Can your Data Collection system… Provide Out of School suspension data and
include # of days, events and students?
Yes I don’t know
Can your Data Collection system… Provide the most frequent problem behavior
and the location of problem behavior?
Yes I don’t know
Can your Data Collection system… Either the number or percentage students
within each subgroup who have ODRs?
Yes I don’t know
If you answered:
Yes – you are in good shape
I don’t know – Contact tech assistance with expertise using the data collection system at your school to provide support prior to the reporting period.
Data Reporting for Tiers 2 and 3
1 # Major ODRs
2 Triangle Data
3 ODRs by Subgroups & IEP
4 OSS # of Days # of Events # of Students
5 Most frequent location
6 Most frequent problem behavior
Universal Assessment: Student Outcome Data
Tiers 2/3 Assessment: Systems Response Data
Systems Response Data
# Students accessing systems supports
# Students responding to the intervention
Data Sources in Products Book:Tier 2/3 Tracking SWIS – CICO feature Excel tracking tool for Tier 2 Interventions
Excel spreadsheet Cumulative totals for both interventions
Wraparound – SIMEO Can use excel spreadsheet for cumulative totals
CICO Student Tracking Tool
** Enter the Student Name in the Numbered Color Cells
Date JuanLean
ne Kiran 4 5 6
9/1/06 45 90
9/2/06 98 90
9/3/06 54 45
9/4/06 55 45
9/5/06 75 56
9/6/06 80 54
9/7/06 75
9/8/06 77
9/9/06 96
Data Resources in Products Book:
Excel Tracking for Semi Annual Reporting:
CICO and Wraparound
Tracking Tool Total
Name August Sept Oct Nov DecAccessing
AResponding
R
Susan A R R R 1 1Bill A R R R 1 1Kay A R R 1 1John A A 1 0Mike A R 1 1jay A R 1 1bob A 1 0jack A R 1 1sally A R 1 1 Total 9 7
WHAT THE DATA LOOKS LIKE…
Putting school data to use
Statewide Data Dashboard Examples:
Who is reporting?
Do outcomes improve over time?
Are interventions effective?
Does fidelity impact outcomes?
Next Steps
Review Semi Annual Reporting Schedule
Set up system so data is ready and available when needed
Identify support you will need to obtain specific data for mid year reporting period
