changing school start times: outcomes evaluation update
TRANSCRIPT
Changing School Start Times:Outcomes Evaluation Update
Presentation to the CCSD Board of Education
Lisa J. Meltzer, Ph.D., CBSMAssociate Professor of Pediatrics
National Jewish Health
Cherry Creek School DistrictAmy Plog Janise McNally Ann DosenDebbie Ricken Javier TrujilloMany others!
University of Minnesota Kyla Wahlstrom
Research Collaborators and Team
Funding: Robert Wood Johnson Foundation, Evidence for Action Grant
National Jewish Health Stephanie Jump Kassie Flewelling
Presentation Overview Change in school start times and goals of outcomes
evaluation
Update on data collection and data sources
Preliminary findings Sleep outcomesMiddle school study sessions Before and after school care
CCSD Change in School Start Times
CCSD Change in Start Times
2016 – 2017 2017 - 2018
Elementary 9:00 a.m. to 3:30 p.m. 8:00 a.m. to 2:45 p.m.
Middle 7:50-8:10 a.m. to 2:50-3:10 p.m. 8:50 a.m. to 3:45 p.m.
High 7:10 a.m. to 2:30-2:51 p.m. 8:20 a.m. to 3:30 p.m.
Goals of Outcomes Evaluation To ensure changes in CCSD provide similar positive
outcomes as existing body of research
To examine impact of change on elementary students
To identify unintended consequences that can be mitigated
Research team formed prior to BOE decision to ensure timely launch of data collection if start times changed
Multi-year evaluation process designed and implemented through partnership between CCSD and NJH
CCSD Evaluation Design Overview Quantitative surveys of students, parents, teachers/staff/
transportation employees Cohort with parent consent to link survey data and district-
level data, as well as linking survey data year-over-year District-level data (i.e., attendance, tardy, test scores) Qualitative data collection with key stakeholders School nurse visits (time of day, presenting problems) Biennial anonymous surveys of health and risk behavior Community data from CDOT and law enforcement
Update on Data Collectionand Data Sources
Sample 2017 (Pre) 2018 (Post)
All Students 25,446 (71%) 30,946 (76%)
Cohort Students 7,097 (28%) 8,487 (27%)
Parents12,733 (28%)
[reporting on 19,388 students]
8,851 (19%)[reporting on
13,955 students]
School Based Staffand Transportation 2,420 (69%) 2,903 (80%)
CCSD Quantitative Surveys
Construct Items Students Parents StaffSt
uden
t
SleepPatterns, quantity, quality, daytime sleepiness, circadian preference
Mood Depression, anxiety, fatigue
Physical Health Physical health, meals, caffeine, drowsy driving
Family Routines Dinner, conversations
ActivitiesSports, activities, homework,employment
AcademicClassroom engagement, first period alertness/preparedness
Adul
t Sleep Quantity, quality Child Care Before/after, school/sitter/family/sibling School/Bus Behavior Behavior, respect, following rules
District Level Data Attendance and first period tardy Schools utilize different codes, so determining how to compare
across district Have to consider session days
Grades First period, compare across types of classes (core, honors,
elective, subject area) Plan to compare across years, 2015 to present Need to consider HS different schedules prior to change (i.e.,
delayed start on Wednesdays)
Qualitative Data Collection Focus groups April 2018 (randomly selected participants) 12 student groups (2 per high school, during lunch hour) Total of 92 sophomore and juniors participated
12 parent groups (4 per level) ES: 24 parents (17 schools); MS: 17 parents (8 schools); HS: 18
parents (6 schools) Groups offered at different times and locations across district
12 teacher groups (4 per level, randomly selected schools) ES: 35 teachers; MS: 32 teachers; HS: 23 teachers
Also analyzing open ended responses from 2018 surveys
Additional District Data Collection Nurses: focus groups, open ended surveys Before and After School: focus groups, open ended
surveys, participation numbers Mental Health Team: open ended surveys Athletics/Activities: coaches, sponsors, directors completed
surveys at end of each season (2017-2018) Attendance for Middle School Supervised Breakfast Climate Safety Wellness Survey: completed in Fall 2018,
will provide anonymous data that can be compared with previous years, including mood, substance use, etc.
School # enrolled in school Approx # Fall (Nov) % Fall Approx #
Winter (Feb) % Winter Approx # Spring (Apr) % Spring
Campus 1480 100 6.8% 25-35 1.7 – 2.4% 50-150 3.4 – 10.1%Falcon Creek 918 10-15 1.0 – 1.6% 20 2.2% 10-25 1.1 – 2.7%
Fox Ridge 1407 7-10 0.05 – 0.07% 12 0.09% 12 0.09%Horizon 956 120 12.5% 20-25 2.1 – 2.6% 5-10 0.05 – 0.1%Infinity 166 4 2.4% 5 3.0% 1-2 0.6 – 1.2%Laredo 1066 5-10 0.05 – 0.09% 20-25 1.9 – 2.3% 40 3.8%Liberty 1138 10-15 0.09 – 1.3% 7-10 0.6 – 0.9% 7-10 0.6 – 0.9%
Prairie 1753 150-200 (up to 240-275 on colder days) 8.6 – 15.7% 150-160 8.6 – 9.1% 150-175 8.6 – 10.0%
Sky Vista 827 40 when door opens, 70 by bell time 4.8 – 8.5% 90-100 10.9 – 12.1% 90-100 10.9 – 12.1%
Thunder Ridge 1317 14-18 1.1 – 1.4% 20-25 1.5% 20-25 1.5%
West 1298 40 (up to 85 on colder days) 3.1 – 6.5% 80-100 6.2 – 7.7% 60-100 4.6 – 7.7%
TOTAL 12,550 500 – 722 4.0 – 5.8% 449 – 517 3.6 – 4.1% 445 – 649 3.5 – 5.2%
Middle School Morning Study Sessions
Before and After School Care Overall enrollment unchanged after change to start/end time
Morning attendance decreased 59% Decrease of 1334 students total (~32 per school)
Total afternoon attendance increased 24% Increase of 542 students total (~13 per school)
Percent of students leaving at 4:30 increased 93% Increase of 510 students total (~12 per school)
Community Level Data Collection Colorado Department of Transportation Crash data, traffic volume, pedestrian safety Compare across years and across counties
Colorado Crime Statistics Citations for shoplifting, vandalism, loitering, fighting,
trespassing, curfew violations Compare across years and across counties
Preliminary Findings
Student Reported Bedtimes and Wake TimesWeekday bedtimes earlier for ES,
slightly later for MS/HS
20.00
20.50
21.00
21.50
22.00
22.50
23.00
3rd 4th 5th 6th 7th 8th 9th 10th 11th
Bed
time
(24-
hour
clo
ck ti
me)
2017 (Pre) 2018 (Post)
Wake times consistent across level (set by start times)
5.00
5.50
6.00
6.50
7.00
7.50
8.00
3rd 4th 5th 6th 7th 8th 9th 10th 11thW
ake
time
(clo
ck ti
me)
2017 (Pre) 2018 (Post)
ES: -23 m MS: +39 m HS: +61 mES: -10 m MS: +8 m HS: +13 m
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3rd 4th 5th 6th 7th 8th 9th 10th 11thW
eeke
nd o
vers
leep
(hou
rs) 2017 (Pre) 2018 (Post)
Student Reported Sleep & Sleep DeficitChanges in sleep driven
by wake time
4.50
5.50
6.50
7.50
8.50
9.50
10.50
3rd 4th 5th 6th 7th 8th 9th 10th 11th
Sle
ep (h
ours
)
2017 (Pre) 2018 (Post)
ES: +15 m MS: -38 m HS: -59 mES: -13 m MS: +31 m HS: +48 m
Significant decrease in adolescent weekend oversleep
Clinically significant oversleep
Cohort and Parent Report of Student SleepCohort (linked) student reported sleep patterns similarNo differences by free/reduced lunch status
Parent report included children grades K-2, nearly identical to student report (weekday and weekend bedtime, wake time, total sleep time, weekend oversleep) Weekday Total Sleep Time (student report) ES: decreased by 12 minutes (-13 minutes) MS: increased by 30 minutes (+30 minutes) HS: increased by 43 minutes (+48 minutes)
Student Report 2017 (Pre) 2018 (Post) Change
Elementary (9 hours) 82.2% 79.1% -3.1%
Middle (9 hours) 37.7% 58.5% +20.8%
High (8 hours) 26.8% 60.8% +34.0%
Percent Students Obtaining Sufficient Sleep
Parent Report 2017 (Pre) 2018 (Post) Change
Elementary (9 hours) 97.9% 96.9% -1.0%
Middle (9 hours) 63.7% 84.9% +21.2%
High (8 hours) 49.9% 82.1% +32.2%
Changes in Daytime Functioning
0.0
5.0
10.0
15.0
20.0
25.0
30.0
35.0
40.0
Elementary Middle High0.0
5.0
10.0
15.0
20.0
25.0
30.0
35.0
40.0
Elementary Middle High0.0
5.0
10.0
15.0
20.0
25.0
30.0
35.0
40.0
Elementary Middle High
Feeling NervousES: 0% MS: -0.4% HS: -4.6% ES: -0.5% MS: -1.6% HS: -6.1%
Feeling WorriedFeeling SadES: -0.6% MS: -2.6% HS: -8.9%
In the Past 7 Days, % of Students Always or Almost Always…
Dark bars are pre-change (2017) and light bars are post-change (2018)
Changes in Daytime Functioning
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
Elementary Middle High0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
Middle High0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
Middle High
Alert First PeriodES: 2.4% MS: -8.2% HS: -18.3% MS: 7.0% HS: 16.0%
Prepared for First Period
Past 7 days, % Students Always/ Almost Always
Too Tired for SchoolworkMS: 8.6% HS: 15.8%
In the Past 7 Days, % of Students At Least Half the Time
Dark bars are pre-change (2017) and light bars are post-change (2018)
Parent and Staff/Transportation SleepParent sleep decreased 6 min for
ES only, increased 12-18 min all other groups
6.60
6.80
7.00
7.20
7.40
7.60
7.80
8.00
ES MS HS ES/MS ES/HS MS/HS All
Sle
ep (h
ours
)
2017 (Pre) 2018 (Post)
ES no change; MS increase 12 min, HS increase 21 min,
Transport increase 6 min
6.60
6.80
7.00
7.20
7.40
7.60
7.80
8.00
ES MS HS Transport
Sle
ep (h
ours
)
2017 (Pre) 2018 (Post)
Sample of Student Quotes Last year I barely came to school. I was way too tired. I would sleep
through all my first periods. I’m doing better in school with the late start times ‘cause last year I
failed Spanish ‘cause I was asleep every day in class. I remember feeling just dead tired all the time last year, and I feel
much better this year, so that’s good. I just feel like everybody is happier, ‘cause everybody gets more
sleep so they are less angry at each other. When you’re coming [to school] in the dark, your brain isn’t really
fully awake and so now that it is light outside…it feels good when we get to school.
Summary Data collection and analysis ongoing Third survey administered February 25 – March 8, 2019 Finishing analyses of focus group and qualitative data Time lag on collection of district and community level data
Preliminary data demonstrate small decrease in sleep for ES, but no change to daytime functioning.
Significant benefits of changing school start times for MS/HS students, parents, and staff
