assessment update rhonda sims, director division of support and research office of assessment and...
TRANSCRIPT
ASSESSMENT UPDATE
Rhonda Sims, Director Division of Support and ResearchOffice Of Assessment And Accountability
Kentucky Department of EducationSeptember 24, 2013
What We’ll be Covering
Timeline for 2013 Reporting What’s included in the School Report
Card (SRC)? Year 2 SRC Review Classifications and Labels
(Rewards/Assistance) Delivery Program Reviews
2
Timeline for 2013 Reporting
Wed.Sept. 25
9 a.m. ET -- Release of embargoed data to districts via the School Report Card 1 p.m. ET -- Release of embargoed data to media
Fri.Sept. 27
12:01 a.m. ET – Embargo liftedPublic release of School Report Card
August Schools received data Quality Review
Data Review for (10 days)ThroughOct. 7
3
School/District/State DataProfilesAssessment ResultsAccountability ClassificationsFederal Accountability/AMOLearning Environment –non-academic datamembershipper pupil spending student demographicsfree/reduced-mealschool safetyDelivery Targets
4
What’s Included in the School Report Card?
attendance rate retention rate dropout rate graduation rate
Assessment Data
K-PREP (Kentucky Performance Rating for Educational Progress) -- Grades 3-8
Scores and performance levels (NAPD)o Readingo Mathematicso Science EXPLORE, PLAN, ACT (Grades 8, 10, 11) Scores and benchmarks End-of-Courseo English II o Algebra II Writing (Grades 5, 6, 8, 10-11) Editing/mechanics (Grades 4, 6, 10 (Plan))
o Social Studieso Writing/mechanics
5
Accountability Data
Next-Generation Learners Achievement Gap Growth Accountability classifications Annual Measurable Objective (AMO) Participation Rate and Graduation Rate Rewards/Assistance
Graduation Rate College/career-readiness
6
Accountability: Year 2 SRC Review
7
Simulated data shown
8
Accountability: Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013
9
Accountability: Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013
10
Accountability: Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013
11
Accountability: Year 2 SRC Review
Simulated data shown
College/Career-Readiness Rate
12
College Ready:Must meet benchmarks on one of the following:
College Ready
ACT
COMPASS
KYOTE
Career Ready: Must meet benchmarks for one requirement in Career Academic area and must meet one requirement inCareer Technical area
Career Ready Academic
Career Ready Technical
Armed Services Vocational Aptitude
Battery (ASVAB)
ACT Work Keys (Applied Math,
Locating information, and Reading
for Information)
Kentucky Occupational
Skills Standards Assessment
(KOSSA)
Industry Certificates
Bonus: College AND Career Ready must meet at least one from each area
College Ready AcademicCareer Ready
Technical
ACT or COMPASS or KYOTE
KOSSA
Industry Certificates
NOTES: (1) By meeting the College Ready Academic definition, the student does not have to take the additional tests of ASVAB or Work Keys for the bonus area. (2) For accountability purposes, the bonus shall not allow the readiness percentageto exceed 100 percent.
KDE:OAA:rls: 9/11/2013
13
Accountability: Year 2 SRC Review
Simulated data shown
Graduation Rate Reminder
Cohort model graduation data is used in the 2012-13 calculation for the Graduation Rate component (20% of high school Next-Generation Learners).
Averaged Freshman Graduation Rate (AFGR) will be used one last time in 2012-13 for graduation rate goals.
Cohort will be used for graduation rate goals moving forward (i.e., 2013-14).
14
15
Accountability: Year 2 SRC Review
Simulated data shown
16
Accountability: Year 2 SRC Review
Simulated data shown
Accountability: Year 2 Classifications and Labels
Needs Improvement (Below 70th Percentile) Proficient (At or Above 70th Percentile) Distinguished (Above 90th Percentile)
Progressing NEW 2013oMeet Annual Measurable Objective (AMO)
goal (1.0 gain in Overall Score below Proficient or .5 gain Proficient and above);
oGraduation rate goal (AFGR); and o Participation rate (95%)
17
High Performing School Top 90% of schools and meets AMO,
graduation rate goal and participation rate goal School of Distinction
Top 95% of schools and meets AMO, graduation rate goal, participation rate goal and has graduation rate above 60% for 2 years
High-Progress NEW 2013Top 10% of improvement and Meet AMO, graduation rate goal (AFGR) and
participation rate (95%)Any other school label can also be labeled High-Progress
18
Accountability: Year 2Rewards Categories
Accountability: Year 2 Assistance Categories Priority (No new Priority Schools added in
2012-13)
Focus (No new Focus Schools added in 2012-13, but new Districts may be added)
oLowest 10% in Overall Gap Group or meets third standard deviation model for a single gap group
19
Accountability: Year 2Locked Proficient & Distinguished Percentiles
Percentiles for Elementary, Middle and High Overall Score were set and locked in 2011-12. The locked percentile serves as the overall score target for 2013 reporting.
70th 90th 95th Elementary Overall Score 62.5 69.8 72.5Middle Overall Score 58.7 64.9 68.2High Overall Score 58.0 64.4 67.7District Overall Score 58.4 63.3 65.2
20
School Report Card Year Two Format Changes Add Trend Data for Profiles Update Graduation Data to show both Cohort & AFGR Add Trend Data for NAPD Tables Add Non-Duplicated Gap Group to list of individual
group scores Add Total Students with Disability (regular and
alternate assessments) Add Level-Based (elementary, middle and high)
data for disaggregated pages Clarify language and footnotes
21
Delivery22
sets yearly targets based upon a 5-year goal to help schools/districts meet state achievement expectations
Simulated data shown
Program Review (PR) Data Release
Tentative Release of School and District Data Date: October 2013
Provided through Open House on KDE website Based on Program Review scores that schools
and districts entered into ASSIST Scores generated using the Program Review
scoring guides/rubrics For accountability, new set of combined goals
for 2014 Date: November 2013
23
Program Review (PR) Scoring Guide24
Program Review Calculations
Each of the 3 Program Review areas (Arts & Humanities, Writing, and Practical Living) is comprised of 4 standards (Curriculum/Instruction, Formative/Summative Assessment, Professional Development, and Administrative Support).Step 1: Average the characteristic scores for a score for each standard.
Scores range from 0-3 for each standard 0–No Implementation, 1–Needs Improvement, 2–Proficient, and
3–Distinguished
Step 2: Add the 4 standard scores to get a single number for each Program Review area.
Scores range 0-12 for each Program Review area The cut score 8 is Proficient and 10.8 is Distinguished
Step 3: Add the three Program Review area scores for a total Program Review score.
Scores range between 0-36
Step 4: Divide the total number by 24 (proficient (8) x 3 areas = 24).
This number yields the percent of the 23 points earned (number of points possible in Unbridled Learning accountability model for PR when Learners and PR are combined).
25
Program Review Data Release
26
CalculationExample
Program Review Data Release Combining Next-Generation Learners and Program Review
Accountability Formula for Combining Next Generation Learners and Program Reviews
Component OverallWeighted Percent
Weighted Score
Next Gen Learners Overall Score
57.9 X 77% = 44.6
Program Reviews 75.0 X 23% = 17.3
Combined Overall
Score* 61.9
27
*Combined Overall Score used to calculate new 70th and 90th percentile cut for summer 2014 targets
Important Resources
KDE website: www.education.ky.gov
28
Important Resources29
ASSESSMENT UPDATE
Rhonda Sims, Director Division of Support and ResearchOffice Of Assessment And Accountability
Kentucky Department of EducationSeptember 24, 2013