FY2015 Teacher Evaluations

State Required and District Selected Student Performance Models

April 2015 CAO

Goals for Today

• Requirements for Student Performance

• Committee Input

• Assessments Used for Student Performance

• Cohort Model

• Rating Distribution Model

FY2015 Student Performance Component Goals

• No additional assessments

• Comply with state requirements

• Provide fair and equitable outcomes

• Provide feedback for improvement

Indicates New in FY2015

FY2015 Committee Input

• Joint Evaluation Negotiation Committee (JENC) – CTA

– District Administration

– Teachers

– Principals

– Teachers

• Student Performance Steering Committee – Elementary, Middle, High School Principals

– Teachers

– District Administrators

District Decisions

• Student Performance Component

–How to apply State VAM for Ratings

– FY2015 assessments to be used

–Model(s) for using assessments

–Which assessment(s) applied to teachers based on grade level, subject area, courses or roles

FY2015 STATE REQUIREMENTS Overall Teacher Evaluation Requirements

Florida Teacher Evaluation System

• Statutory Requirements

– 2011: Established by Student Success Act (SB 736)

– 2013-14: F.S. 1012.34, F.S.1008.22 and S.B. 1664

• Teacher Evaluation Components

– Instructional Practice

– Student Performance Measures

– Professional Job Responsibility

• FY2014 Legislative Impact

– SB 1664: Student Performance components shall be based on the students assigned to teacher

FY2015 Overall Requirements

Components of Teacher Evaluations

• Instructional Practice (58% - 48%)

• Professional Job Responsibilities (2%)

• Student Performance “VAM” (40% - 50%)

– 50% if a teacher has 3 consecutive years of VAM data (reading or mathematics)

– State will provide a combined 3-year score

F.S. 1012.34

FY2015 Overall Requirements

FY2015 Required Statewide Test Data for Teacher Evaluations

• Statewide Value-added Model (VAM) Data

– FSA English Language Arts Grades 4-10

– FSA Math Grades 4-8

– Algebra 1 Grades 8 & 9

S.B. 1664

FY2015 Required Statewide Test Data for Teacher Evaluations

• Other Statewide Assessments Required in FY2015

– FSA English Language Arts Grade 3

– FSA Math Grade 3

– NGSSS Science Grades 5, 8

– Civics, Algebra 2, Geometry, Biology 1, US History

S.B. 1664

FY2015 Required Test Data for Teacher Evaluations

Local Assessment Data may include: 1. Statewide assessments 2. Other standardized assessments, including nationally recognized standardized assessments 3. Industry certification assessments 4. District-developed or district-selected end-of-course assessments. 5. Teacher-selected or principal-selected assessments

Local assessments implemented including, but not limited to,

• project-based assessments,

• adjudicated performances, and

• practical application assignments. FS 1008.22

FY2015 ASSESSMENTS FOR TEACHER EVALUATIONS

Student Performance Component

FY2015 Assessments for Elementary School Teacher Evaluations

Grade Assessment State Required / District Selected

Teacher Performance

Scores

K Early Literacy Behaviors District Selected District

1-2 Palm Beach Performance Assessment (PBPA)

District Developed District

3 Florida Standards ELA Florida Standards Math

State Required District

4-5 Florida Standards ELA State Required State VAM

4-5 Florida Standards Math State Required State VAM

5 FCAT 2.0 Science State Required District

Kindergarten: Early Literacy Behaviors Aug-Oct (PRE) May (POST)

Oral Language 1 = 2 or below

2 = 3 – 4

3 = 5 – 6

4 = 7 – 9

Oral Language

1 = 5 – 6

2 = 7 – 9

3 = 10

4 = 11+

Concepts of Print 1 = 1

2 = 2 – 3

3 = 4 – 5

4 = 6+

Concepts of Print 1 = 7

2 = 8 – 9

3 = 10

4 = 10 Prior May

Combined Letter ID 1 = 6 or below

2 = 7 – 14

3 = 15 – 20

4 = 20+

Combined Letter ID 1 = 18 – 34

2 = 35 – 45

3 = 46 – 50

4 = 51 – 52

Letter Sound 1 = 4 or below

2 = 5 – 8

3 = 9 – 13

4 = 14+

Letter Sound 1 = 9 – 13

2 = 14 – 16

3 = 17 – 18

4 = 19

Word List 1 = 4 or below

2 = 5 - 9

3 = 10 – 24

4 = 25 – 44+

Word List 1 = 10 – 24

2 = 25 – 44

3 = 45 – 55

4 = 56+

Grade 1-2: Palm Beach Performance Assessment

Number of

Points

Scaled

Score

1 – 6 1

7 – 10 2

11 – 14 3

15 – 18 4*

19 – 21 5

22 - 24 6

Grade 1 – Scoring Table

*End of Year Proficiency: Level 4

Number of

Points

Scaled

Score

1 – 10 1

11 – 18 2

19 – 25 3

26 – 32 4*

33 – 38 5

39 – 42 6

Grade 2 – Scoring Table

*End of Year Proficiency: Level 4

FY2015 Assessments for Middle School Teacher Evaluations

Grade Assessment State Required / District Selected

Teacher Performance

Scores

6-8 Florida Standards ELA State Required State VAM

6-8 Florida Standards Math State Required State VAM

7 Civics EOC State Required District

8 Algebra 1 EOC State Required State VAM

8 FCAT 2.0 Science State Required District

FY2015 Assessments for High School Teacher Evaluations

Grade Assessment State Required / District Selected

Teacher Performance

Scores

9-10 Florida Standards ELA State Required State VAM

9 Algebra 1 EOC State Required State VAM

Enrolled Algebra 2 EOC State Required District

Enrolled Geometry EOC State Required District

Enrolled Biology 1 EOC State Required District

Enrolled US History EOC State Required District

11 SAT District Selected District

11-12 FCAT 2.0 Reading Retake District Selected District

DISTRICT DEVELOPED MODEL FOR STUDENT PERFORMANCE RATINGS

Student Performance Component

“Cohort” Model • Pre-test/Post-test Model

• Teachers bracketed into “COHORTS” based on average prior performance of students – Avg. FCAT Reading Level

– Ex: Teacher’s students on average are Level 1

• Teachers compared to District average based on average current performance

• Rating levels aligned based on prior performance of students

• Create teacher rating distributions similar to State VAM (HE, EFF, NI/D, UN)

“Cohort” Model Elementary School Teachers

Post-Test Pre-Test Elementary Literacy Behaviors Elementary Literacy Behaviors

Palm Beach Performance Assessment Palm Beach Performance Assessment

Grade 3 Florida Standards ELA Grade 2 Spring Diagnostic

Grade 3 Math Grade 2 Spring Diagnostic

Grade 5 FCAT 2.0 Science Grade 4 FCAT 2.0 Reading

“Cohort” Model Middle School Teachers

Post-Test Pre-Test Grade 8 FCAT 2.0 Science Grade 7 FCAT 2.0 Reading

Grade 7 Civics Grade 6 FCAT Reading

Geometry Prior Year Math/EOC

“Cohort” Model High School Teachers

Post-Test Pre-Test Algebra 2 EOC Prior Year Math/EOC

Geometry EOC Prior Year Math/EOC

Biology EOC Prior Year FCAT Reading

U.S. History EOC Grade 10 FCAT Reading

FCAT 2.0 Reading Retake Prior Year FCAT Reading

SAT Grade 10 FCAT Reading

Teacher Average Teacher 1 Teacher 2 Teacher 3 Teacher 4 Teacher 5

Stu

de

nt

Sc

ore

s

Stu 1 1 2 3 5 5

Stu 2 2 2 3 5 5

Stu 3 2 2 3 5 5

Stu 4 1 1 2 2 3

Stu 5 1 2 3 5 5

Stu 6 2 2 3 3 3

Stu 7 1 2 3 5 5

Stu 8 2 2 3 5 5

Stu 9 2 2 4 3 3

Stu 10 2 2 3 5 5

Stu 11 1 3 5 5 4

Stu 12 1 3 5 5 4

Stu 13 1 2 3 4 4

Stu 14 1 3 5 3 5

Stu 15 2 2 3 5 5

Stu 16 2 1 2 2 4

Stu 17 1 1 2 2 3

Stu 18 2 2 3 5 5

Stu 19 2 2 3 5 5

Stu 20 1 2 3 5 5

Avg. 1.50 2.00 3.24 4.12 4.53

Q: What is the average prior year performance? A: Average achievement level of students assigned.

Cohort (Pre-Test/Post) Test Model Y

Axi

s: P

ost

-te

st P

erf

orm

ance

X Axis: Pre-test Performance

Cohort 1 Cohort 2 Cohort 3 Cohort 4

HI EFF

EFF

NI/D

UN

Cohort (Pre-Test/Post) Test Model Y

Axi

s: P

ost

-te

st P

erf

orm

ance

X Axis: Pre-test Performance

Cohort 1 Cohort 2 Cohort 3 Cohort 4

HI EFF

EFF

NI/D

UN

Teacher Cohort: Average Performance of

Students on Prior Year Test

Cohort (Pre-Test/Post) Test Model Y

Axi

s: P

ost

-te

st P

erf

orm

ance

X Axis: Pre-test Performance

Cohort 1 Cohort 2 Cohort 3 Cohort 4

HI EFF

EFF

NI/D

UN

Teacher Rating: Average Performance on Current Year Test

ILLUSTRATION OF COHORT MODEL Student Performance Component

Cohort Model Illustration

Performance compared to District Average

Current Year

Avg. Performance of Teacher’s Students Prior Year

Avg. Level 1

(1.0-1.9)

Avg. Level 2

(2.0-2.9)

Avg. Level 3

(3.0-3.9)

Avg. Level 4-5 (4.0-5.0)

HE HE HE HE

HE HE HE EFF

HE HE EFF EFF

HE EFF EFF NI/DEV

EFF EFF NI/DEV UN

EFF NI/DEV NI/DEV UN

NI/DEVE NI/DEV UN UN

UN UN UN UN

PERFORMANCE BANDS FOR CURRENT YEAR --District Average--

Cohort Model Overview

Performance compared to District Average

Current Year

Avg. Performance of Teacher’s Students Prior Year

Avg. Level 1

(1.0-1.9)

Avg. Level 2

(2.0-2.9)

Avg. Level 3

(3.0-3.9)

Avg. Level 4-5 (4.0-5.0)

HE HE HE HE

HE HE HE EFF

HE HE EFF EFF

HE EFF EFF NI/DEV

EFF EFF NI/DEV UN

EFF NI/DEV NI/DEV UN

NI/DEVE NI/DEV UN UN

UN UN UN UN

PERFORMANCE BANDS FOR CURRENT YEAR --District Average--

Cohort Model Overview

Performance compared to District Average

Current Year

Avg. Performance of Teacher’s Students Prior Year

Avg. Level 1

(1.0-1.9)

Avg. Level 2

(2.0-2.9)

Avg. Level 3

(3.0-3.9)

Avg. Level 4-5 (4.0-5.0)

HE HE HE HE

HE HE HE EFF

HE HE EFF EFF

HE EFF EFF NI/DEV

EFF EFF NI/DEV UN

EFF NI/DEV NI/DEV UN

NI/DEVE NI/DEV UN UN

UN UN UN UN

PERFORMANCE BANDS FOR CURRENT YEAR --District Average--

Cohort Model Overview

Performance compared to District Average

Current Year

Avg. Performance of Teacher’s Students Prior Year

Avg. Level 1

(1.0-1.9)

Avg. Level 2

(2.0-2.9)

Avg. Level 3

(3.0-3.9)

Avg. Level 4-5 (4.0-5.0)

HE HE HE HE

HE HE HE EFF

HE HE EFF EFF

HE EFF EFF NI/DEV

EFF EFF NI/DEV NI/DEV

EFF NI/DEV NI/DEV UN

NI/DEVE NI/DEV UN UN

UN UN UN UN

PERFORMANCE BANDS FOR CURRENT YEAR --District Average--

Setting Distributions for Student Performance Ratings

HE 87-100 %

EFF 15% - < 87%

NI/D 2 - < 15%

UN 0 - <2%

Setting Distributions for Student Performance Ratings

Mean Score

-1 SD

-2 SD

+2 SD

+1 SD

2% 14% 34% 34% 14% 2%

Setting Distributions for Student Performance Ratings

Probably more than

others

Different than others

Mean Score

-1 SD

-2 SD

+2 SD

+1 SD

2% 14% 34% 34% 14% 2%

Setting Distributions for Student Performance Ratings

Same as others

Probably more than

others

Different than others

Mean Score

-1 SD

-2 SD

+2 SD

+1 SD

2% 14% 34% 34% 14% 2%

Setting Distributions for Student Performance Ratings

Same as others

Probably more than

others

Probably less than

others

Different than others

Mean Score

-1 SD

-2 SD

+2 SD

+1 SD

2% 14% 34% 34% 14% 2%

Setting Distributions for Student Performance Ratings

Same as others

Probably more than

others

Probably less than

others

Different than others

Different than others

Mean Score

-1 SD

-2 SD

+2 SD

+1 SD

2% 14% 34% 34% 14% 2%

STUDENT PERFORMANCE SCORE TYPES

Student Performance Component

FY2015 Elementary School Teacher Student Performance Score Types

Score Type Description

Elementary Literacy Behaviors (ELB)

• Majority of students in Grades K

Palm Beach Performance Assessment (PBPA)

• Majority of students in Grades 1-2

Grade 3 FSA Reading/Math • Majority of students in Grade 3

FSA Reading/Math VAM • Teach Grade 4-5 ELA/Reading/Math courses

Non-FSA Reading/Math VAM • Do not teach ELA/Reading/Math courses • Teach majority of students in Grades 4-5

Grade 5 FCAT 2.0 Science • Assigned Grade 5 Science course

School VAM • Do not have 10 or more students with scores • More than 1 school assigned, District VAM Score

*Scores may be combined for teachers based on course/grade assignment Based on Survey 2 – 3 match and minimum of 10 students

FY14 Middle School Teacher Student Performance Score Types

Score Type Description

FSA Reading VAM • Teach Grade 6-8 ELA/Reading courses • 10 or more students with FSA VAM scores

FSA Math VAM • Teach Grade 6-8 Math courses • 10 or more students with FSA VAM scores

Non-FSA Reading/Math VAM • Do not teach ELA/Reading/Math courses • Majority of students in Grades 6-8 • 10 or more have Non-FSA VAM scores

Civics EOC • Assigned Civics EOC Course

FCAT 2.0 Science • Assigned Grade 8 Science course

Algebra 1 EOC (Grade 8) • Assigned Algebra 1 EOC Course • 10 or more Grade 8 students with scores

Geometry EOC • Assigned Geometry EOC course

School VAM • Do not have 10 or more students with scores • More than 1 school assigned, District VAM Score

*Scores may be combined for teachers based on course/grade assignment Based on Survey 2 – 3 match and minimum of 10 students

High School Teacher Student Performance Score Types

Score Type Description

FSA Reading VAM • Teach Grade 9-10 ELA/Reading/Math courses

Non-FSA Reading VAM • Do not teach ELA/Reading/Math courses

Algebra 1 EOC (Grade 9) • Assigned Algebra 1 EOC Course

Algebra 2 EOC • Assigned Algebra 1 EOC Course w 10+ students

Geometry EOC • Assigned Algebra 1 EOC Course

US History EOC • Assigned US History EOC Course

Biology 1 EOC • Assigned Biology 1 EOC course

SAT • None of above course assignments • Teach Grade 11 students only

FCAT 2.0 Reading Retakes • None of the above and • Assigned Intensive Reading Grades 11-12

School VAM • Do not have 10 or more students with scores from any above • More than 1 school assigned, District VAM Score

*Scores may be combined for teachers based on course/grade assignment Based on Survey 2 – 3 match and minimum of 10 students

Next Steps

• Monitor Legislative Actions

• Breeze Presentation Format

• Detailed Level Presentations (EL, MS, HS)

• Review Data with Committees

• Committee Work through Summer for FY2016