value-added assessment

31
VALUE-ADDED ASSESSMENT An Accountability Revolution S. Woodring

Upload: swoodring

Post on 21-Jan-2015

794 views

Category:

Education


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Value-Added Assessment

VALUE-ADDED ASSESSMENTAn Accountability Revolution

S. Woodring

Page 2: Value-Added Assessment

What is Value-Added Assessment? Value-added assessment can show

whether particular students, those taking a certain class, have made the expected amount of progress, have made less progress than expected, or have been stretched beyond what they could reasonably be expected to achieve.

http://www.cgp.upenn.edu/ope_value.html#2

Page 3: Value-Added Assessment

How is Value Added Different than traditional measures? Student performance on assessments

can be measured in two very different ways, both of which are important.

Achievement describes the absolute levels attained by students in their end-of-year tests.

Growth, in contrast, describes the progress in test scores made over the school year.

Page 4: Value-Added Assessment

Why should we use the Value- Added theory?

Using the same methods, one can look back over several years to measure the long-term impact that a particular teacher or school had on student achievement.

http://www.cgp.upenn.edu/ope_value.html#2

Page 5: Value-Added Assessment

Problem

Current school accountability systems do not measure growth in student learning and our students are failing to show significant growth.

Page 6: Value-Added Assessment

In the past, students and schools have been ranked solely according to achievement.

The problem with this method is that achievement is highly linked to the socioeconomic status of a student's family.

Page 7: Value-Added Assessment

The failure of public schools to educate America's most disadvantaged students is the country's most glaring and abiding social and moral problem.

Over nearly two decades, a rough national consensus has developed to improve schools by holding them accountable for their students' performance via high-stakes tests.

http://www.washingtonmonthly.com/features/2005/0510.toch.html

Page 8: Value-Added Assessment

In contrast, value-added assessment measures growth and answers the question: How much value did the school staff add to the students who live in its community? How, in effect, did they do with the hand society dealt them?

Page 9: Value-Added Assessment

If schools are to be judged fairly, it is important to understand this significant difference.

Page 10: Value-Added Assessment

What are some of the benefits of the data? diagnostic information can be used

to: Identify effective teachers Identify ineffective teachers Determine where to allocate resources design comprehensive accountability

systems that can assess the impact that particular kinds of teaching, curriculum, and professional development have on academic achievement.

Page 11: Value-Added Assessment

Effective vs. Ineffective Teachers

Value added assessment can be used to separate teachers by effectiveness in quintiles and determine the cumulative impact on student achievement.

Value-Added Concepts & Research with Dr. William Sanders video

Page 12: Value-Added Assessment

Example

5th Grade Math Students assigned to teachers in the top quintile for three consecutive years scored at the 96th percentile.

Page 13: Value-Added Assessment

Example

Conversely, students assigned to teachers in the bottom quintile for three consecutive years scored at the 44th percentile.

Page 14: Value-Added Assessment

Measurement Patterns

Shed Patterns occur when the lowest level of achievers make the greatest gains in the classroom and the highest achievers are held back.

Gain

Previous Achievement

“Shed”

Page 15: Value-Added Assessment

Tee-Pee patterns occur when teachers focus their instruction on the middle (average students) of the class. Average students make the greatest gains and those at the bottom and top realize less of a gain.

Gain

Previous Achievement

“Tee Pee”

Page 16: Value-Added Assessment

June Rivers Study

This study examined the performance of 8th grade students on 9th grade proficiency tests and linked the scores back to performance on 4th grade tests to predict the possibility of passing on the first attempt on the ninth grade test.

Value-Added Concepts & Research with Dr. William Sanders video

Page 17: Value-Added Assessment

Findings

Students from the bottom quartile who were assigned to a sequence of teachers from the top quintile for 4 years had a 60% chance of passing.

Students from the bottom quartile who were assigned a sequence of teachers from the bottom quintile for 4 years had a 15 % probability of passing.

Value-Added Concepts & Research with Dr. William Sanders video

Page 18: Value-Added Assessment

Students from the top quartile who were assigned to a sequence of teachers from the bottom quintile for 4 years had an 80% probability of passing.

Students from the top quartile who were assigned to a sequence of teachers from the top quintile for 4 years had a 90% probability of passing.

Value-Added Concepts & Research with Dr. William Sanders video

Page 19: Value-Added Assessment

How much impact can you have on kids by focusing on academic gain?

Realized Gain

Grade Level 100% 80% 110% 110% 120% 60%

2 2.0 2.0 2.0 1.0 1.0 1.0 3 3.0 2.8 3.1 2.1 2.2 1.8 4 4.0 3.6 4.2 3.2 3.4 2.6 5 6.0 4.4 5.3 4.3 4.6 3.4 6 6.0 5.2 6.4 5.4 5.8 4.2 7 7.0 6.0 7.5 6.5 7.0 5.0 8 8.0 6.8 8.6 7.6 8.2 5.8

Value-Added Concepts & Research with Dr. William Sanders video

Schools

Page 20: Value-Added Assessment

Effective teachers appear to be effective with students of all achievement levels, regardless of the level of heterogeneity in their classrooms.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 21: Value-Added Assessment

If the teacher is ineffective, students under that teacher's tutelage will achieve inadequate progress academically, regardless of how similar or different they are regarding their academic achievement.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 22: Value-Added Assessment

There is a disturbingly common but not universal pattern for the best students to make the lowest gains.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 23: Value-Added Assessment

Possible explanations include a lack of stretch in curriculum and instruction to accommodate the highest achievers and insufficient availability of higher level course offering in all schools.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 24: Value-Added Assessment

Hundreds of studies on ability grouping have been conducted since the 1930s. Study after study finds no positive

effect of ability grouping in any subject or at any grade level, even for the high achievers most widely assumed to benefit from grouping.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 25: Value-Added Assessment

Teachers seem to have far more to do with the academic progress of students than does

the method used for assignment of children to teachers.

Journal of Personnel Evaluation in Education 11: 57±67, 1997

Page 26: Value-Added Assessment

Benefits of using Value-Added nationwide

Using a value-added testing regime could yield at least three important benefits

http://www.ppionline.org/documents/Value_Added_Testing.pdf

Page 27: Value-Added Assessment

It would make ESEA more effective by providing a more accurate picture of which schools, school districts, and states are and are not making progress.

http://www.ppionline.org/documents/Value_Added_Testing.pdf

Page 28: Value-Added Assessment

It would generate objective measures of teacher quality that could be used to improve teaching.

http://www.ppionline.org/documents/Value_Added_Testing.pdf

Page 29: Value-Added Assessment

It would lend itself more readily to evaluating school reform programs.

http://www.ppionline.org/documents/Value_Added_Testing.pdf

Page 30: Value-Added Assessment

Call to Action

Page 31: Value-Added Assessment

Thank you