using mars assessments overview understanding student performance

Using MARS assessments

OverviewUnderstanding student performance

CST – Released Items Algebra 1

The design of scaffolded performance assessment tasks

Core Ramp

Access

Top

Core

Apprentice Task

Performance AssessmentsTo Inform Instruction And Measure Higher Level Thinking

• The Mathematics Assessment Resource Service (MARS) is an NSF funded collaboration between U.C. Berkeley and the Shell Centre in Nottingham England.

• The Assessments target grades 2- Geometry and are aligned with the State and NCTM National Math Standards.

RampAccess

Top

Core

Entry level (access into task)Core Mathematics - (meeting standards)Top of Ramp (conceptually deeper, beyond)

Task Design

Student tests are hand scored by classroom teachers trained and calibrated using standard protocols.

Students in grades 2 through 10th/11th grade are administered performance exams (5 apprentice tasks per exam).

District scoring leaders are trained in using task specific rubrics

Student results are collected, analyzed, and reported by an independent data contractor.

Random sample of student papers are audited and rescored by SJSU math & CS students. (Two reader correlation >0.95)

Performance Exams40,000 – 70,000 students per year since 1999

MAC vs. CST 2012

Silicon Valley Mathematics InitiativeMathematics Assessment Collaborative

Performance Assessment Exam 2012

MAC vs CST 20122nd Grade MAC Level 1 MAC Level 2 MAC Level 3 MAC Level 4

Far Below Basic 1.0% 0.3% 0.1% 0.0%Below Basic 1.9% 2.4% 1.2% 0.0%

Basic 1.3% 4.8% 5.5% 0.3%Proficient 0.4% 3.5% 17.7% 3.4%

Advanced 0.3% 0.9% 23.4% 31.4%

2nd Grade MAC Below MAC At/Above Total

CST Below 11.7% 7.1% 18.8%

CST At/Above 5.1% 75.9% 81.0%Total 16.8% 83.0% 100%

3rd Grade MAC Below MAC At/Above Total

CST Below 15.9% 5.2% 21.1%CST At/Above 13.7% 65.4% 79.1%Total 29.6% 70.6% 100%

4th Grade MAC Below MAC At/Above Total

CST Below 16.9% 2.8% 19.7%CST At/Above 20.3% 60.0% 80.3%Total 37.2% 62.8% 100%

5th Grade MAC Below MAC At/Above Total

CST Below 20.6% 3.8% 24.4%CST At/Above 18.7% 56.9% 75.6%Total 39.3% 60.7% 100%

Elementary Grades

Middle School

6th Grade MAC Below MAC At/Above Total

CST Below 37.2% 1.4% 38.6%CST At/Above 25.1% 36.5% 61.6%Total 62.3% 37.9% 100%

7th Grade MAC Below MAC At/Above Total

CST Below 33.3% 2.1% 35.4%CST At/Above 27.4% 37.1% 64.5%Total 60.7% 39.2% 100%

Course 1 MAC Below MAC At/Above Total

CST Below 34.5% 3.6% 38.1%CST At/Above 30.3% 31.5% 61.8%Total 64.8% 35.1% 100%

8th Graders Taking HS Geometry

Course 2MAC

BelowMAC

At/Above Total

CST Below 3.1% 0.8% 3.9%CST At/Above 51.3% 44.8% 96.1%

Total 54.4% 45.6% 100%

Use of Formative Assessment

Research suggested that attention to the use of assessment to inform instruction particularly at the classroom level in many cases effectively doubled the speed of student learning.

Five elements of using assessment to inform learning

• The provision of effective feedback to students

• The active involvement of students in their own learning

• The adjustment of teaching to into account the results of assessment

Five elements of using assessment to inform learning

• The recognition of the profound influence assessment has on the motivation and self-esteem of students, both of which are crucial influences on learning

• The need for students to be able to assess themselves and understand how to improve

The teacher’s job is not to transmit knowledge. It is to engineereffective learning environments for students. The features of effective environments are that they create student engagement andAllow teachers, learners, and their peers to ensure that learning isProceeding in the intended directions.

Bell and Swan study

An important technique for helping students understanding learning intentions and success criteria is asking them to look at samples of other students’ work and to engage in a discussion about the strengths and weaknesses of each.

Students are much better at spotting errors and weaknesses in the work of others than they are in their own.

Putting Principals into Practice

Mathematical Practices

• Attend to precision. -use clear definitions• Construct viable arguments and critique the

reasoning of others.Briefly: Think of a definition for perimeter. Share

with a neighbor.

Marco thinksPlan C has a larger perimeterthan Plans A and B. Explainwhy Marco iswrong.

Look at sample work and engage in discussion about strengths and

weaknesses

“Marco probably counted. But he counted wrong.”

“How could this explanation be improved? What is missing to make it convincing?”

Getting students engaged

“Plan A and B have bigger areas, so they have bigger perimeters.”

Do you agree or disagree? Is this sometimes true, always true, or never true?

Understanding Learning Trajectory and a Variety of Strategies

Jade sold only Peanut Butter Cookie Dough. She raised $32. How manyTubs did she sell?

What do you think the student is doing?What do the lines represent? What do the numbers represent? Does it makesense?

This helps lay the foundation for proportional reasoning at later grades, for understanding input/output tables,for making graphs.

Understanding Learning Trajectory Situating the mathematics of the task in the learning

trajectory for number and data: At earlier grade levels students have been learning about data collection and representation in the form of bar graphs. At this grade level students are extending the ways of displaying data to include line plots. In second and third grade students have been successfully thinking about most and least and using comparison subtraction to find the how many more. Also at third grade students have started to expand their ideas about number to include fractions, as parts of a whole, and use rulers to measure with fractions.

Understanding Learning Trajectory

At this grade level students are starting to decompose a fraction into a sum of its parts and add and subtract fractions. At later grades students will learn algorithms for adding and subtracting fractions. Students will perform more complex analysis of data to look at mean, median, mode and range.

Asking a Question that gives Insight into learning

Promote learning/ push thinking

“As teachers we are not interested in our students’ ability to do what we have taught them to do. We are only interested in their ability to apply their newly acquired knowledge to a similar but different situation.”

Asking a Question that gives Insight into learning

How much longer was the longest wingspan from the shortest?

Understanding Place Value and Subtraction

What does a student need to understand to use this process?What principals remain in place from subtraction with whole numbers?

Understanding Place Value and Subtraction

What principals about subtraction doesn’t the student understand?

Understanding Place Value and Subtraction

What is going on in the diagram? Where do the numbers comefrom? Does this make sense?

Use of Formative Assessment

Research suggested that attention to the use of assessment to inform instruction particularly at the classroom level in many cases effective doubled the speed of student learning. So, I sincerely hope that you take what we’ve learned, the tools we developed, and use the tasks this year to inform instruction.

Suggestions for Getting Started

• Have staff try some former tasks in classrooms and use staff meetings to use the “Tools for Teachers” to think about implications for instruction and design re-engagement lessons.