smarter balanced: test specifications, performance tasks, rubrics, oh my! october 15, 2012portland,...
TRANSCRIPT
Smar
ter B
alan
ced: T
est
Specifi
catio
ns,
Perfo
rman
ce Ta
sks,
Rubrics,
oh M
y!
Octob
er 1
5, 2012
Portl
and, O
R
Rachel A. AazzerahScience and Social Sciences Assessment SpecialistOregon Department of EducationEmail: [email protected]
Audience Survey
Raise your hand if: You work in elementary grades K-5 You work in middle school 6-8 You work in high school You are a TOSA You work in the district office You are a curriculum specialist You are just interested
Using one hand (0-5), show your knowledge of: Common Core Standards Smarter Balanced Assessment in General Smarter Balanced Assessment Performance Tasks
Overview
1. Introduction to Smarter Balanced2. Claims3. Targets4. Test Specifications5. Summative Assessment Item Types6. Performance Tasks7. Rubrics8. Public Release of Sample Smarter Balanced Items9. Resources10. Questions
Introduction to Smarter Balanced
OAKS-Smarter Balanced Assessment Transition Timeline
2011-2012
2012-2013
2013-2014
2014-2015
OAKS OAKS OAKS Smarter
OAKSReading based on 2002 ELA Content StandardsWriting based on current scoring guideMathematics based on 2007/2009 Math Content Standards
Smarter Balanced AssessmentBased on Common Core State Standards adopted by Oregon in 2010
Smarter Item Development
n
Smarter Item Types Overview
TEXT
TEXT
TEXT
TXT
EXT
Claims for Mathematics Summative Assessment
Claim #1
Concepts & Procedures: “Students can explain and apply mathematical concepts and interpret and carry out mathematical procedures with precision and fluency.”
Claim #2
Problem Solving: “Students can solve a range of complex well-posed problems in pure and applied mathematics, making productive use of knowledge and problem solving strategies.”
Claim #3
Communicating Reasoning: “Students can clearly and precisely construct viable arguments to support their own reasoning and to critique the reasoning of others.”
Claim #4
Modeling and Data Analysis: “Students can analyze complex, real-world scenarios and can construct and use mathematical models to interpret and solve problems.”
Smarter ELA Claims
Place text here
Smarter Balanced Assessment Targets
For each of the different claims, Smarter Balanced has developed assessment targets (i.e. assessable content that will be on the summative assessments).
Math: Claim 1- By Grade Level (In Packet)*
Claim 2, 3, 4- Mathematical Practices
(Same for all grade levels)
ELA: Targets by Grade Level for each Claim
SummAtive Assessment Test Specifications
Math
*Computer Adaptive Test (CAT) with SR, CR, TE items
*Performance Task(s)
Given last 12-15 weeks of school year
ELA
*Computer Adaptive Test (CAT) with SR, CR, TE items
*Performance Task(s)
Given last 12-15 weeks of school year
Sample Math Items
*Number Line *Painting a Barn*Soybean Field*Julie’s Jackets*Frogs and Flies
*All sample items are found in the presentation packet.
Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org (Assessments).
Sample ELA Items
*Excerpt from Summer on Wheels (ELA Selective Response Item)
*Sojourner Truth (ELA Technology Enabled Item)*Annie John (ELA Constructed Response Item)
*All sample items are found in the presentation packet
Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org (Assessments).
Guidelines for Development of Smarter Balanced Performance Tasks
Represent content that is relevant and meaningful to students
Allow for demonstration of important knowledge and skills, including such 21st century skills as critically analyzing and synthesizing information presented in a variety of formats, media, etc.
Incorporate knowledge and skills of prior grades, even though the major focus is on the standards for the current grade level.
Allow for multiple points of view and interpretations.
Are scored using multiple rubrics uniquely matched to the primary content claims and targets identified by the task developer in the task forms.
Be feasible for the school/classroom environment.
(From: Smarter Balanced Assessment Consortium: Performance Task Specifications, April 16, 2012)
Performance Tasks
The use of
performance
measures has been
found
to increase the
intellectual challenge
in classrooms
and to support
higher-quality
teaching.
- Linda Darling-Hammond and Frank Adamson, Stanford University
The use of
performance
measures has been
found
to increase the
intellectual challenge
in classrooms
and to support
higher-quality
teaching.
- Linda Darling-Hammond and Frank Adamson, Stanford University
Performance Tasks SummaryPerformance tasks:
should incorporate real-world, college- and career-related skills that require students to accomplish complex goals during multiple testing sessions.
involve a significant interaction of students with stimulus materials leading to an exhibition of the students’ application of knowledge and skills, often in writing or spoken language.
should be multi-stepped and allow for reflection and revision.
are used because the ability to integrate knowledge and skills across multiple content standards is a critical skill that cannot be assessed with selected response or constructed response items.
Math Performance Task Preview
Grade 5:School Festival You serve on a committee that is in charge of planning a school festival. The following tasks need to be completed by committee members as part of the planning for the school festival. • Determine the budget for the festival. • Choose the food and drinks for the festival. • Determine amounts of supplies for making a dessert. • Make a schedule of the different activities. • Make some decisions on the games and prizes used during the festival.
Sample Smarter Math Performance Task Sample Smarter Math Performance Task
* Details and rubrics are in the session packet. Up to two class sessions (90 minutes) are suggested for this task, with no pre-teaching necessary.
ELA Performance Task Preview
Robot Pets Session 1 (60 minutes)
o Read 1 article and watch 2 brief videos on robots as pets, taking notes
o Respond to 3 constructed-response questions: 1 addressing reading comprehension, 2 addressing research skills
Session 2 (45 minutes)o Read 1 article and watch 1 short video, taking noteso Small discussion group work
Session 3 (90 minutes)o Compose full-length argumentative essay on robots as
petso May use notes and refer back to articleso Pre-writing, drafting, and revising will be involved
Sample Smarter English Language Arts Performance Task Sample Smarter English Language Arts Performance Task
ELA Performance Task Preview
Robot Pets Video 1: Fujitsu’s cute teddy-bear robot
shows what it can do, May 2010.http://www.youtube.com/watch?v=AwWeN1ARy74
Video 2: Pleo: Robot, pet or both? December 2007
http://www.youtube.com/watch?v=F6LCEFr8SxQ
Video 3: Maya’s Human Interactionhttp://www.youtube.com/watch?v=9b4jx5RzqAk
Sample Smarter English Language Arts Performance Task Sample Smarter English Language Arts Performance Task
Smarter Generic Writing RubricFive Attributes (4-point scale)
Statement of Purpose/FocusOrganizationElaboration of EvidenceLanguage and VocabularyConventions
Individual scores contribute to the overall score
on the summative assessment
Resources Smarter Balanced Website http://www.smarterbalanced.org/
Smarter Sample Items and Performance Tasks http://www.smarterbalanced.org/smarterbalanced-assessments
/#item
Smarter Item Writing and Review Materialshttp://www.smarterbalanced.org/smarter-balanced-assessments/
item-writing-and-review/
Common Core State Standards Toolkithttp://www.ode.state.or.us/search/page/?id=3430
Common Core State Standards Assessment Resources
http://www.ode.state.or.us/search/page/?id=3298
PUBLIC RELEASE OF SAMPLE SMARTER BALANCED MATH AND ELA ITEMS
*Smarter Balanced will release 60 Math and 60 ELA Sample items (both Computer Adaptive Test items and Performance Tasks) for all grade levels (3-8 and High School (11) on October 9, 2012
http://www.smarterbalanced.org/sample-items-and-performance-tasks/.
*The public will be able to take a sample test, in which they can score some of the questions to see if they answered it correctly or not (rubrics included). http://www.smarterbalanced.org/sample-items-and-performance-tasks-questions-and-feedback/.
Questions
Thank you for attending this presentation!
Rachel Aazzerah: [email protected]
Additional ODE Contacts-
Mark Freed (Math): [email protected]
Ken Hermens (English): [email protected]
Derek Brown (Essential Skills): [email protected]
ODE Webpage: www.ode.state.or.us