![Page 1: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/1.jpg)
Anthony Quan
A Closer Look at the SMARTER Balanced Assessments:Preparing for Elementary Mathematics
[email protected] Education Program, UCLA
![Page 2: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/2.jpg)
Agenda:
Item Types Depth of Knowledge Technology Next Steps
![Page 3: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/3.jpg)
Try This
![Page 4: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/4.jpg)
Assessment Items
• Multiple choice/Selected response• Short-answer• Constructed response• Extended response• Performance Events• Technology-enhanced
![Page 5: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/5.jpg)
Depth of Knowledge
“He who learns but does not think, is lost.
He who thinks, but does not
learn is in great danger.”
Confucious
![Page 6: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/6.jpg)
Depth of Knowledge (DOK)No Child Left Behind (NCLB) requires assessments to “measure the depth and breadth of the state academic content standards for a given grade level”. (U.S. Department of Education, 2003, p. 12)
![Page 7: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/7.jpg)
What is Depth of Knowledge (DOK)?
• A scale of cognitive demand (thinking) to align standards with assessments
• Based on the research of Norman Webb, University of Wisconsin Center for Education Research and the National Institute for Science Education
• Defines the “ceiling” or highest DOK level for each Core Content standard for the state assessment
• Guides item development for state assessments
![Page 8: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/8.jpg)
DOK is about complexity
• The intended student learning outcome determines the DOK level.
• Every objective in the science and mathematics frameworks has been assigned a DOK level.
• Instruction and classroom assessments must reflect the DOK level of the objective or intended learning outcome.
![Page 9: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/9.jpg)
Depth of Knowledge
• Level 1• Conduct basic mathematical calculations• Label locations• Perform routine procedures
• RECALL• Determine the perimeter or area of
rectangles given a drawing or labels
![Page 10: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/10.jpg)
Depth of Knowledge
![Page 11: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/11.jpg)
Depth of Knowledge
• Level Two• Solve routine multiple-step problems• Identify patterns• Organize, represent and interpret data
• SKILLS AND/OR CONCEPT• Classify plane and three dimensional figures
![Page 12: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/12.jpg)
![Page 13: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/13.jpg)
Depth of Knowledge
• Level Three• Apply a concept in other contents• Support ideas with details and examples
• STRATEGIC THINKING• Solve a multiple-step problem and provide
support with a mathematical explanation that justifies the answer
![Page 14: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/14.jpg)
![Page 15: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/15.jpg)
Depth of Knowledge
• Level Four• Apply mathematical model to illuminate a
problem or situation.• Analyze and synthesize information from multiple
sources• Design a mathematical model to inform and solve
a practical or abstract situation
• EXTENDED THINKING
![Page 16: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/16.jpg)
![Page 17: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/17.jpg)
![Page 18: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/18.jpg)
Depth of Knowledge
• So what is the point of knowing Depth of Knowledge?
• This helps us understand what the outcomes of our lessons should be.
• We need to prepare students to think more conceptually
![Page 19: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/19.jpg)
Making Sense & Worthwhile Tasks
“What are our Kids really being asked to do?”
“How are we keeping up with
Cognitive Demand?”
![Page 20: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/20.jpg)
Why Depth of Knowledge?
Mechanism to ensure that the intent of the standard and the level of student demonstration required by that standard matches the assessment items (required under NCLB)
To ensure that teachers are teaching to a level that will promote student achievement
![Page 21: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/21.jpg)
DOK is NOT...
• Bloom’s taxonomy
• the same as difficulty
• about using “verbs”
![Page 22: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/22.jpg)
![Page 23: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/23.jpg)
DOK is about intended outcome,
not difficultyDOK is a reference to the complexity of mental
processing that must occur to answer a question, perform a task, or generate a product.
• Adding is a mental process.• Knowing the rule for adding is the intended
outcome that influences the DOK.• Once someone learns the “rule” of how to
add, 4 + 4 is DOK 1 and is also easy.• Adding 4,678,895 + 9,578,885 is still a DOK 1
but may be more “difficult.”
![Page 24: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/24.jpg)
Let’s look at DOK in Math Activities
![Page 25: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/25.jpg)
Remember DOK is...
…descriptive…focuses on how deeply
a student has to know the content in order to respond
…NOT the same as difficulty.
…NOT the same as Bloom ’s Taxonomy
![Page 26: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/26.jpg)
What is Computer Adaptive Testing (CAT)?
• Adapts to the student’s ability level
• Assessment “engine” delivers short series of moderately difficult grade items
• Depending on student’s initial performance delivers items that are either more or less difficult
• Process continues until student’s performance level is determined.
![Page 27: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/27.jpg)
Benefits of Computer Adaptive Testing (CAT)
27
Faster results
Shorter test length
Increased precision
Tailored to student ability
Greater security
Mature technology
![Page 28: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/28.jpg)
Tablets vs. Computers• There are current challenges to test item
security for online assessment with tablets, e-readers, and smartphones.
• Testing software used by computers typically shuts down keyboard commands, such as “print screen” and “copy,” to ensure test security. Tablet applications don’t have this capability.
• SBAC will conduct further development and testing.
![Page 29: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/29.jpg)
IT Technology Readiness Tool
• Online dynamic and interactive technology readiness tool
• Helps SEAs and LEAs evaluate current technology and infrastructure in terms of SBAC implementation readiness
• It is anticipated tool will be ready in spring 2012
• NCS Pearson will develop
![Page 30: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/30.jpg)
System Portal for Online Delivery
• System Portal contains information about Common Core State Standards, Consortium activities, web-based learning communities, and assessment results
• Dashboard gives parents, students, practitioners, and policymakers access to assessment information
• Reporting capabilities include static and dynamic reports, secure and public views
• Item development and scoring application support educator participation in assessment
• Feedback and evaluation mechanism provides surveys, open feedback, and vetting of materials
![Page 31: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/31.jpg)
Digital Etiquette
• Are there suggestions for preparing technology enhanced responses?
• YES. Let’s take a look at what can be done.
![Page 32: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/32.jpg)
*According to the Common Core, “The standards require that students gain, evaluate, and present increasingly complex information, ideas, and evidence
through listening and speaking as well as through media.”
*With media taking a prominent role in both the gathering of information and the presentation of new knowledge products, it is recommended that schools be
equipped with:
• projection/presentation stations
• internet connectivity
• media creation stations
• writing centers
• internet stations to support distance learning course offerings
• video and still cameras with computer software for media production ***Recommendations from the NYLA (New York Librarian Association)
![Page 33: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/33.jpg)
By embracing technology and encouraging students to explore its various forms, educators also have aresponsibility to teach students to use technology in a responsible manner.
2 Things To Remember…Digital Citizenship will be constantly changing with the times as new tools are developed and used.
As within any society, we need a structure which people need to honor so that we are respectful to each other.
![Page 34: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/34.jpg)
![Page 35: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/35.jpg)
How Do We Start Implementing Digital Citizenship In Our Classrooms and Where Can
We Find Support ?
• http://cybercitizenship.ning.com• http://www.onguardonline.gov• http://GetNetWise.org• http://CommonSenseMedia.org • http://iKeepSafe.org - Parents• http://NetSmarts.org• http://WiredSafety.org
![Page 36: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/36.jpg)
Technology in the Classroom
• Banana Hunt (cool-mathgames.com)• Adopted materials• Geogebra (geogebra.org)
![Page 37: Anthony Quan A Closer Look at the SMARTER Balanced Assessments: Preparing for Elementary Mathematics quan@gseis.ucla.edu Teacher Education Program, UCLA](https://reader035.vdocuments.site/reader035/viewer/2022062714/56649d005503460f949d227f/html5/thumbnails/37.jpg)
Equity Issues
• Availability of Technology• Accessibility of Technology• Integrating Technology into the curriculum• Teacher knowledge and comfort