creating and implementing rigorous formative assessments iasp fall conference 2014
TRANSCRIPT
CREATING AND IMPLEMENTING RIGOROUS FORMATIVE ASSESSMENTS
IASP Fall Conference 2014
AGENDA
In the beginning… Find Your Constants Setting a Path Professional Development Projecting the Future
A brief history of how Duneland School Corporation came to identify the need for locally developed rigorous common assessments.
IN THE BEGINNING…
Elementary Assessments
District Wide Common Writing Prompts
Textbook Based Common Unit Assessments
School Based School Improvement Assessments
Recording of Data Use/Purpose of Data Hand Scoring &
Recording Vertical Articulation Validity & Reliability
The Items The Complexities
Intermediate/Middle School Assessments
Writing Prompts Screening Placement
Assessments Pre & Post Assessments School Improvement Pre & Post
Assessments Individual Teacher Course Finals Department Quarterly
Assessments
Inconsistencies within a course
Reliable Data No Review of Data Lack of Data Storage Multiple Buildings
The Items Complexities
High School Assessments
Algebra 1 ECA Failure Algebra 1 Common
Assessments Vocabulary Assessments Department Quarterly
Assessments
How do we score?
RISO ScanTron By Hand
In an era of change, holding on to what you control and hold important.
FIND YOUR CONSTANTS
A Climate of Change
Indiana Standards – Common Core – College & Career Readiness Standards
Textbook Change Acuity Predictive – Acuity Diagnostic mClass NWEA ISTEP IREAD3
AdvancED Visit
Train all professionals how to harvest and communicate student performance data from locally developed assessments so as to build confidence among principals and teachers to make instructional, research-based decisions based upon valid and reliable local assessment results that have been triangulated against external assessments.
Superintendents Advisory Committee
Common Concerns Across the state Danielle Shockey, Deputy Superintendent of Public
Instruction Stick to your constants to weather the storm
Our steps to the process and clarifying definitions for the future.
DEFINING A PATH
Our Path
Clearly identify any and all common assessments used within schools and across the district. Assessment evaluation.
Curriculum evaluation. Mechanism for assessment creation. Timeline for assessment creation. Formats for assessments at all levels. Professional development on writing assessments. Writing assessments.
15
Essential Assessment Questions
Gradebook Accountability
Program or curriculum Grade level or content School, division or state
I am not sure what my students know and don’t know about this
I need data to inform me about why they are not getting this concept
I need data for creating like groups for further instruction
16
Key Elements of Rigorous Instruction
Rigor
Cognitive Engagement
OngoingAssessment
Complex Content
Student Engagement
Barbara Blackburn
Rigor is creating an environment in which each student is expected to learn at high levels each student is supported so he or she can learn at high
levels each student demonstrates learning at high levels
(Blackburn, 2008)
Karin Hess
Cognitive rigor encompasses: the complexity of content the cognitive engagement with that contentthe scope of the planned learning activities
(Hess, Carlock, Jones, & Walkup, 2009)
Robyn R. Jackson
Rigor is a quality of instruction that requires students to: construct meaning for themselves impose structure on information integrate individual skills into processes operate within but at the outer edge of their abilities apply what they learn in more than one context and to
unpredictable situations
http://www.mindstepsinc.com/rigor/
A relationship with Interactive Achievement and onTRAC.
PROFESSIONAL DEVELOPMENT
General Tips and Guidelines
Items that Produce Reliable Results
Bad
Why was Jamestown a poor site for a settlement and when was it moved to Williamsburg?
Good
Why was Jamestown a poor site for a settlement?-and-
When was the capital moved to Williamsburg?
Single Idea or Problem
Good Graphic
Readable Graphics
Not so Good Graphics
Which explorer’s route is represented by A?
A ColumbusB NewportC CartierD Ponce de Leon
Avoid unnecessary information ingraphics
Garrett has cereal every morning for breakfast. He notices that the cereal box is in the shape of a rectangular prism. The cereal box that he is eating from has the volume of 1,200 square inches and a height of 20 inches. Knowing the height and volume, which of the following could be the dimensions of the length and width of the cereal box?
What can be eliminated?
A cereal box has the volume of 1,200 square inches and a height of 20 inches. Which of the following could be the dimensions of the length and width of the cereal box?
Clear, precise, simple language
These items were on the same history test:
Who led a raid on the United States arsenal (armory) at Harpers Ferry, Virginia?
-and-
Why did John Brown lead a raid on the United States arsenal (armory) at Harpers Ferry, Virginia?
Ensure items are not interdependent
If Shakayan divided a dozen eggs into three equal groups, how many groups of eggs would she have?
A 4B 3C 1D 12
If April divided a dozen eggs into three equal groups, how many groups of eggs would she have?
Do NOT use difficult or common names
Include words in the stem that would be repeated in each response option.
After the secession of Virginia –
A the capital of the Confederacy was RichmondB the capital of the Confederacy was ManassasC the capital of the Confederacy was MontgomeryD the capital of the Confederacy was Atlanta
After the secession of Virginia the capital of the Confederacy was –
A RichmondB ManassasC MontgomeryD Atlanta
Reduce redundancy
Use as little punctuation as possible.
Bad
Which number isn’t an example of an integer?
Good
Which number is NOT an example of an integer?
Do NOT use contractions
Use new language as frequently as possible.
SOL Framework
“Many settlers died of starvation…”
BadMany settlers died of –
A starvation
GoodWhich hardship caused the deaths of many settlers?
A They did not have enough food to eat.
Avoid phrases taken directly from text or lecture
Place “blanks” at the end of the statement, rather than the middle. Use a dash.
John found the solution of 13 + x = 25 in one step by —
A dividing both sides of the number sentence by 13 B adding 13 to both sides of the number sentenceC multiplying both sides of the number sentence by 13D subtracting 13 from both sides of the number sentence
Incomplete statements
Virginia’s Maggie L. Walker is known as the first African-American woman to —
A become a city officialB become a bank presidentC was a spy for the Continental ArmyD led the Underground Railroad
Distractors must be grammatically consistent with the stem
BadWhen selecting a career you should take into account all of the following EXCEPT ‒A your own talentsB what your friends are doingC things you are interested inD what you are good at
GoodWhen selecting a career people should take into account all of the following EXCEPT ‒A their own talentsB what their friends are doingC things they are interested inD what they are good at
Write items in the THIRD PERSON
Before the Civil War, the primary form of a family’s transportation was a –
A horse and buggy
B rocket
C skateboard
D canoe
Ensure distractors are equally attractive
Subject History 8.1
Question: Nat Turner led a revolt against -
Answer: plantation owners Students might select this distractor if:
Option 1: slaves they don’t attend to the word against
Option 2: Confederate troops they think the revolt took place during the civil war
Option 3: abolitionists they think he sided with slave owners
Thinking through your distractors
Bad
West Virginia separated from Virginia because of different opinions about —
A the types of materials the United States should trade with foreign countriesB slaveryC what types of religion people should practiceD whether factories should be built in the southern states
All distractors should be equivalent in length, style and structure
The colony of Virginia mainly provided England with –
A locations for English prisonsB new sources of raw materials C all of the aboveD none of the above
Avoid “all of the above” & “none of the above”
Which of the following is a reason why the southern states seceded from the Union?
A Northern and southern states disagreed about everything.B The industrial economy of the North did not support slavery.C People in the South wanted to continue farming on plantations.D The southern states did not want any of the western territories to become states.
Avoid absolute terminology
The Good the Bad and the Ugly Learning Activity I
ISTEP and ISTEP+ Formatting
Distractors are:CapitalizedNo periods
Who were members of the 1619 Virginia Assembly?
A LordsB BurgessesC Indentured servantsD American Indians (First Americans)
When distractors are incomplete sentences
A person mixed 2 teaspoons of salt into 1 cup of water that measured 70°F. What most likely happened?
A The salt did not lose any of its original chemical properties
B A new compound was formed with the water and salt
C The temperature of the water was lowered by ten degrees
D The salt molecules broke apart to form sodium and chloride
Distractors are:CapitalizedNo Periods
When distractors are complete sentences or statements
To find more information about Pocahontas, a student should use ―
A the Internet and an encyclopedia
B a dictionary and the internet
C an encyclopedia and a thesaurus
D a dictionary and a thesaurus
Distractors are:Not capitalizedNo periods
When stem is an incomplete statement
Always CAPITALIZED BEST NOT MOST LIKELY
Use of Italics
Writing Directions
Grade 8
Use of Graphics for Multiple Choice
The colony of Virginia mainly provided England with ―
A locations for English prisonsB increased influence with other countriesC American Indians (First Americans) as a labor sourceD new source of raw materials for English industry
Qualifiers are NOT italicized
PROJECTING THE FUTURE
APPROVAL & MONITORING
Determine Mechanism for Approval Who will be approving the assessments? What criteria will be used for final approval?
Set Timeline for Implementation Determine Mechanism for Modifications
How often will assessments be reviewed for modifications? Who will be making modifications to assessments? How will modifications be approved?
Determine Mechanism for Monitoring Results Determine standardized assessments used to triangulate data for validity. Determine who will review district data and how? Assessments Implemented, Recorded, & Modified – Monitoring Provided by
Curriculum Committees (K-12 representatives) Provide Professional Development as Needed
WRAP UP & QUESTIONS?
Contact Information
PrincipalBailly Elementary School Chesterton, IN(219)[email protected]
Director of Professional DevelopmentInteractive Achievement(540) 206-2262 office(757) 535-4484 [email protected]
www.interactiveachievement.comFollow me onTwitter @SallyIAnson1
KEVIN ZECKSALLY I’ANSON, Ed. D.