assessment literacy for the middle level educator jennifer borgioli learner-centered initiatives,...
TRANSCRIPT
![Page 1: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/1.jpg)
Assessment Literacy for the Middle Level Educator
Jennifer BorgioliLearner-Centered Initiatives,
Ltd.
![Page 2: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/2.jpg)
Organizational Focus
Assessment to produce learning…
and not just measure learning.
![Page 3: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/3.jpg)
![Page 4: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/4.jpg)
Do you honestly want to know what X exactly is? Is your life going to be improved by momentarily knowing what x is? No. Absolutely not. This whole problem is a conspiracy against hardworking American students. Let me tell you, solving for X right now is not going to stop the recession. It fact, it’s not going to do anything. And another thing. When have you ever had to know what is X is in your long esteemed professional career? Exactly. This is a futile attempt for “educators” in this district to boast of their student’s success rate. I am going to go the rest of my life not knowing what X is. Because what is X when you really think about it? A letter, the spot, two lines crossing each other. I don’t think anyone will ever really know what X truly is because the essence of X is beyond our brain potential. In conclusion, Harry S. Truman’s middle name was just the letter S, not an actual name. Now that is a letter that’s actually being utilized. See, you learned something, and it was not because of this logarithm. The End.
![Page 5: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/5.jpg)
Talking about the science of
our profession does not
discredit the art.
![Page 6: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/6.jpg)
![Page 7: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/7.jpg)
“Less than 20% of teacher preparation programs contain higher level or advanced courses in psychometrics (assessment design) or instructional data analysis.”
Inside Higher Education, April 2009
![Page 8: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/8.jpg)
ImplicationsMinimize
interruptions.Make them worthy.
![Page 9: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/9.jpg)
To be assessment savvy….
![Page 10: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/10.jpg)
Essential Element #2
2f. The degree to which the middle-level educational program includes ongoing Standards-based assessments
![Page 11: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/11.jpg)
Assessment• Definition: The strategic collection of
evidence of student learning. (Martin-Kniep, 2009)
Assessment: test as dogs: pitbull
• A thing and a process
![Page 12: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/12.jpg)
“And while the exams may be a thoroughly vetted, sophisticated means of measurement, they are an inadequate, constricted form of expression.”
March 12, 2013SEATTLE’S LOW-STAKES TESTING TRAPPosted by Michael Guerriero
Read more: http://www.newyorker.com/online/blogs/newsdesk/2013/03/seattles-low-stakes-testing-trap.html#ixzz2NWx8bv00
![Page 13: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/13.jpg)
What are the implications of chasing the pineapple?
![Page 14: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/14.jpg)
“Standards-Based Assessment”
RL.05.06a: Recognize and describe how an author’s background and culture affect his or her perspective. (NYS)
![Page 15: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/15.jpg)
Assessment considerations
![Page 16: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/16.jpg)
1999 APA Testing Standards
![Page 17: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/17.jpg)
![Page 18: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/18.jpg)
“The higher the stakes of an assessment’s results, the higher the expectation for the documentation
supporting the assessment design and the decisions made based on the assessment results.” (Section 13)
![Page 19: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/19.jpg)
![Page 20: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/20.jpg)
Traditional Assessme
nt
Performance-
Based Assessme
nt
![Page 21: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/21.jpg)
Performance-Based Assessments (PBAs)
A performance task is an assessment that requires students to demonstrate achievement by producing an extended written or spoken answer, by engaging in group or individual activities, or by creating a specific product. (Nitko, 2001)
![Page 22: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/22.jpg)
PBA’s versus TraditionalLiskin-Gasparro (1997) and Mueller (2008)
Attribute Traditional Performance
Assessment activity
Selecting a response
Performing a task
Nature of activity Contrived Emulates real life
Cognitive levelKnowledge/
comprehensionApplication/
analysis/synthesis
Development of solution
Teacher-structured
Student-structured
Objectivity of scoring
Easily achieved Difficult to achieve
Evidence of mastery
Indirect Direct
![Page 23: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/23.jpg)
PBA’s versus TraditionalLiskin-Gasparro (1997) and Mueller (2008)
Attribute Traditional Performance
Assessment activity
Selecting a response
Performing a task
Nature of activity Contrived Emulates real life
Cognitive levelKnowledge/
comprehensionApplication/
analysis/synthesis
Development of solution
Teacher-structured
Student-structured
Objectivity of scoring
Easily achievedDifficult to
achieve
Evidence of mastery
Indirect Direct
![Page 24: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/24.jpg)
Validity = Accuracy
![Page 25: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/25.jpg)
How do we ensure alignment and validity in assessment?Degrees of Alignment
![Page 26: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/26.jpg)
![Page 27: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/27.jpg)
Goal is Best Fit
![Page 28: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/28.jpg)
If you want to assess your students’ ability to perform, design, apply, interpret. . .
. . . then assess them with a performance or product task that requires them to perform, design, apply, or interpret.
![Page 29: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/29.jpg)
I cannot claim my
assessment is valid if I do not have
some type of blueprint
![Page 30: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/30.jpg)
Minimum
![Page 31: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/31.jpg)
Basic
![Page 32: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/32.jpg)
Articulated
New York State Learning Standard: Read to collect and interpret data, facts, and ideas from unfamiliar texts (4 items, 15% of test)
23
The student chose a response that completes the sentence
with an inference that is related to another element in the
passage but not to the specified detail
The student chose a response that completes the sentence
with an inference that is related to the main idea of the
passage but not to the specified detail
Correct Response: The student chose the correct response,
demonstrating that the student can infer a detail from passage
text
The student chose a response that completes the sentence
with an inference that may be based on prior knowledge and not supported by the passage
24
The student chose a response that describes a point of view
that is mentioned in the passage, but that is not the
author or narrator's point of view
The student chose a response that describes a point of view
that is related to passage content, but that is not stated
or implied in the passage
Correct Response: The student chose the correct response,
demonstrating that the student can infer an author or
narrator's point of view
The student chose a response that describes a point of view that is contradicted by details
in the passage
![Page 33: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/33.jpg)
![Page 34: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/34.jpg)
![Page 35: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/35.jpg)
How many?3-5
3 – 5 standards in a PBA (reflected in rows in the rubric)
3 – 5 items per standard on a traditional test
![Page 36: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/36.jpg)
Reliability = Consistency
![Page 37: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/37.jpg)
I cannot claim my assessment is
reliable if I do not have statistics to support my claim
![Page 38: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/38.jpg)
Reliability
Indication of how consistently an assessment measures its intended target and the extent to which scores are relatively free of error. Low reliability means that scores cannot be trusted for decision making. Necessary but not sufficient condition to ensure validity.
![Page 39: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/39.jpg)
Three Types of Measurement Error
• Subject effect• Test effect• Environmental effects
![Page 40: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/40.jpg)
Subject Effects
![Page 41: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/41.jpg)
Others…
• Fatigue• Sleep deprivation• Illness• Disability
![Page 42: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/42.jpg)
![Page 43: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/43.jpg)
Testing Fatigue
Test Familiarity Bias
Score
Score
![Page 44: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/44.jpg)
In what ways do we knowingly
(or unknowingl
y) contribute
to measureme
nt error?
![Page 45: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/45.jpg)
Test Effects
![Page 46: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/46.jpg)
![Page 47: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/47.jpg)
![Page 48: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/48.jpg)
Examples
• Not enough space for a response• Confusing items• Typos• Misleading (or lacking)
directions• Scorer inconsistencies
![Page 49: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/49.jpg)
10. Format the item vertically instead of horizontally.
From A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment by Haladyna, Downing, and Rodriguez
![Page 50: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/50.jpg)
21. Place choices in logical or numerical order. Students should not have to hunt to find an answer. Answers should be
provided in a logical, predictable pattern.
![Page 51: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/51.jpg)
Compare with . . .
![Page 52: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/52.jpg)
![Page 53: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/53.jpg)
![Page 54: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/54.jpg)
Final Eyes isn’t about editing
rather “is this what you want the students to
see/read?”
![Page 55: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/55.jpg)
![Page 56: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/56.jpg)
From Haladyna:26. Avoid All-of-the-above.28. Avoid giving clues to the right answer, such as specific determiners including always, never, completely, and absolutely
![Page 57: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/57.jpg)
![Page 58: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/58.jpg)
Test from
Period 1
Test from Period 2
![Page 59: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/59.jpg)
![Page 60: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/60.jpg)
![Page 61: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/61.jpg)
Engage in peer review “Final Eyes”
– Is each item aligned to a standard?*– Is each item rigorous?– Is each item fair?– Does each item have one, unambiguous
correct key?*– Are all plausible/text based?– Are all tasks meaningful and build upon
student comprehension?
*Very hard to answer without a test map
![Page 62: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/62.jpg)
3. Develop Context-Dependent Item Sets for
Content Areas
![Page 63: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/63.jpg)
Develop Test Maps and Item Analysis Procedures
• The higher the stakes of an assessment, the more we need to play by the rules
• If it’s a mid-term or final exam, there should be a test map.
• Consider also:– Item analysis– Using choice E (primarily for pre-
assessments)
![Page 64: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/64.jpg)
Environmental Effects
![Page 65: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/65.jpg)
In what ways might we knowingly (or
unknowingly) contribute to
measurement error?
![Page 66: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/66.jpg)
Reliability = Consistency
![Page 67: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/67.jpg)
3 general ways to collect evidence of reliability
• Stability: How consistent are the results of an assessment when given at two time-separated occasions?
• Alternate Form: How consistent are the results of an assessment when given in two different forms?
• Internal Consistency: How consistently do the test’s items function?
• Inter-rater reliability: How consistently do scorer’s use the scoring rubric?
![Page 68: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/68.jpg)
Cronbach’s Alpha
“In statistics, Cronbach's (alpha) is a coefficient of reliability. It is commonly used as a measure of the internal consistency or reliability of a psychometric test score for a sample of examinees. Alpha is not robust against missing data.” (Nitko, 2012)
![Page 69: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/69.jpg)
![Page 70: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/70.jpg)
Item Analysis
“This is unfamiliar to me”
![Page 71: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/71.jpg)
Percent of Students Selecting Choice “E”
![Page 72: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/72.jpg)
One assessment does not an assessment
system make.
![Page 73: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/73.jpg)
![Page 74: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/74.jpg)
WHEN DESIGNING A PRE/POST PERFORMANCE
TASK •the standards and thinking demands must stay the same.
•the modality that students express their thinking through must also stay the same.
•the content of the baseline and post must be different. •the rubrics for the pre/post will be the same in terms of thinking and modality, but the content dimension will be different.
![Page 75: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/75.jpg)
MS General Music ExamplePre Assessment Post Assessment
Students listen to 3 songs from Western African
Your mother has just returned from a business trip and is playing a song from the country she visited. (Students listen to song) Explain in a blog post how you know what country or region she went to based on the song you heard.
Students listen to 3 songs from Spain
Your task as a member of your school newspaper is to write an introduction to the new exchange student. Write a brief paragraph that introduces people to the music of her country.
Music 4a. Identify the cultural contexts of a performance or recording and perform (with movement, where culturally appropriate) a varied repertoire of folk, art, andcontemporary selections from the basic cultures that represent the peoples of the world
W.6-8.4: Produce clear and coherent writing in which the development, organization, and style are appropriate to task, purpose, and audience.W.6-8.2d: Use precise language and domain-specific vocabulary to inform about or explain the topic.
![Page 76: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/76.jpg)
HS PE ExamplePre Assessment Post Assessment
The superintendent of a neighboring school is proposing cutting PE to 40 minutes once a month. Explain to the superintendent why her idea is a good or bad one.
Our State Congresswoman is advocating for increasing PE to 40 minutes a day for all students who are not playing a formal sport in school. Explain to the Congresswoman why you agree or disagree with her idea.
PE 2. iii. Accept physical activity as an important part of life. Self-renewal, productivity as a worker, energy for family activities, fitness, weight control, stress management, and reduction in health-care costs are understood as benefits of physical activity
W.6-8.4: Produce clear and coherent writing in which the development, organization, and style are appropriate to task, purpose, and audience.W.6-8.2d: Use precise language and domain-specific vocabulary to inform about or explain the topic.
![Page 77: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/77.jpg)
HS Art ExampleStudents will create their own artwork that communicates the theme of personal identity as an artist through the purposeful use of the elements and principles of art. (NYSVALS Commencement 1.b & 1.c) Students will respond critically to their artwork through dictation or writing by using the language of art criticism to describe, analyze, interpret, and make a judgment regarding that work of art. (NYSVALS Commencement 3a & WHST. 9-10. 2.d)
Students will create their own artwork that communicates the theme of personal identity as a learner through the purposeful use of the elements and principles of art. (NYSVALS Commencement 1.b & 1.c) Students will respond critically to their artwork through dictation or writing by using the language of art criticism to describe, analyze, interpret, and make a judgment regarding that work of art. (NYSVALS Commencement 3a & WHST. 9-10. 2.d)
![Page 78: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/78.jpg)
Grade 8 ELA (Local Assessment)
Pre Assessment Post Assessment
Does setting influence character?Select a character from a book
you read last year. Write a brief scene (with dialogue, an established setting, and plot) that places your character in NYC on September 10, 2001.
Write a second scene that places your character in NYC
on September 12, 2001.
Select a character from a book you read this year. Write a
brief scene (with dialogue, an established setting, and plot) that places your character in
Philly on July 3, 1776.
Write a second scene that places your character in Philly
on July 5, 1776.
![Page 79: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/79.jpg)
It’s 2063. Write a first draft of a Wikipedia entry for these two
photos. Use what you
learned in SS 8 to
compare, contrast, and
make connections
to US history,
culture, laws, and society.
![Page 80: Assessment Literacy for the Middle Level Educator Jennifer Borgioli Learner-Centered Initiatives, Ltd](https://reader036.vdocuments.site/reader036/viewer/2022062511/551bd717550346c3588b57fc/html5/thumbnails/80.jpg)
http://www.youtube.com/lciltd