best practice in test security
TRANSCRIPT
![Page 1: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/1.jpg)
Best Practices in Test SecurityWyoming Law Conference 2015
![Page 2: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/2.jpg)
Today’s Meet
• For today’s presentation materials and to ask questions or chat with me go to
• https://todaysmeet.com/MS2TestSecurity
![Page 3: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/3.jpg)
The ugly side of accountability
The higher the stakes the higher the chances for corruption!
![Page 4: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/4.jpg)
Hypothetical Discussion 1
You are the District Test Coordinator. A middle school parent calls you and reports that her child says the tests from the 7th grade state assessment were the same problems they practiced in class the week before.Before you can fully investigate, you receive a call from the state department that one of your board members has turned the school in for cheating.What do you do?
![Page 5: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/5.jpg)
Las Vegas
• Cheating Teachers Caused School’s Scores to Skyrocket
• Changed student answer sheets
![Page 6: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/6.jpg)
Atlanta
• 35 indicted• 12 administrators, educators on trial• Alleged to have cheated, lied and stole as a
cleverly disguised conspiracy to inflate state test scores
• High pressure culture
![Page 7: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/7.jpg)
Columbus
• State investigation of district reveals “top-down culture of data manipulation and employee intimidation”
• Changed test scores and grades
![Page 8: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/8.jpg)
El Paso
• Superintendent pleads guilty to inflating district test scores by holding back low performing students and forcing others to drop out
![Page 9: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/9.jpg)
Philadelphia
• Three principals fired for test cheating• Wrong to right erasures on tests reveal
patterns
![Page 10: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/10.jpg)
L.A. County
• 5 school districts stripped of scores on state test
• Claims of cheating, misconduct or mistakes in handling standardized tests
![Page 11: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/11.jpg)
Peoria
• Staff members at charter school admitted to directing special education students to erase answers on state standardized tests
• Staff admits to erasing some answers themselves
![Page 12: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/12.jpg)
New Orleans
• 33 schools flagged for possible cheating• Plagiarism, improper test proctoring, excessive
changed answers
![Page 13: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/13.jpg)
Best Practice 1
• Define cheating and irregularities– Erase or changing an answer– Filling in blank answers– Providing correct answers– Excluding students with poor performance on test days– Cueing students on incorrect answers– Talking students through definitions and processes– Giving extra time for students who don’t have
accommodations in the IEP
![Page 14: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/14.jpg)
Best Practice 2
• Provide professional development on test administration
• Have teachers sign an attendance sheet • Make sure those who are absent receive a
makeup session• Attach the agenda for the testing workshop to
the attendance form and file it away – it may protect you later
![Page 15: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/15.jpg)
Best Practice 3
• Assign a test coordinator at each school who…– Develops policies and procedures– Schedules a limited time for testing– Administers tests in “controlled and secure”
settings
![Page 16: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/16.jpg)
Best Practice 4
• Develop Chain of Custody– Limit access to tests– Inventory and/or audit test booklets– Keep record of who, when and where materials
were accessed from a secure location– Remove test materials immediately and score off-
site– Securely lock materials after each test day is
completed
![Page 17: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/17.jpg)
Best Practice 5
• Monitor test administration– Train proctors– Have at least two adults trained to proctor in each
testing room– Monitor the tests during the scheduled times
![Page 18: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/18.jpg)
Best Practice 6
• Conduct comprehensive integrity analysis– Ratio Analysis/Erasure analysis• Look for unusually high numbers of answers changed
from wrong to right– Item-Response Pattern Analysis• Look for unusually common response patterns from
students in the same class– Test Score Analysis• Look for exceptionally large increases from previous
years or large declines in next year’s test
![Page 19: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/19.jpg)
Best Practice 7
• Have procedures for investigating allegations of cheating or misconduct– Emphasize prevention and protection of
employees from false allegations– Provide a process for reporting, to whom, and
when– Develop a policy that protects “whistleblowers”– Follow up with all schools using the Wrong/Right
answer analysis for their school
![Page 20: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/20.jpg)
Best Practice 8
• Investigating– Investigate immediately– Ensure that all witnesses are interviewed– Coordinate with proper authorities• Chain of command BUT know what to do if superiors
are involved – who do you report to then?– The level of reporting to authorities may depend
on the type of test and the state of your employment
![Page 21: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/21.jpg)
Best Practice 9
• Identify district ethics statements or other documents that address testing
• Make sure faculty and test proctors are aware of those documents
• Wyoming has a Professional Conduct Guide that addresses standardized testing
![Page 22: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/22.jpg)
Best Practice 10
• If all your best efforts fail• Investigate, document, then discipline or
prosecute those who are guilty
![Page 23: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/23.jpg)
MJS Consulting LLC• Dr. Mark J. Stock• 64 Arrowhead Drive• Laramie, WY, 82070
• Work # 307-766-6825• Cell # 307-399-1711
• [email protected]• University of Wyoming• Assistant Professor Educational Leadership
![Page 24: Best practice in test security](https://reader033.vdocuments.site/reader033/viewer/2022042907/58d13ed41a28ab455d8b5547/html5/thumbnails/24.jpg)
Hypothetical Discussion 2
A teacher stops by your office (you are the principal) and says, “Something odd happened today. I asked a new student who was transferred to my class this semester from Mr. Jones’s class how he did on the final assessment. He says the class never took it. But when I looked on the computer, it shows scores for all the students. I asked the other 4 students from his class and they all said the same thing.”
What should you do? Take 10 minutes to discuss