Download - Test Security Guidebook
![Page 1: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/1.jpg)
Test Security Guidebook
West Virginia: A State Perspective
![Page 2: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/2.jpg)
An Important Addition
• A compilation of “Best Practices” • 3 Key Areas– Prevention– Detection– Investigation
• Key Implications:– Potential source to conduct a gap analysis– Preparation for any test security requirements
![Page 3: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/3.jpg)
State Awareness Timeline
• Test security has always been of interest to SEAs
• Security breaches have thrust assessment issues into the spotlight
• SEAs, LEAs, and schools now have a dedicated interest in test security and assessment integrity
![Page 4: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/4.jpg)
Assessment Integrity
Ensuring the validity and reliability of assessment results through standardized
and secure assessment conditions. ®
![Page 5: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/5.jpg)
A State’s Potential Context
• The 3 Ps of Assessment Integrity– Policy– Politics– Practical Implications (i.e., reliability of results)
• What is the driver?– Timing + Severity + Pervasiveness + Climate =– Crapshoot
![Page 6: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/6.jpg)
A State’s Potential Question
• How often have people in testing programs been asked to engage in a potentially controversial decision in advance of clear and distinct policy or practice?
• Drives the need for solid guidance to drive best practice.
![Page 7: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/7.jpg)
WV’s Approach
Greatest Area of Emphasis
![Page 8: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/8.jpg)
Primary Focus
• Prevention– Training– Security of Test Materials– Policy-based Definitions– Code of Ethics– Signed Agreements
![Page 9: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/9.jpg)
Secondary Focus
• Investigation– Allegations – Pattern Analyses– Gains Analyses– Qualitative Analyses• Documentation• Interviews• Written/oral complaints or reports
![Page 10: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/10.jpg)
Secondary Focus Cont’d
• Detection– Erasure Analyses– Reporting Protocols– Investigation Protocols
![Page 11: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/11.jpg)
Newest Areas of Focus(West Virginia)
• Detection– Staff assigned to troll:• Twitter• Pinterest• Facebook
– New Technologies• Snapchat• http://www.snapchat.com/#What-is-snapchat?• Unmonitored photos that are automatically deleted
![Page 12: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/12.jpg)
Result and Implications
• Uncovered more instances of test administrator violations – Kids sleeping– Student tweets (positive and negative)– A few cases of administrators sleeping
• What’s next?– Documenting assigned roles and responsibilities,
as well as the process.
![Page 13: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/13.jpg)
Where are we now?
• Waiting for the next AJC article• (Quality?) Information everywhere about test
security practices, audits, and requirements.• The guidebook providing a comprehensive
look at the three major categories• Taking recommendations to create actionable
information that practitioners can use to revise practice and policy
![Page 14: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/14.jpg)
Using the Guidebook
• Prevention– Documentation that can be used for a “best-practices
check” • Detection– Potentially a weak area for states– Need defensible analyses to mitigate Type 1 and 2 error– More sources for triangulation
• Follow-up Investigations– Establish policies and procedures to have something to
reference (e.g., invalidations)
![Page 15: Test Security Guidebook](https://reader036.vdocuments.site/reader036/viewer/2022062811/56815fcb550346895dcec34b/html5/thumbnails/15.jpg)
Thank you
Contact Information
Juan D’BrotWest Virginia Department of Education
Executive DirectorOffice of Assessment and Accountability
Office of [email protected]