the caveon security screen designed specifically for school district assessment programs
TRANSCRIPT
The Caveon Security Screen
designed specifically for
School District Assessment Programs
Of 40,000 students recently surveyed
95% admitted to cheating in High School.
Did you know?
Of 7,000 adults recently surveyed
51% believed it was necessary
to be dishonest to get ahead.
Did you know?
As a leader for your district, how do you know your
student test data accurately reflects student proficiency?
Are you being sufficiently proactive in protecting
your testing program against common threats?
• Test taker copying during a test administration
• Memorizing questions to share with others
• Unauthorized access to test materials
• Teachers and proctors assisting test takers
Recent notorious cheating scandals in some
of our nations largest public school districts
continue to receive attention in the news . . .
The Houston Independent School
District has uncovered evidence
that teachers at two elementary
schools helped students cheat on
state exams, and educators at
two other campuses offered questionable assistance.
Test booklets showed suspicious erasures changing
wrong responses to right.
The Houston Chronicle February 25, 2013
USA Today found
irregularities in DC schools‘
test scores from an analysis
of results between 2008
and 2010. More than 100 schools had score sheets that
had an irregularly high number of erasures of wrong
answers to right ones. Two teachers have been forced out.
USA TODAY June 22, 2012
At the Los Angeles Unified
School District six institutions
from Crescendo Charter
Schools faced closure after
the founder of Crescendo gave principals copies of state
standardized tests in advance and asked teachers to
prepare students with them.
Los Angeles Times September 5, 2011
Investigators in Atlanta
have found the widest
ranging incident of test
tampering in U.S. history.
179 educators have been implicated and 41 have resigned or
retired for participating in dishonest test practices. The district
is now deciding how to handle the remaining 138 implicated
educators and is looking to remove them from the system.
TIMENewsFeedJuly 6, 2011
Michigan Educator Survey
Detroit Free Press, July 26, 2011
29% felt pressure to cheat on a standardized test
34% felt pressure to change students’ scores for the better
21% knew educators that changed scores on students’ tests
8% admitted to changing students’ scores due to pressure
August 25, 2011
Duncan: No link between cheating and NCLB
Places the blame on school leaders
Regardless of who the perpetrators are . . .
School District Administrators will feel the heat !
School district leaders need to be proactive in
protecting the validity of the test scores within
their assessment programs.
Offered by the recognized world leader in test security
services, the Caveon Security Screen is a data forensic
diagnostic screening service providing school districts
a cost effective means to monitor assessment programs
for indications of test irregularities.
The Caveon Security Screen
Consultation
• Consultation with a Caveon Test Security Specialist
• Advice on Test Security planning and evaluation
• Interpretation of forensic data output reports
• Guidance on test irregularity follow-up
What the Caveon Security Screen Provides
• Similarity Index analyses
• Perfect Test and Identical Test Analyses
• School level data reported by grade and by subject
• Flagged student output with cluster details for pairs and groups
Data Forensics
The diagnostics include custom data forensic analyses
of student test records along with data interpretation and
consultation with a Caveon Test Security Specialist.
The data forensic analyses provide a powerfully credible
statistic highlighting the likelihood of answer copying, test
coaching, proxy test taking or collusion.
The Caveon Security Screen Data Forensics
How credible is a Flagged Similarity Index ?
• Chance of being hit by lightning = 1 in 1 Million
• Chance of winning the lottery = 1 in 10 Million
• Chance of DNA false-positive = 1 in 30 Million
• Chance of students flagged for
Similarity doing their own work = 1 in 1 Trillion
The Caveon Security Screen Data Forensics
Sample Forensic Output Data Report
• Test Site Observations
• Policies and Procedures Review
• Test Administrator and Proctor Interviews
• Web Patrol seeking stolen test questions
• Security Audit of full Examination Program
• Focused Investigations of Test Irregularities
• Gains or Losses Forensic Analyses
• Erasures Forensic Analyses
Additional Diagnostic Services Available
Build on Caveon’s test security experience and expertise
to protect and strengthen your assessment program.
Be proactive in protecting the integrity of your assessment
data and the reputation of your school district.
Contact a Caveon Test Security Specialist to learn
more about how the Caveon Security Screen can
be customized to meet your needs.
Consultation
• Consultation with a Caveon Test Security Specialist
• Advice on Test Security planning and evaluation
• Interpretation of forensic data output reports
• Guidance on test irregularity follow-up
The Caveon Security Screen
• Similarity Index analyses
• Perfect Test and Identical Test Analyses
• School level data reported by grade and by subject
• Flagged student output with cluster details for pairs and groups
Data Forensics
Michael W. Stetter, D.Ed.
Test Security Specialist
Caveon Consulting
(302) 415-0375