office of assessment and accountability kentucky department of education august 20111
TRANSCRIPT
Administration Code Training
Office of Assessment and Accountability
Kentucky Department of Education
August 2011 1
Allegation # of Incidents
Inappropriate Assistance/Intervention by Staff
Test Security (Staff)
Test Security (Student)
Out of Order (Staff)
Out of Order (Student)
Special Education
Student Action
Missing Test Booklets
OtherAugust 2011 2
Allegations for 20105, 6, 18, 27, 35, 37, 40, 45, 54
Allegation # of Incidents
Inappropriate Assistance/Intervention by Staff 35
Test Security (Staff) 40
Test Security (Student) 5
Out of Order (Staff) 27
Out of Order (Student) 54
Special Education 46
Student Action 18
Missing Test Booklets 6
Other 37August 2011 3
Allegations for 2010
To review the appropriate practices for the state assessment system as defined in the Administration Code for Kentucky’s Educational Assessment Program (703 KAR 5:080)
Revised September 2009
To review the Inclusion of Special Populations in the State-Required Assessment and Accountability Programs (703 KAR 5:070)
Revised February 2009
August 2011 4
Purpose of This Training
I. RationaleII. Appropriate Assessment PracticesIII. Violations of the 703 KAR 5:080 Administration
CodeIV. Review of Secure Assessment ComponentsV. Proper Reporting of Nonacademic IndicatorsVI. Signature Page
August 2011 5
703 KAR 5:080Table of Contents
Key to Administration Regulation and Training PowerPoint
ACCEPTABLE NOT ACCEPTABLE
Positive Statement Aligns Topic Change appears
below line in regulation
New or Clarified information in Bold Blue
Negative Statement Aligns Topic Change appears
below line in regulation
New or Clarified information in Bold Blue
August 2011 6
From the PowerPoint
From the Regulation
I. Rationale
Multiple state-required assessments
1. Professional Ethics 704 KAR 20:680
2. Educational Defensibility Teach the content
3. Student Ownership All work done entirely by the student
August 2011 7
KYEXPLORE
PLAN
ACT
K-PREP (CRT/NRT
)
Alternate Assessment
Access
Non-Academic Data
EOC
August 2011 8
II. APPROPRIATE ASSESSMENT
PRACTICES
Test Security, Procedures for Reporting Errors, Classroom Materials, Administration Practices, Test Preparation, Inclusion of Special Populations, & Alternate Assessment
August 2011 9
Requires annual training for all individuals involved in any component of the state assessment
Annually read and comply with documents and manuals specific to the state-wide assessment
Training includes “documents and administration manuals specific to state-required assessment components”
August 2011 10
Appropriate Assessment Practices
Training must be completed prior to any state required assessment administration
703 KAR 5:080 & 703 KAR 5:070 shall be reviewed prior to spring test administration by all involved in assessment
August 2011 11
Appropriate Assessment Practices
“DACs, administrators, and teachers shall ensure the security of the assessment materials before, during, and after test administration.”
“When not being used for a scheduled testing session, all assessment materials shall be stored in a secure location with access granted to authorized personnel only.”
August 2011 12
Test Security
Test Security
ACCEPTABLE NOT ACCEPTABLE
Using Kentucky’s Core Content for Assessment
Using released items Signing of
nondisclosure forms by noncertified personnel assisting with testing
Revealing any secure test item
Using secure test items to prepare students for assessment
Taking notes about or discussing the content, concepts or structure of any secure test item
August 2011 13
Test Security
ACCEPTABLE NOT ACCEPTABLE
Using technology to save responses to CDs or portable drives (i.e., flash drives, floppy discs, etc.)
Copying of Alert Papers by DAC, BAC or school administrator
Saving student responses electronically to local drives or network drive
Reproducing secure test materials in any way
Access to electronic devices with wireless communication or imaging capabilities
August 2011 14
Test Security
ACCEPTABLE NOT ACCEPTABLE
Destroying student notes, rough drafts or scratch paper after testing
Visually scanning student response booklets for stray marks and “good faith effort”
Scoring of test items or rough drafts is not permitted
Reading student responses in entirety for “good faith effort” is not permitted
August 2011 15
Test SecurityACCEPTABLE NOT ACCEPTABLE
Distributing Test Administration Manuals (TAMs) to administrators or proctors prior to the testing window
Distributing tests in the order of the shrink-wrapped packages
Ensuring that reusable test materials are free of any marks made by past students
Making test booklets available to administrators or proctors prior to the testing window
Showing test items to anyone not administering the test
Leaving test booklets unattended outside of locked storage
Storing test booklets in a classroom without double-locked storage
August 2011 16
Example – For DACSent to KDE from DAC
Grade Level Grade 4
Content Area & Part Reading – Part B
Form Form 3A
Page Number Page 30
Identify item as multiple choice or open response or on-demand writing prompt
Multiple Choice Item # 2
Error or Problem No correct answer choice provided
August 2011 17
Reporting Errors
Do not reproduce test item!
Content information or strategies/processes cannot be displayed on any classroom surface, including clothing.
Materials containing content information or strategies/processes added to classroom surfaces during instruction must be removed or covered during the assessment.
Periodic tables and motivational-type posters may remain.
August 2011 18
Classroom Materials & Surfaces
What are acceptable materials on the walls, ceilings, floors, blinds, windows and clothing
during testing?
August 2011 19
Testing EnvironmentACTIVITY
ACTIVITY
Dictionaries & Thesauri for on-demand writing Calculators as designated in the
administration manual for that assessmentRefer to EXPLORE, PLAN & ACT manuals for
acceptable calculators Blank writing or graph paper, blank overlay
sheets, and bookmarks which are free of content
August 2011 20
Acceptable Materials
Sharing calculators during testing session
Leaving the testing area for calculators, dictionaries, thesauri, blank writing or graph paper, etc.
Having materials or information at the student workstation that was not sent as a part of the assessment
August 2011 21
Not Acceptable Practices
General Instructions“Do your best”“Stay on task”
Assistance or Evaluative Comments
“You can do better.”“You can write more.”
August 2011 22
Administration Practices
Accommodations for assessment shall be consistent with a student’s current IEP, 504 Plan or PSP.
Accommodations for one student shall not interfere or influence the assessment of another student.
Students who exhibit disruptive behavior prior to or during testing may be tested in a different location from their peers.
August 2011 23
Students with Accommodations
Restroom breaks are allowed, if the student is monitored at all times.
Lunch BreakTests should be scheduled to avoid lunch.If lunch is unavoidable, it should be brought to the
students in the testing area.If there are too many students to bring lunch to
the testing area, then students may be escorted to the lunchroom and monitored to prevent discussion.
August 2011 24
Breaks During Testing
August 2011 25
Do either of these classrooms display suitable arrangements for testing?
Why or Why Not?
All students in the same grade level in the same school must be simultaneously assessed in the same content area.• Students that are absent should resume
testing with their class in the section that the class is testing.• Example: A student that was absent for
Part A and returns to school when Part B is being administered will take Part B with the class. Then he will take Part A in a makeup session later.
August 2011 26
Testing Schedules
Time Limits and extended time for each assessment must be followed per the administration manual.
Students with extended time as an accommodation on an IEP, 504 Plan or PSP may have additional time during that school day.
August 2011 27
Testing Schedules
If a student is ill and cannot finish the test section, the student may complete that section later. The student may not return to previously answered parts of the section.
If a student leaves during the test session for a reason other than sudden illness, the student cannot complete the test section at a later time.
August 2011 28
Student Illness – vs. – Appointment
ACCEPTABLE – Instructional
Practice
• Continuing normal instruction during testing window
• Ongoing regular review of year long content
• Embedded test taking strategies in regular content instruction
• Test item retaken for disciplinary purposes
NOT ACCEPTABLE – Instructional
Practice
• Cessation of normal instruction during testing window
• Review of content based upon information from secure test materials
• Test prep courses with no link to Program of Studies
August 2011 29
Test Preparation
Test preparation or practice activities are not to be conducted instead of regular classroom instruction.
Teachers and other staff shall not be required to conduct test preparation or practice activities outside the normal work day.
August 2011 30
Test Preparation
Can include pre-writing requirement (type to be determined by the student)
Cannot require complete first drafts
Cannot include evaluative statements or grade assignments of test answers
Cannot give feedback until after test booklets are returned to the BAC or DAC
August 2011 31
Good Faith Effort
Shall be consistent with those applied within the regular curriculum or with the larger school program in general and attainable year round for student achievement.
August 2011 32
Rewards or Motivational Strategies
Follow School Food Services Guidelines and local and state boards finance policies.
Local school board funds or cash awards from school activity funds generated by students shall not be used for student incentives.
ESS funds shall not be used for test preparation.
Donations from individuals, businesses, parents or school staff can be used for student incentives.
August 2011 33
Funding of “Rewards”
Those providing accommodations must be trained in Administration Code and how the student uses accommodations.
Accommodations during an assessment shall be consistent with 703 KAR 5:070, Procedures for the Inclusion of Special Populations
August 2011 34
Inclusion of Special Populations
Students in program have primary ownership of assessment pieces
Yearly training for administration is required
Alternate Assessment components are secure materials
Altering results of Alternate Assessment components is prohibited
August 2011 35
Alternate Assessment
III. Violations of the Administration Code
for Kentucky’s Educational
Assessment Program
August 2011 36
All allegations, or perceived inappropriate testing procedure or behavior, should be reported to the Building Assessment Coordinator (BAC) and then to the District Assessment Coordinator (DAC).
If the DAC is the one not following proper procedure and does not correct or report the situation, a call or e-mail can be placed to the Allegations Coordinator in the Office of Legal Services by any concerned person.
August 2011 37
Reporting Allegations
Step 6District receives letter from KDE with action to
be taken
Step 5
Commissioner of Education makes final determination
Step 4
Board of Review makes recommendations to Commissioner of Education
Step 3
Findings reported to Board of Review
Step 2
KDE manages investigation process
Step 1
Allegation referred to KDE Allegation Coordinator
Alleged Testing Violation Process
August 2011 38
IV. Review of Secure Assessment
Components by Parents and Persons
not in the Employment of a Kentucky Public
School District
August 2011 39
Parents and Others not employed by a Kentucky Public School District may: review secure materials at the KDE office in Frankfort and not at the local
district.
A nondisclosure statement must be
signed before reviewing secure assessment components.
August 2011 40
Review of Secure Materials
V. Proper Reporting of Nonacademic Indicators (Attendance, Retention,
Dropout Rate, Graduation Rate and Transition to Adult
Life)
August 2011 41
Local districts shall:◦ report data to KDE.◦ inform KDE of any errors in reporting.
Data that is reported is lagged by one year.◦ Example: Information reported in fall will be
information regarding students in the prior school year.
August 2011 42
Nonacademic Data
VI. Signature Page
August 2011 43
August 2011 44
Signature Page – 1 page/person
Office of Assessment and Accountability
Division of Support and Research
(502)564-4394
[email protected] 2011 45