science statewide summative field test
TRANSCRIPT
Science Statewide Summative Field Test
2
A SYSTEM of Science Assessments
3
} Built on teaching and learning in classroom
} Each component adds and elicits new evidence of students’ learning
} Defensible evidence of student attainment of the standard – as the standard was intended – is generated
} Supports different purposes/users/uses
Classroom Embedded
Assessments
Statewide Summative Assessment
Through-Course Tasks
PE
KDE:OAA:DAS: js: 1/17/2017
December DAC Monthly Webcast provided an overview of the science system of assessments including DAC’s role.
Field Test Purpose
4
• Psychometric analysis of item types • Engage students with items • Observe administration • Prepare for operational assessment
KDE:OAA:DAS: js: 1/17/2017
Science Summative Field Test
5
High Schools P Arrival week of March 6 P Test Window upon arrival of
materials through week of March 27
P All students at Grade 11 P Return by March 31
KDE:OAA:DAS: js: 1/17/2017
Elementary/Middle Schools P Arrival week of March 6 P Test Window March 13-17 P All students at Grades 4 and 7 P Return by March 24
P All schools will be involved P Student combined booklet (no separate answer document) P No student performance levels generated
P Operational test for Alternate Assessment for 2016-17 P Alternate Assessment student performance levels reported
Materials – Science Field Test } Regular and accommodated (large print) test materials will
arrive in the district week of March 6. } Test materials arrive in the district packaged by school.
} Student combined booklet
● Students answer in the test booklet (not a separate student response booklet)
● Pre-populated with student information
} Test materials will include an overage: ● School will receive 5% ● District will receive 3%
6 KDE:OAA:DAS: js: 1/17/2017
Bundle Science and Engineering Practices
Disciplinary Core Ideas Crosscutting Concepts
Storyline around a
Phenomena
Cluster MC and
Extended Response
7 KDE:OAA:DAS: js: 1/17/2017
Construction of Items
Forms – Science Field Test
8
• Multiple (20) forms per grade level • Clusters of items • Transition between clusters
• “Directions” page per cluster • “Go On” • No breaks
• Two clusters per form
KDE:OAA:DAS: js: 1/17/2017
Cluster Format
9
• Clusters contain multiple choice and extended response items • Typically six multiple choice and two extended
response questions • Multiple choice
• Question will specify number of correct responses
• Could have more than one correct answer • Potentially have more than four choice
options, eight at most
KDE:OAA:DAS: js: 1/17/2017
Cluster Format (continued)
10
• Extended Response • Limited to no more than one page • Response could be required in same box as
stimulus • Stimulus could be on separate page • To provide full page for student response • Response pages can look very different from
K-PREP response space
KDE:OAA:DAS: js: 1/17/2017
11 KDE:OAA:DSR:
12 KDE:OAA:DSR:
13
Student Combined Booklet
KDE:OAA:DAS: js: 1/17/2017
Student Combined Booklet } Correct pre-printed Student Combined Booklet ● Use Student Combined Booklet as is. ● Following instructions in TAM, grid Accommodations given
(large-print) } Incorrect pre-printed Student Combined Booklet ● Void the Student Combined Booklet. ● Assign a new let Student Combined Book following gridding
instruction in the script portion of the TAM. ● Enter correct information into IC.
} No pre-printed Student Combined Booklet ● Follow gridding instruction in the script portion of the TAM.
} Any voided Student Combined Booklet must be returned to Pearson (excluding voided with bodily fluids)
14 KDE:OAA:DAS: js: 1/17/2017
Accommodated Materials – Science Field Test
15
• Students with IEP, PSP and 504 plans may receive accommodations
• Large-print available • Visually impaired and hearing impaired students use
Form 1 • Without audio and text reader,
• Human readers are needed • BACs may organize small student groups with only a
reader accommodation by form within the grade span • Extended time (time and a half - up to 105 minutes,
double time – up to 140 minutes) • Non-standard response template will be available
KDE:OAA:DAS: js: 1/17/2017
Extended Response Spaces
16
v Answer boxes look very different v Will have only ONE NSR template while book
has many different looks v Labeled parts A, B and C can be moved up or
down based on student need v Student may use NSR template created for
Science Field Test to type and graph paper for drawing as long as everything is taped inside the box
v Be careful tape cannot cover the timing tracks
KDE:OAA:DAS: js: 1/17/2017
17 KDE:OAA:DSR:
Example 1 Example 2
Scheduling – Science Field Test
18
• Pre-test activities • On day of testing, follow gridding instruction in the
script portion of the TAM. • Test administration
• Seventy minutes (70) maximum • No break provided
• Post-test survey • Elementary and Middle – Four Questions • High – Ten Questions • Yes/No Answers and Agree/Disagree at high school • Example: I understood what the questions on the test
were asking me to think about or do. KDE:OAA:DAS: js: 1/17/2017
Scheduling – Science Field Test
19
• Testing date determined by individual school, all students take at same time within the school.
• Makeup test sessions are optional. • First Year English Language Learners attempt
four multiple choice items or one extended response item.
• Foreign Exchange and students in Alternate Assessment program will not take part in Science Field Test.
KDE:OAA:DAS: js: 1/17/2017
Monitoring Visits– Science Field Test
20
OAA and OTL Staff • Observations • Collection of student time on testing data • Questions about testing
KDE:OAA:DAS: js: 1/17/2017
Support Materials – Science Field Test
21
• DAC/BAC Manual • Test Administration Manuals (TAM) • Calculators Optional
KDE:OAA:DAS: js: 1/17/2017
Inventory and Return of Materials } Inventory materials as soon as possible upon
receipt. } Keep original boxes. } Original boxes will be used to return test materials. } Request additional materials if needed. } Check district and school overage before placing an
additional order.
22
Note: Do not exchange test materials between schools in or out of the district in lieu of ordering additional materials.
KDE:OAA:DAS: js: 1/17/2017
Requesting Additional Materials
} PearsonAccess } Online orders must be submitted and
approved prior to 1:30 p.m. ET to be included in that day’s shipment.
} Requests for additional test materials can be made through March 24.
23 KDE:OAA:DAS: js: 1/17/2017
Test Security Training } Administration Code and Inclusion of Special Populations w/signatures Signatures } Student Honor Code } Nondisclosure Agreement } Appropriate Assessment Practices Form } DAC/BAC Certification of Proper Test Administration Documentation of testing } Seating charts (all required tests) } Testing room location codes Observations } KDE staff will observe testing } Cover/remove classroom posters
24 KDE:OAA:DAS: js: 1/17/2017
Allegations Possible
Science Through Course Tasks
25
Science Through Course Tasks
26
• Provide snapshots of student learning/thinking/application (and models of quality 3-D tasks) of the science standards; teachers working collaboratively analyze students’ work to calibrate expectations and confer on instructional implications/next steps to promote learning
KDE:OAA:DAS: js: 1/17/2017
Science Through Course Tasks
} One (1) task per grade K-12 from every district
} Before submitting ● Remove the student name ● Write the name of the district on the paper ● Write the name of the task on the paper ● Write the student's grade level on the paper
} Complete Summary Form
27 KDE:OAA:DAS: js: 1/17/2017
Submitting TCTs to KDE Send TCTs to KDE by April 14
Option 1 Electronic copies uploaded to SharePoint (Link will be provided in a Monday DAC E-mail)
Option 2 Paper copies mailed to:
Kentucky Department of Education 300 Sower Boulevard, 5th floor NE Frankfort, KY 40601 attn: Mindy Curless TCT collection 28
KDE:OAA:DAS: js: 1/17/2017