PRESENTED BY:STEPHANIE E . HASKINS

FEBRUARY 18 , 2015

Spring 2015Writing SOL Training

Training Agenda

• Timeline

• What’s New?

• Testing and Curriculum Resources

• Student Registration & Test Assignments

• Role of Examiners

• Reminders for Testing Coordinators

• Questions

- 2 -

Testing Timeline

Date Activity

Week of Feb 2 Non-secure Testing Materials Arrive

February 25 Data Upload File Due to DDOT

February 27 Secure material delivery (Paper/pencil)

March 3 Multiple-choice (Online AND paper)

March 4 Prompt (Online AND paper)

March 13 Return all testing materials (MS)

April 13 – 17 Term Grad Testing (Writing – Spring)

April 20 Return all testing materials (HS)

Closings or Delays

2-hour delay: Multiple-choice testing will continue on modified schedule. Short-paper testing will be rescheduled.

Closing: Testing will re-scheduled, and a new schedule will be communicated.

Testing Upload

Group Name: Consider how you want score reports to be organized. For high school, include note for Spring (i.e. Sp) to help organize reports.

Group Code: Will NOT appear on printed reports; allows for data sorts; Max 10 characters

Ethnicity/ Race: Hispanic; 32 categories ELL information: Test tier, composite, literacy, SOA-LEP, AYP-D SOA Transfer: Enrolled after 20th day – Sept 17th or after OR Feb 18th (*snow)

or after AYP: If a student began school ANY day AFTER the first day OR first day of

semester AND was NOT in our division last year, can be coded as AYP. May disregard reference to “September 30”. A: within division B: outside division/ within Virginia C: outside Virginia

Term grad: Scheduled to graduate by Aug 31, 2014; qualifies for 2nd attempt Project Graduation: High school only – Refer to definition in TIMS RP-Code: Genesis Retest: High school only – if retaking test Online Test: Students NOT marked as online should have documented need

Additions in RED andDeletions in RED

What’s New?

ALL Writing is combined to 2014-2015 in Pearson (versus Fall, Spring, Summer).

All short papers will be scored once by a human scorer and once by a computer. If disagreement exists, short paper will be scored again by human reader.

Term grads are NO longer automatically scored a second time; review during rescore process.

Test status revised to include parent refusal; Use version 2.0 of paper answer documents.

Special Test Accommodations (Appendix C/D) updated; added #30 (Read back student response).

Examiner manual and Test Implementation Manual – directions updated to include discussion of cell phones & cheating.

School affidavit updated to include return of paper/pencil documents.

Examiner and Proctor guidance from VDOE

Resources

School Test Coordinator HandbookStudent Data Upload File RequirementsTest Implementation ManualSupplement to Test Implementation Manual Examiner’s ManualPearson Access User’s Guide for the

Virginia Assessment ProgramVirginia Standards of Learning Assessments

Guidelines for Administering the Read-Aloud Accommodation

Resources

www.doe.virginia.gov/testing/scoring/index.shtml

Testing ResourcesTest Implementation Manual: Page iii: What’s New? Page xv: Checklist of STC Responsibilities Pages 18-19: Online Tools, Icons, Descriptions Pages 20-22: Testing Manipulatives Pages 28-31: Troubleshooting online testing Pages 31-33: Responding to Student Questions Appendix A: Test Security Appendix B: Test Transmittal Appendix C: Special Test Accommodations Appendix D: Table of Testing Accommodations

Testing ResourcesExaminer’s Manual: Checklist of Examiner Responsibilities What’s New? Applications for Test Preparation Reading the Prompt Online Tools, Icons, Descriptions Testing Manipulatives Accommodations Reporting test errors/ Test Irregularities Troubleshooting online testing Specific directions Answering student questions Directions for Submitting Tests Test security Special Test Accommodations

Curriculum Resources

www.doe.virginia.gov/testing/sol/standards_docs/english/2010/online_writing/index.shtml

SOL Writing Test Blueprint and Rubric SOL Writing Test Prompts Writing Practice Tools and Guides Writing MC/ TEI Practice Items and Guides Checklists for Writers

http://www.doe.virginia.gov/testing/sol/standards_docs/english/index.shtml

Standards and Framework Released Tests

www.staunton.k12.va.us(Assessment & Testing Services) SOL Writing Rubric

http://www.perspectiveforeducators.com/va Writing Scoring (Password is: Virginia)

Other WRITING Testing Reminders:

Review the test blueprint to make sure all writing standards are reviewed.

Review multiple-choice format using released practice items, including technology-enhanced items.

Writing prompts are all released. Students will write to one of the released prompts. Use rubric to evaluate Writing prompts – 2/3 of

score is composing/written expression & 1/3 is usage/mechanics.

Use editing checklist to self-evaluate writing. Use Perspective website for anchor papers,

practice papers, and verification sets. In addition to classroom use, this site could also be shared with parents for at home use.

Other WRITING Online PRACTICE Tips:

Use writing prompt practice tool (and guide) to respond to prompts and become familiar with tool.

Refer to Prompt Writing Practice reminders.

Paper vs. Online

Students who meet one or more of following criteria may be assigned a paper/pencil test:

Placement: Special situation school, homebound, Governor’s school

Accommodation requires paper/pencil: large-print, Braille, flexible schedule (multiple testing sessions requiring more than one day)

Documented medical condition: Exposure to computer will aggravate condition (i.e. seizure disorder, etc.)

Materials

Paper/Pencil

Multiple-choicePencilScratch paperShort paperPencilScratch paperDictionary

(Highlighter or pen of 1 color, as needed)

Online

Multiple-choicePencilScratch paperShort paperPencilScratch paper

(Highlighter or pen of 1 color, as needed)

Online Writing Tests: How

Creating test sessions for online SOL Writing tests:• One difference in test session management when

administering online writing:• Unlike a non-writing test administration

– One online SOL Writing test assignment will allow a DDOT or STC to add that student to two sessionsA session for the short paper component A session for the multiple-choice/TEI

component• Student must complete both components to have a

complete, scorable writing test• A student MUST complete both components in the same

mode

Online Writing Tests: How

Creating an online Writing Test Session

Online Writing Tests: How

Creating an online Writing Test Session (continued)

Online Writing Tests: How

Online Writing Tests: How

Online Writing Tests: How

Online Writing Tests: How

In a writing test administration, the two components (MC/TEI and short paper component) will show individually on the Student Test Details screen for an online SOL Writing test.

Online Writing Tests: How

Special test accommodations will be recorded on the Student Test Details screen for each component of the writing test. If the same accommodation is used on both components, it is coded only once.

Sample ScreenThis appears after the student successfully logs in.

Sample ScreenThis appears after the student successfully logs in.

The sample screen is a picture of the Student Response Area that the Examiner refers to in the test directions read to students for the Short Paper component. Students are not able to type in the sample screen.

The tools on the TestNav Toolbar on the sample screen ARE active.

The Student Response Area and the Response Tools are NOT active on the sample screen.

Exhibit Window from the Sample Screen Includes 4 different tabs

The text “SAMPLE PROMPT” appears on the first tab of the Exhibit Window when the student is on the Sample screen.

Exhibit Window from the Sample Screen Window can be resized

Exhibit Window from the Sample ScreenThe Checklist for Writers is on the 2nd Tab

Exhibit Window from the Sample ScreenThe Shortcut Keys are shown on the 3rd Tab

Exhibit Window from the Sample ScreenCopyright Statement is shown on the 4th Tab

(This does not appear after the Sample screen.)

Student Response Screen:Appears after the Sample Screen

Exhibit Window from the Student Response Screen Three tabs (Prompt, Checklist for Writers, Shortcut Keys)

The SOL Writing Prompt will appear on the first tab of the Exhibit Window when the student opens it while on the Short Paper screen. The tabs with the Checklist for Writers and Shortcut Keys are also active.

Special Test Accommodations: Online Writing (2010) Audio Test

Audio on the online Multiple-Choice/TEI component• Assign the audio form to the student in the online test

session• Audio player appears in the lower right of the screen on the

first test question, after the sample item(s)• Same format as non-writing audio tests – starts to play

automatically as the student navigates to each test itemAudio on the online Short Paper component

• Assign the audio form to the student in the online short paper test session

• Audio of the prompt will not begin until student clicks “Play” button

Audio Symbols for Tests

Audio Symbols for Tests

NOTE: Read-aloud CANNOT be created for short-paper test. The session must be created as a “regular” test session. ALL students may have prompt read to them.

Special Test Accommodations Online Writing (2010)

Audio Short Paper Component

Audio of the prompt will not begin until the student clicks the “Play” button

Test Security Agreement

READ all Test Security Agreement prior to signing and administering any SOL assessment.

Role of Examiners/ Proctors

During test administration, Examiners/Proctors must monitor the testing process by moving as unobtrusively as possible about the room. They should ensure that students are working independently and do not have access to unauthorized materials.

Answering Student Questions

Examiners/ Proctors MAY answer questions regarding technical issues of the assessment.

They may NOT answer questions that would provide any hint or clue with regard to the assessment.

Examples of Technical Questions

Scrolling: “To view all of the reading passage, use the scroll bar to the right of the passage to move the page up and down.”

Navigating the test: “To move to the next question click Next”; “To go back to the previous question click Previous”; “To go back to a question from the review screen click on the question’s number”; “To submit your test click the Submit the test button”; “Go back to the test item to make sure the Pointer was used to indicate the answer.”

NOTE: Examiners/ Proctors may NOT use the student’s mouse or keyboard to navigate any portion of the test for the student.

FAQs

When a student has completed testing can the test examiner scroll down the review screen (look over the student’s answer section on the answer document) and make sure the student has an answer for every question?

No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). The Examiner may only tell the student to “read the screen carefully” (online) or to “review the answer document carefully” (paper).

FAQs

We are concerned that our students might select the wrong button to submit their tests. Can the examiner submit the test for the student?

No. The examiner must not touch the student’s mouse (avoid the appearance of providing assistance). Directions in the Examiner’s Manual state, when students are ready to submit their tests for scoring, they raise their hands. The Examiner gives permission to the student to submit and may say, “to submit your test click on the 3rd button which says Submit the test.”

Guidance for Submitting a Test

GRADES 6-8 & EOC: If examiner sees that student has unfinished items, examiner may only tell student to “Read the screen carefully.”

43

FAQs

If the student does not remember how to use one of the tools, can the examiner show the student how to operate the tool?

No. The examiner may say, “for help with a tool, click on the help icon (life preserver) on the tool bar.”

FAQs

Can staff and students get practice with the various functions on a test before live testing?

YES! Students and staff may practice the login process, using tools, navigation, and submitting tests by taking a Training Center Test or by using the practice TestNav items. Students who have the audio accommodation may practice the audio controls also by taking the Training Center Test in audio format. Look for Applications for Test Preparation in the TIM and Examiner’s Manuals for several other applications to help students.

FAQs

If an examiner observes a student not writing to the prompt, can he or she tell the student to read the prompt and make sure you are writing to it?

No, they cannot address individual students. The examiner can remind the entire class to “Read the topic carefully and write a short paper about it.”

FAQs

Are parents or students permitted to have a copy of their child’s short paper after scoring is complete?

Yes. Parents may not have the un-released prompt however, just the student’s response to the prompt. Students cannot request the paper, the parent has to request it.

FAQs

Can a student’s parent sit in the testing room with their child during testing?

No, only test examiners/proctors and staff that are essential to testing (all of which have been trained and have signed the test security agreement) are permitted in the secure testing environment.

FAQs

Can a teacher review a new test to get a feel for the type of questions that are being asked?

No, this is what released test items and practice items can be used for. Anticipated Released Tests Schedule for the “new” SOL

History/Social Science (2008 SOL) Spring 2013 Mathematics (2009 SOL) Spring 2014 Reading (2010 SOL) Spring 2015 Science (2010 SOL) Spring 2015

FAQs

While testing: Can I write notes of encouragement and put them on students’ desks, or can I verbally encourage students to do their best on the test, or pat them on the back to show support, etc.?

No, none of this is permissible during the test session. These actions can give the appearance of inappropriate assistance and can result in an investigation and possible retesting.

STC Reminders . . .

Proctor Authorization Tickets and Student Authorization Tickets – These tickets should be printed no more than 4 days prior to the test window start date and must be stored in a secure location until needed.

Start the test session the day of the scheduled session. Use the Examiner’s/ Proctor’s Test Booklet/ Test Ticket

Transmittal Form/ Affidavit to distribute and collect test tickets and materials to examiners. Provide Examiners extra copies of the formula sheets and the Periodic Table of the Elements, where applicable.

Ensure that all examiners/ proctors have allowable test manipulatives. (Refer to instructions in TIM and Examiner Manual for clearing calculator memory.)

More reminders . . .

View the status of each test session through Session Details screen (Ready, Active, Exited, Resumed, Resumed-Upload, Submitted, Processing, Completed, Marked Complete).

Add, move, and remove students from test sessions, as needed. Students who are absent on the day of testing must be removed/moved from the session before it can be stopped.

Stop all online test sessions at the end of the day. All students must show a Completed status on the Session Details screen. Any students with a Not Started, Exited, or Resume status must be removed/ moved to a make-up or irregularity session before stopping the test session.

More reminders . . .

Moving a student: If students are moved to an alternate testing site to complete their tests, their Student Authorization tickets must be collected by the Examiner or Proctor prior to the move and redistributed only after the students are settled in the new location. While in transit, students must not be allowed to discuss the test with anyone or have access to educational materials.

Their online test must be Exited prior to being moved to the new location. Before the student can log in (using the same information on the test ticket) to complete their test, the student’s test must be Resumed in Test Session Management.

Testing Irregularities

Report any irregularities within 24 hours.

MOST Common Irregularities:#1 - Student unable to complete test#2 - Accommodation not provided or inappropriate

accommodation provided#3 - Test inappropriately marked complete#4 – Wrong test#5 - Inappropriate manipulative

Marking Tests Complete

Mark test complete guidelines: Every student identified for testing must be accounted for via an online test or a paper document, including students who were not tested because they: Were exempt due to LEP Were absent during the entire testing window Refused or were disruptive Cheated Were involved in a medical emergency Failed the course but passed the test and are retaking the

course Took a substitute test for verified credit

Move these students to a new session and the DDOT will mark these tests complete at the conclusion of testing.

Other reminders . . .

Testing Accommodations: Add Test-Specific data in PearsonAccess to indicate what accommodations were provided to the student under the Test Details screen of PearsonAccess. (Temporary Accommodations may be handled through the upload or under Student Registration.)

Student Alerts: Clear all student alerts for the school, when possible. Ask if there are questions related to alerts.

Be sure that the RETEST flag is selected on the Test Assignment screen for every student who is retaking the test for verified credit.

Test Alerts and Reporting

Must have both components completed in the same mode to be reported as a complete test

New alerts will be used such as:• Unmatched Test Component

– Either the online short paper or online MC/TEI component is not complete

Additional details to be provided regarding Student Test Alerts and Accessing Score Reports

- 57 -

High School Only:

Substitute Tests: If a student is enrolled for the first time in a course that requires an EOC test and has taken or will take an approved substitute test in place of the EOC tests, include in upload and select Testing Status code 10. If a student has failed an EOC test and takes an approved substitute test as a retest in an attempt to earn a verified credit, complete Testing Status code 10 AND set Retest flag to Y.

Questions?