ISTEP+ Part 2 Pretest WorkshopSpring 2017

Agenda

General Administration Information ISTEP+ Online Details ISTEP+ Paper/Pencil Details Special Populations

• ISTAR• LEP Students

Return of Results Ethical Testing Practices

Grades 3-8, 10: Overview Separate test books/online test sections per content

area• 3-8, 10: English/Language Arts, Mathematics • Grades 4 , 6, and 10*: Science• Grades 5 and 7: Social Studies

*The grade 10 Science test is administered when students are enrolled in Biology I, no matter their grade placement.

Grades 3-8, 10: Details

ISTEP+ Grades 3-8, 10: Two testing windows required as part of the administration

• Part 1 (February 27-March 10) • Part 2 (April 17-May 5)

ISTEP+ Grade 10: ELA, Math notes• Used to calculate high school accountability in

2016-17, replacing the ECAs previously used for this purpose

• Becomes graduation examination beginning with Class of 2019 - Grade 10 students in 2016-17

Practice Test Flexibility

Practice Test• Purpose Ensure student access to item types Provide opportunity for student and teacher to engage with the

content

• Administration flexibility for Practice Test ONLY Order of test sections determined locally Begin once available Utilize instructionally “Test Examiner” may be any school staff member Answers are embedded in the practice test manual

Test Administration Flexibility Operational Test – Part 2

• Order of test sessions ELA or Math first; Followed by the other content area (ELA or Math) second Science or Social Studies third All sections in a content area must be administered in order

• Administration considerations Students may test with their content area teachers

• Paper/pencil test books and online test sections separate by content area

• School not required to administer same test section simultaneously to all students in grade with this option

• Be mindful of the total testing time for students each day.

Item Types: Part 2

ELA and Science• Multiple Choice Items (MC)• Technology Enhanced (TE)

• Online Only

Math Multiple-Choice (MC) Technology-Enhanced (TE)

• Online only Gridded-Response (GR)

• Paper/pencil only

• Social Studies Multiple-Choice (MC)

ISTEP+ Purpose

• The purpose of the Spring 2017 ISTEP+ assessment in grade 10:

• Assess student mastery of Indiana Standards• Administer the Spring 2017 ISTEP+ test for

accountability• Field test items are embedded in the test to use

during the future ISTEP+ administrations

The Grade 10 ELA and Math ISTEP+ tests are the graduation examination beginning with grade 10 students in 2016-17.

Grade 10: Asmt Design (ELA, Math)

Focus on domain-based assessments• Domain = content within a particular subject area

ELA examples• Reading: Literature and Nonfiction Vocabulary and

Media Literacy • Writing: Genres, Writing and Research Process,

Conventions of Standard English

Math examples• Number Sense, Expressions, Computation• Geometry and Measurement• Data Analysis, Statistics, and Probability• Linear Equations, Inequalities, and Functions• Systems of equations and inequalities• Quadratic and exponential equations and functions

Grade 10: Asmt Design (Science)

The ELA and Math tests are not aligned to specific courses, allowing maximum local flexibility for course sequences.

• Exception: Grade 10 Science (per SBOE direction) Test aligned to following standards (approx. 50/50):

• The Nature of Science• Biology I

Student participates in ISTEP+ Grade 10 Science Test when in Biology I course • Test administered in multiple grade levels

General Administration Information

All Students: Gr. 3-8, 10 Same rules apply to all grades regarding participation,

accommodations, test security

Results have implications for students, schools, and corporations • Remediation, accountability

Science and Social Studies required• Science: federal requirement (ESEA/ESSA)• Social Studies: state requirement (statute)

Applied Skills images released (parent portal)

Student Test Number (STN)

STN is critical for matching students across test windows (Part 1, Part 2) to produce results

• Avoid Undetermined results and impact on accountability• If you administer paper:

– Use your barcode labels– Bubble ONLY if a barcode label for paper/pencil is not available

One STN per student (stays with student) Schools must account for every student not

tested—keep records now to prepare for the DOE-NT collection.

DOE-TL Barcode File: OL, PP Period 2 Barcode file submitted November 28 – December 21 Period 3 Barcode file submitted February 13 – February 24

• Paper-Pencil Labels delivered by Mar. 31 with Part 2 test materials– ISTEP+ and IREAD-3 labels are NOT interchangeable

These same barcode files are used to “populate” PearsonAccessnext (PAN) for ISTEP+ Online (Part 1, 2) Sessions

For paper-pencil schools, even with a label, it is still necessary to complete the handwritten information at the top of the document in Box 1 and any accommodations or invalidations.

Student Transfer

• All student transfers are done in PearsonAccessnext (PP and OL)• A student arrives at the new corporation.• The new corporation collects student information, including STN and where he

or she was in the testing process at the previous school.• The new corporation goes into PearsonAccessnext and makes the transfer

request.• The previous corporation approves the transfer request in PearsonAccessnext.• The student test data transfers to the new corporation.• The new corporation testing online assigns the student to tests, places the

student in sessions, and begins testing the student or resumes testing.• The new corporation testing paper-pencil hand bubbles the test booklet.

15

ISTEP+ Online Details

ISTEP+ Online Calendar

Part 2

• March 14-May 5 Online Part 2 Practice Test Window

• Mid March Test Sessions Available in PearsonAccessnext

• March 27-31 Standard Edition Test Materials, TCM Delivery

• April 3-7 Accommodated Test Materials, (Large print and Braille), Read-Aloud Script and Examiner’s Manual Delivery

ISTEP+ Online Overview Part 1: ELA, Math, Social Studies, and Science Student test sessions may be created now

Practice Test Required • Online Practice Tests available in the PearsonAccessnext Training site

(sessions must be manually created using sample students)

ISTEP+ Online Devices

Requirements for tablets and devices include the following:• iPad 2 or later (9.5 in or larger)• Android or Windows tablets• Chromebooks• Thin Client configurations (if you tested this way last year)• Laptops (Windows, Mac, or Linux)• PCs (Windows, Mac, or Linux)

• All student devices need the current TestNav app installed

More information available at: https://support.assessment.pearson.com/display/TN/TestNav

ISTEP+ Online PearsonAccessnext

Operational site: in.pearsonaccessnext.comTraining site: trng-in.pearsonaccessnext.com

ISTEP+ Paper/Pencil Details

ISTEP+ Paper/Pencil CalendarPart 2

• March 27-31 Standard Edition Practice Test and Operational Test Materials, Examiner’s Manuals Delivery

• April 3-7 Braille test materials, Read-Aloud Scripts, Large Print (Practice Test and Operational) delivery

• April 3-May 4 Standard Edition Additional Material Order window

• Early April Predetermined Pick-up Schedule posted on the Indiana Resource Center

• April 10-May 4 Accommodated Material Additional Material Order window

• May 8-10 Scheduled pickups for corporations and nonpublic schools

ISTEP+ P/P Barcode Labels

Review Barcode Label guidance in the Test Coordinator’s Manual (TCM)

Not all data appears on the label; see the Student Roster for details

Bubble information for all “new” students without labels

Use ONLY labels for the Spring 2017 ISTEP tests• Securely destroy all unused labels after Part 2

ISTEP+ P/P LP, Braille, R-A Scripts

Large Print, Braille• Shipped directly to Corporation Test Coordinator• Process documents appropriately

See Appendix D for Large Print and Appendix F for Braille in TCM; avoid Undetermined results!

Read-Aloud Scripts • Ensure standardization of the test administration• Teachers are required to use the read-aloud scripts with

students who have an IEP that allows for such an accommodation.

ISTEP+ P/P CGR Computer-Generated Responses (CGR)

• Record critical student information at top of each page (see TCM)• There should only be one CGR item response per page• Use white paper (computer-generated)• Apply the Student Barcode Label to the appropriate grade and subject

assessment book then place CGR sheets on inside cover• Keep a copy in a secure location (principal’s office)• Indicate CGR under comments on your Session Header Summary. Fill out

an additional Session Header per grade level and subject for which there are students with CGR responses

• CGR bubble on front of test booklet (Y)• Locate a Pearson return box and apply the pink accommodated inbound

return label.

ISTEP+ P/P Materials Return SAVE YOUR BOXES!! (ISTEP+ and IREAD-3)

• Return in correct boxes - do not mix (Blue; Orange)

Please read directions! (TCM)

“Things To Remember” (TCM)

ALL student test documents must be returned• How will you account for every test document?

Teacher names, grade, and number of documents must match exactly on:• Session Headers and• Session Header Summary

These exact matches are critical

ISTEP+ P/P Packing & Shipping

ISTEP+ and IREAD-3: Use Paper Bands• Must be numbered sequentially• Secure with clear “office” tape• Be sure tape does not touch the session header or

assessment book under the paper band

Unique Barcode Shipping Labels (by school)

Be sure to use the correct shipping labels and boxes for each test!! (ISTEP+, IREAD-3)

Special Populations

Alternate Assessment: ISTAR

Indiana Standards Tool for Alternate Reporting (ISTAR)• English/Language Arts, Math, Science, Social Studies

ISTEP+ or ISTAR Decision• All students must participate in assessment; Case Conference

Committee decision to use ISTAR Referenced to Indiana Standards; will NOT lead to diploma Two testing windows

• Clarifying Participation No limit re: number of students who can participate in ISTAR Federal Regulation sets a 1% limit (for corporations and at the state

level) on the number of students who can be “counted as proficient on Alternate Standards” when calculating accountability

English Learners/LEP Students All EL students MUST take all portions of ISTEP+

• Except those enrolled in US schools < 1 year“Less than 1 year” definition:

students enrolled after March 1, 2016

♦MAY substitute WIDA ACCESS for ISTEP+ ELA Corporation-wide > 2 decisions!

1. ISTEP+ Grades 3-8 ELA2. ISTEP+ Grade 10 ELA

♦Must take Math and Science (Gr. 4, 6, & 10) or Social Studies (Gr. 5 & 7)

• Accommodations (refer to Appendix C)

Accommodations (SpEd/LEP)

Appendix C in the Indiana Assessment Program Manual• Outlines the standard accommodations for students with an

IEP, Section 504 Plan, ILP or Nonpublic School Service Plan Accommodations MUST be assigned in a student’s profile in

Pearson Access Next prior to testing– A tutorial on how to update a student’s profile with an accommodation can

be found at: https://www.youtube.com/watch?v=wpSxCA6vYF0&feature=youtu.be

Non-Standard Assessment Accommodation • Is one NOT identified in the Indiana Assessment Program Manual• Deadline to submit based on dates listed on the Request for Non-

Standard Assessment Accommodation form• Accommodation must be approved by Office of Student Assessment

Online Tool: Text-to-Speech

32

Play Text-to-Speech

Toggle Click-to-Hear

Text-to-Speech Settings

Return of Results

Results: Grades 3-8, 10

Preliminary results available 6/16

Rescore window 6/19-7/7

Final results 8/16

Results: Corporation/School All reports via PearsonAccessnext

• Secure site with unique passwords

• Contains FERPA-protected data! (Family Educational Rights and Privacy Act)

• Corporation- and school-level results Student-level data Summary-level data

• Teacher Access Determined by Part 2 Session Header (P/P) and Online

teacher groups

One paper copy of Individual Student Reports and Labels delivered to sites

Results: Parent Portal

Online parent access to student results Invitation Codes included on Individual Student

Reports and in Student Data Files available through PearsonAccessnext

• Distribute ISRs to parents upon receipt• School responsibility to reissue IC codes to parents, as

needed

Part 1 (Applied skills) Images linked to results in the Parent Portal• Parent review of student responses

Rescore information (Part 1)• Watch for more details

Invalidations

Documentation required for “Invalid” kept locally

Marking a student record as “Invalid” must be completed by:

ISTEP+ Part 2 – May 12

IMPORTANT: Invalidations MAY NOT BE REVERSED following these dates.

Contact Information

•Assessment Office INassessments@doe.in.gov Telephone 317-232-9050; Toll Free 888-544-7837 Fax 317-233-2196 Website http://www.doe.in.gov/assessment Learning Connection https://learningconnection.doe.in.gov

•STN Application Center: (800) 527-4931

•Office of Special Education: (317) 232-0570

•Office of English Learners: (317) 232-0555

•School Accountability: schoolaccountability@doe.in.gov

•Pearson: Indiana_Helpdesk@support.pearson.com (866) 683-6668

Next Section…

Ethical Testing Practices

Key References / Resources• Documents Pursuant to State Board of Education Administrative

Rule, 511 IAC 5-5 (updated documents!)

2016-17 Code of Ethical Practices and Procedures

2016-17 Indiana Testing Security and Integrity Agreement

2016-17 Protocol for Reporting and Investigating Alleged Breaches• CTCs be sure to review and share with staff so that all are

familiar with the process in the unfortunate event a test security concern arises.

• 2016-17 Indiana Assessment Program Manual Applicable chapters and appendices

In particular, Chapter 10 (Testing Policies, Administration, and Security)

References and resources are available via the web at www.doe.in.gov/assessment.

40

Monitoring• The purpose of monitoring is to verify that required testing

procedures and policies are being implemented and to provide technical assistance and support with regard to test administration and test security.

• The Office of Student Assessment may utilize both desktop and onsite methods of monitoring.

• Schools and corporations are encouraged to ensure that all necessary documentation (as described throughout this presentation) is appropriately filed onsite and readily available at the local level.

• Although there may be unannounced onsite monitoring visits, IDOE will notify corporations/schools in advance if selected for desktop monitoring.

41

Your Responsibility: Know and Understand

Read the 2016-17 Code of Ethical Practices and Procedures (the Code)

Read applicable portions of the 2016-17 Indiana Assessment Program Manual, including Chapter 10

Attend Testing Security & Integrity Training

Sign the 2016-17 Indiana Testing Security and Integrity Agreement

These steps are an annual requirement.

42

Roles and Responsibilities: Part 1• Roles/Responsibilities

• Superintendent Ultimately responsible for testing program

• Test Examiners/Proctors Responsible for test administration at the classroom- and

student-level

• School Support Staff Responsible for handling secure test materials when asked to

assist (e.g., helping to pack boxes, transporting test materials within the school or corporation) Reminder: Custodians and other non-instructional staff that have

access to test materials must receive test security training, review important test security-related documents, and sign the Indiana Testing Security and Integrity Agreement.

43

Roles and Responsibilities: Part 2• Roles/Responsibilities, continued

• Corporation/School Test Coordinators (CTCs, STCs) Responsible for implementation (including testing procedures,

protocols, and training) relative to staff training, testing security, test access, accommodations, custody of test materials, and reporting unethical behavior

Responsible for distributing assessment updates and key assessment communication to corporation and school staff

Responsible for maintaining documentation of staff completion of trainings and dissemination of assessment communication to staff

44

CTC responsibilities are outlined in three locations:• Chapter 10 of the Indiana Assessment Program Manual• Assessment-related Roles and Responsibilities document• CTC assurances section in DOE Online

Test Security Details: Part 1• Policy Requirement

• Every school corporation and school (including charter and accredited nonpublic) MUST have a written test security policy.

• Be sure to thoroughly review the 2016-17 Indiana Assessment Program Manual.

• A list of required components for locally developed test security policies is included.

• Simply copying/pasting the Code or Chapter 10 is not acceptable.

• Policy documents must be specific to the site and include all IDOE-required components.

• Documentation the Test Security Policy has been reviewed with staff must be locally kept on file.

• Documentation may be requested in the event the site is selected for monitoring.

45

Test Security Details: Part 2• Secure storage, administration, and return of test materials

• CTCs and STCs MUST:Control secure storage, distribution, administration, and

collection of tests (i.e., inventory and track materials)Critical: sign-in/sign-out systemIMPORTANT Note: A principal’s office, teacher’s room, or any location that anyone has unsupervised access to at any point is not considered a secure location for the storage of test materials, including online test tickets and access codes.

Ensure that no tests are copiedReturn all used and unused test materials

ALL test materials are secure, including paper/pencil and online materials (e.g., test tickets, access codes).

46

Test Security Details: Part 3

• It is a violation of test security to:

1) Give students access to test questions in advance2) Coach students in any way during the test3) Discuss, paraphrase, copy, reproduce, post/text/send via

social media, or use in any manner any portion of a secure test document or actual/paraphrased student response for any reason (including school newsletters and internal/external emails)

4) Permit students or adults to have cell phones in the testing room (only exception: for adults, if cell phone is the school’ s only means of communication regarding an urgent matter)

5) Alter answer documents before, during, or after testing6) Score student responses on the assessment before returning

documents for scoring

47

Test Security Details: Part 4

• If a concern arises regarding a test item….…contact the Office of Student Assessment via email

at INassessments@doe.in.gov or by calling 317-232-9050.

Refer to the item by grade level, content area, session or section number, and item number

NEVER make a copy of the item, paraphrase the item, or email the item (not even to the IDOE)!

48

Before Testing: Part 1

• Prepare students by providing standards-based instruction and using ONLY test items that have been approved and released by the IDOE.

Released = posted on the IDOE website

• Know and understand acceptable teacher practices, e.g.:Do – Practice appropriate test-taking strategies with studentsDon’t – Develop and use elaborate review materials

49

Per Chapter 10 of the 2016-17 Indiana Assessment Program Manual, all test preparation materials must be reviewed and approved by the CTC

or designee prior to use by teachers or with students.

Before Testing: Part 2

50

Teachers need to be good consumers of practice items, making sure the items used truly align to standards and not making the items exclusively the curriculum.

Examples of elaborate review materials include:• A large packet of review items that takes significant time away from

instruction• Review items that mirror actual test items• Drilling students on items from a review booklet that accompanies the

textbook or digital curriculum—teachers need to use best practice with these materials Again, teachers need to be good consumers—check for alignment, etc. Appropriate use of the items that align might include a daily warm-up activity.

Before Testing: Part 3

• Review Test Examiner qualifications Examiners must hold a license granted by the Indiana Department of

Education. (License must be instructional, administrative, or a school services license.)• 2016-17 IDOE monitoring may include a random sample review to verify

examiners meet this requirement

• Provide formal test administration training for staff on the mechanics of administering the test prior to the test window

• Provide test security training for staff regarding security policies/ procedures related to the particular assessment prior to the test window

Test Examiners and Proctors must be trained to understand testing procedures and their responsibilities as Test Examiners and Proctors.

51

Before Testing: Part 4

• Ensure staff administering assessments to students receiving accommodations

• are familiar with each student’s individual accommodations; and • have received training on accommodations prior to the test window

• Administer required Practice Test, if applicable

During 2016-17 monitoring, the IDOE may collect documentation of completed trainings, including 1) the mechanics of administering the test; 2) testing security policies/procedures; and 3) accommodations implementation.

52

Before Testing: Part 5

• Access to Examiner’s Manuals (EMs) Examiners must carefully review EMs prior to the test

administration. Examiners may keep the EMs following test administration

training for all assessments except IREAD-3.

For IREAD-3, early access to the TAM (Test Administration Manual) is permitted ONLY during test administration training, as the TAM contains test content. Teachers are not to discuss test content contained in the

TAM after the training session.

• Access to student test books/answer documents NO advance access to actual tests

53

During Testing: Part 1

• Examiners/Proctors must monitor test sessions to ensure that all students:

Follow instructions and record item responses in the appropriate places

Do not exchange answers and do not interfere with ordistract others

Use only permitted materials and devices; do not have access to cell phones or other unacceptable devices

54

To ensure implementation fidelity, Examiners/Proctors must focus entirely on the assessment administration during each test session.

During Testing: Part 2

• CTCs or STCs (or Designees) must monitor test administrations to ensure:

All examiners and proctors monitor students

Cell phones and other inappropriate devices are not accessible during testing

Appropriate accommodations are provided for students with an IEP, ILP, Section 504 Plan, or Service Plan

55

During Testing: Part 3

• Test sessions MUST be given in order by content area with one exception:

– If a student has been absent, the student begins or resumes testing with his/her class. Missed test sessions are made up during a scheduled

make-up session prior to the end of the testing window.

• Test Examiners and Proctors must provide any accommodations outlined in a student’s IEP, ILP, Section 504 Plan or Service Plan.

56

During Testing: Part 4

• If an issue or interruption to testing occurs, the Test Examiner/Proctor must notify the STC.

– The school shall investigate and report inappropriate testing practices or testing irregularities

• according to the 2016-17 Protocol (for test security concerns) in Appendix A of the Indiana Assessment Program Manual; or

• using the 2016-17 Testing Irregularity Report form in Appendix B of the Indiana Assessment Program Manual.

Test materials (including online test tickets and access codes) must be placed in a centrally-located, locked, secure area immediately upon completion of testing each day.

57

During Testing: Part 5

• Refer to Chapter 10 of the 2016-17 Indiana Assessment Program Manual for more information, including particular situations, such as:

• What to do if a student becomes ill during testing

• Testing specific categories of students, including:• Foreign Exchange Students• Homebound Students• Suspended Students• Expelled Students

58

After Testing: Part 1

• School and corporation staff members are responsible for proper disposal and return of secure materials following the test administration. Keep appropriate documentation locally on file

• Reports of incidents/events that might invalidate scores, including disruptions, illness, and possible cheating are to be submitted according to the 2016-17 Protocol.

Document security is important! All test materials are to be accounted for at the end of the testing window.

59

After Testing: Part 2

Remember…

• A specific test item is not to be discussed unless and until the item is released on the web by the IDOE.

Help staff members understand that reviewing test questions with students after testing is complete is not acceptable UNTIL the IDOE releases the item by posting it on the web.

Help staff members understand that discussing, texting, emailing, or posting actual or paraphrased test questions is not acceptable UNTIL the IDOE releases the item by posting it on the web.

60

What if…• If an assessment issue arises, please contact the

Assessment Office by calling (317) 232-9050 A number of events can occur; time is of the essence!

Document (Write it down at the time!)• Notes should include, but not be limited to, documenting who was

involved, the test section/session/materials involved, what happened, date/time/location of event/incident, etc.

Sample issues/concerns that could arise:− Test material issues− Test irregularities− Student or adult cheating− Student illness

− Interruption to testing− Exposure of items− Acts of nature− Inappropriate testing practices

Assessment Resources

• Visit http://www.doe.in.gov/assessmento Test Blueprints, Instructional & Assessment Guidance, and other

key information regarding specific assessments

• 2016-17 Indiana Assessment Program Manual

• Test Coordinator Corner (TCC)o Located in Learning Connection community

IDOE - Test Coordinator Corner For CTCs as well as one additional person identified by the CTC or

Superintendent

Contact Information• Assessment Office INassessments@doe.in.gov

Telephone 317-232-9050; Toll Free 888-544-7837 Fax 317-233-2196 Website http://www.doe.in.gov/assessment Learning Connection https://learningconnection.doe.in.gov

• STN Application Center: (800) 527-4931

• Office of Special Education: (317) 232-0570

• Office of English Learners: (317) 232-0555

• School Accountability: schoolaccountability@doe.in.gov

Whom Should CTCs Call?

Call Test Vendor Usernames &

passwords Student Login

InformationOnline testing issues Pencil/paper testing

materialsOther vendor related

concerns

Call Assessment Office

Policy issues

Test irregularities

Test security concerns Assessment program

information

Call STN App Center Barcode data file

questions or concernsQuestions about STNs