MINNESOTA COMPREHENSIVE ASSESSMENTS

School Assessment Coordinator Training

Spring 2014

1

Online Assessments

MCA Math grades 3-8

MCA-Modified Math

MCA-Modified Reading

MCA Science

MCA Science with accommodations

MTAS data entry

MCA some paper accommodations data entry

2

New for 2013–2014

• Spring 2014 Title pages appear at the beginning of each reading passage on the Reading MCA.

• 2013-2014 fewer reading passages and more test items per passage to answer.

• Spring 2014 is the last year for Reading and Mathematics MCA- Modified.

3

SAC Responsibilities School Assessment Coordinators are responsible for:• uploading the Secure Browser on student testing computers, • scheduling/organizing all tests, • providing access to AIR and training the Test Monitors & Data Entry staff,

and• running the diagnostic tool on a computer in the testing lab, if not done

during the OLPA window.

Monitors and/or SACs are responsible for: • starting the tests,• approving the students taking the online tests, and• actively monitoring students during the test.

Information Technology is responsible for the hardware & software that will be used for online assessments **Create an online testing ticket** if you have technology problems.

4

Online Test Security Issues

• Nondisclosure Agreements• Everyone with secure access to AIR must complete the

online nondisclosure form in TIDE.

• Test Monitors & data entry personnel must accept the agreement in TIDE or they will not be able to monitor tests or enter student responses.

• Everyone with access to the test items but who does not have secure access to AIR needs to sign a paper version of the Nondisclosure Agreement.

• Required: one signed nondisclosure agreement per year.

5

American Institutes for Research(AIR)

AIR Secure Browser - - New 6.0Must be installed on all student computers.

To install A.I.R. Secure Browser icon, login to each student computer with:Username: airPassword: air

Wait…then look for the icon on the student desktop.This could take a few minutes (5-10).

6

SAC Online Check List

___ Install the new secure browser on the student computers if needed.

___Run System Diagnostics from one student login screen within the secure

browser - one computer, one time, if needed.

___Know your username (email address) and password.

___Create user accounts for monitors & data entry personnel.

___SAC, monitors & data entry personnel MUST complete the online Non-Disclosure

Agreement.

___Create class lists with student names and MARSS numbers from AIR TIDE or

CAMPUS.

7

School Assessment Coordinator(SAC) Meeting February 11 & 13, 2014

• Online MCA Modified (MCA-M) Reading and Math

• MATS Reading, Math and Science

• Online MCA Science

• Paper/Pencil MCA Reading

8

Online MCA-Modified (MCA-M)Reading & Math Test Window

• March 17 – May 9

• Grades 5 – 8

• Included in the participation and proficiency calculations for NCLB

9

MCA-Modified (MCA-M) Reading& Math Tests, cont.

• For some IEP students in grades 5-8, who don't qualify for the MTAS but meet the MCA-M criteria developed by MDE.

Does Not Meet standard on MCAs in the subject for two previous consecutive years is one requirement.

• Given online and/or with paper accommodations.

• IEPs need to document the use of these tests and accommodations.

10

MCA-Modified (MCA-M) Reading& Math Tests, cont.

• Math scripts, large print & Braille are available for the MCA-M.

• Once a student takes a modified test, they may continue taking modified tests regardless of their previous MCA-M result.

11

MTAS Reading, Math and ScienceTest Window

• March 17 – May 9

• Learning Characteristics Inventory (LCI) and assessment results must be entered into the AIR Data Entry Interface by school staff.

• Reading, math & science are included in the participation calculations for NCLB.

• Reading & math results are included in the proficiency calculations for NCLB.

12

Online MCA Science Test Window

• March 17 – April 10

• 95% participation required for NCLB

• Grades 5 & 8

13

Accommodations and Options forAll Assessments

IEP/504• Accommodated Text-to-Speech

• MCA-math paper scripts must use paper tests*

• Mod Math & Science scripts are used at the computer

• 12-pt paper tests*

• Large print paper books must use paper tests*

• Braille*

• Hand-held calculator must use paper tests for MCA-math*

• Other IEP/504 required accommodations

• See Procedures Manual, pg 90

ALL students• Text-to-Speech

• Small group

• See Procedures Manual, pg 95

ELLs• Accommodated

Text-to-Speech• Paper MCA-math scripts must use paper tests*

* responses must be entered into the Date Entry Interface in AIR14

Accommodated and RegularText-to-Speech Online Options

ALL students have the Text-to-Speech (TTS) option

IEP/504 & ELL students may use Accommodated Text-to-Speech (ATTS) if required in their plans

• Chart title, X & Y axis titles are read to the student, not numbers or formulas

• Students record in AIR must be set to ATTS before the student is approved for testing

• Send names of students who need ATTS to your DAC or…….. Complete it yourself in TIDE Student Information or just before approval to test!

The ATTS is already turned on for most students who have it in their IEP!

15

Large Print Test Books, 12 pt Paper Tests, Scripts, Braille and MTAS

• Student responses must be entered into the AIR Data Entry Interface (DEI) for all tests or accommodations that require a paper/pencil test or accommodation

• MTAS Learner Characteristics Inventory and test responses must be entered into DEI

• Responses from students using paper test books (12 pt or large print), scripts, & Braille must be entered into DEI

• Manual for DEI is posted on AIR General Resources and REAs Test Coordination web site

16

Precode Files Loaded to AIR

• MARSS student data is first uploaded to AIR on January 24th

• Updates from CAMPUS to MARSS to AIR will occur frequently during the test windows

• Accommodations and test type (i.e. MCA, MCA-M, MTAS, scripts) are made available for each student after information is updated overnight to AIR

• Notify your DAC ASAP if you have any changes in student test types or accommodations

• Most changes will be available overnight

17

Training Online Test Monitors

• Determine Test Monitor Tasks• Turn on student computers & login using air as username and

password?• Click on student's desktop?• Login students using MARSS # and first name as it appears on

CAMPUS?• Prepare before students enter the lab

• Test Session Monitoring• Starting a session• Approving students to begin their tests• Adding Accommodated Text-to-Speech to some students before

approval to begin the test• Troubleshooting

• Review Test Monitor Directions

18

Training Test Monitors, cont.

Test Session Security• Provide student MARSS numbers and first

name as it is on CAMPUS.

• MARSS numbers are secure information and must be collected and shredded.

• Maintain test security during entire test session.

19

Online Test Security Issues

• Nondisclosure Agreements• Everyone with secure access to AIR must complete the

online nondisclosure form in TIDE.

• Test Monitors & data entry personnel must accept the agreement in TIDE or they will not be able to monitor tests or enter student responses.

• Everyone with access to the test items but who does not have secure access to AIR needs to sign a paper version of the Nondisclosure Agreement.

• Required: one signed nondisclosure agreement per year.

20

21

Administration Mode

Format

Paper Administration

Four-page document containing instructions for Test Monitors and script to be read aloud to students

Online Administrations

Online Test Monitor Directions presentation that is projected for studentsInstructions for Test Monitors document contains instructions for Test Monitors

Paper Accommodations for Online Tests

Multi-page document containing instructions for Test Monitors and test-specific script that is read aloud to students

Test Monitor Directions

All Test Monitor Directions are available on theTitle 1 Test Monitor Directions page in AIR.

Computer Glitches & Restarts

If a student is kicked off the system:• Browser shuts down after 20 minutes of inactivity.• Student simply logs back in with current session ID.

If SAC or Monitor session is stopped or logged off:• SAC/Monitor starts a new session and students log back in using the new session code. • The test will pick up where student left off. • The student's test and responses are linked to their MARSS number, not to the session code.

22

Online Irregularities Examples

Scenario Likely Outcome

Student started or completed an assessment for the wrong grade or student started or completed wrong assessment because of Test Monitor misadministration (e.g., MCA instead of MCA-Modified).

DAC invalidates wrong test in TIDE. District changes grade in MARSS or test assignment in Test WES. The new test eligibility is sent to AIR and the student can test once correct information appears in TIDE.

Student uses a handheld calculator in conjunction with the online Math OLPA or MCA.

DAC invalidates the test in TIDE.

23

Online Irregularities Examples,cont.

24

Scenario Likely OutcomeStudent was kicked out of the test because of technical difficulties and cannot go back and review previously completed pages.

Student begins where he or she left off without review of previously completed pages.

Student starts testing on form that doesn’t match script (Math MCA-Modified and Science MCA only).   

For Math MCA-Modified and Science MCA, options for the district: • Student finishes without script.

Accommodated text-to-speech can be used. The Test Monitor cannot read the items from the screen.

• Student does not complete test. DAC invalidates test in TIDE.

24

• MCA and MCA-Modified• For all grades subjects, and administration

modes.• Students must respond to 90 percent of the

total number of items in the assessment to receive a valid score.

• Students responding to six or more items but fewer than 90% receive a NC score code.

• Students responding to fewer than six items receive a NA score code.

Grades 3-8 Valid Score Rules

25

Paper/Pencil MCA READING

MCA Reading Test Window

for Grades 3-8

Apr 15 – May 2

26

SPPS MCA-Reading Testing Schedule

Grade and Test Test Administration

Mode

Minutes per Segment

(student work only)

Minutes per Segment(total test

administration)

Total Test Administration

3-8 Reading MCA Paper 30-45 minutes 45-60 minutes 3-4 hours

27

Not Following the Schedule is a Breach of Security

Tuesday, April 15 Reading Segment 1Wednesday. April 16 Reading Segment 2Thursday, April 17 Reading Segment 3Tuesday, April 22 Reading Segment 4

Minnesota Department of Education

Estimated Testing Time

• One segment per day

• Students must be allowed extra time as long as they are making progress

• Schools must have at least 95% participation on all MCAs in all subgroups to make AYP/MMR

• State accountability window is April 14-25

28

Important Information for 2014

• MTAS test materials will be delivered on March 4 or 11.

• MCA paper test materials will be delivered on March 18.

• For New-to-Country students, a MCA reading answer document with the NTC bubble filled in must be returned for processing whether or not the student attempts the test.

29

Receiving MCA Materials

• Before you open the boxes… make sure they all belong at your school, verify you have the correct number of boxes, open the white coordinator box first, verify you received everything on the packing list and keep boxes to use when returning materials.

• Secure materials must be kept in a locked location when not in use.

30

Receiving MCA Materials, cont.

• Secure test materials include...... Anything that contains a test item is a secure item

• Regular & Modified test books• Grade 3 test/answer books• Math CDs• Math scripts• Large print test books• Braille test books

31

Receiving MCA Materials, cont.

• Non-secure test materials SAC/DAC Manuals and monitor directions Grade 4-8 answer documents School/Grade Header Sheets Red dots for grades 4-8 test books Blue striped district/school labels

• Use the school packing list from the white box to inventory your materials. Contact Robin immediately if anything is missing or if you need additional materials.

32

Returning MCA Materials

• Apply one colored DRC label and one white UPS label to every box being returned• Answer Documents are returned separately from

secure materials• Paper Bands are used to help organize materials• DRC colored labels

• Turquoise color label answer document boxes OR• Rose color label for secure materials boxes

• barcoded labels• One on every box K2 white

33

Answer Document Problems

• New students without pre-ID answer docs• First name, last name• Date of Birth• Gender• MARSS number (State ID on CAMPUS)• MARSS LOC DIST DATA

• School Number + blank space + CIF [local student ID]

• i.e. 512 123456• Blue-stripped district/school labels for hand bubbled-in

answer documents

34

Answer Document Problems, cont.

• Wrong grade or wrong MARSS # on Pre-ID answer doc or label• MUST complete a new answer document• First name, last name• Date of Birth and Gender• MARSS number (13 digit State ID on

CAMPUS)• MARSS LOC DIST DATA

• School Number + blank space + CIF (local student ID) i.e. 512 123456

• Blue-stripped district/school labels for hand bubbled-in answer documents

35

Answer Document Problems, cont.

• Wrong birth date, gender, name• Use the answer document.• Verify that the correct information is in

CAMPUS.• Correction will be made during the

verification process.

36

Paper/pencil Answer DocumentsOnline codes and demographics info.

• Test Codes

ABS = absent

INV = invalidates test, student refusal

ME = medical excuse with medical verification

REF = parent refusal

• Accommodation Codes MUST be filled in for:

Responding to the tests

CA = computer assistive technology

SC = used a scribe during the test (requires a TAR)

37

Other Answer Document Grids

• Accommodation Codes may need to be filled in for: Presentation of the tests

18 or 24 = large print test books

BR = Braille test books

MC = math CD

MS = math script read to student

OA = other accommodation

TD = translated directions (requires TAR)• Complete New-to-Country (NTC) Bubble-in if needed.

Online accommodations may be entered in the student record in AIR. Send ME, INV, REFs, NTC to Robin Lane, REA at

360 Colborne.

38

ME, INV, REFs, NTC for onlineME, INV, REFs, NTC for online

Student ‘FLAGS’

• To use test accommodations students must have “Flags” on CAMPUS to denote....• Special Education/504 Plan Students

• May use accommodations if documented in their IEP.

• English Language Learners – hover over the flag!• May use some specific accommodations as listed in

the MDE Procedures Manual beginning on page 97.

• Accommodations do not change the rigor of the assessment.

39

Special Education/504 Plan Students• All Special Ed students must take the MCAs, MCA-Ms or

the Minnesota Test of Academic Skills (MTAS)- no one is exempt from testing.

• Only students who meet specific criteria may take the MCA-Ms or MTAS.

• The use of the MCA-M or MTAS must be documented in the student’s IEP.

• Most Special Ed students will take the MCA or MCA-Ms.• All accommodations must be documented in the

student’s IEP.

40

Special Education Students

• Special Ed students may have accommodations as documented in their IEPs. They may• have the math test read to them using the math

script,• use a large print test book and answer

document,• use computer assistive technology,• use ‘other accommodations’ as documented in

their IEP.

41

Immersion Emergent Bilingual Learners• All ELL students in appropriate grades must take the

math and science tests.

• Most ELL students in appropriate grades must take the reading test. (see next slide)

• ELL students may have the math script read to them.

• If you need a script, send student name and MARSS# to your DAC, Robin Lane at robin.lane@spps.org.

42

Immersion Emergent Bilingual Learners, cont.

• New-to-Country (NTC) ELL students• are students who have been in the USA for less

than 12 months on the first day of the test window• do not have to take the MCA reading.

• Testing Office/ELL Dept. will develop a NTC list for you closer to the test window.

• Reading answer documents for these students must be sent to DRC with the New-to-Country bubble filled in.

43

Test Security for Paper & Online Accommodations

• Verify you received all of the materials on your packing list. When you open the shrink-wrapped packages,

verify you received the listed security numbers within the package.

• Secure materials must be kept in a locked area in the school at all times when not in use.

44

Test Security, cont.

• Track each paper secure item.• TEST BOOKLET SECURITY SIGN-OUT FORM (one

for Reading and one for Math) • tracks test books from coordinator to monitor.

• CLASSROOM SECURITY CHECKLISTS (one for reading and one for math)• tracks test books from monitor to student.

• The monitor must sign at the bottom of these lists.

• Excel file with pre-coded students available. Email Robin Lane @ robin.lane@spps.org to request this file.

45

Test Security & TrainingMonitors

• You must• hold a training meeting for your monitors,• have them sign-in to prove they attended the

meeting,• allow time for monitors to read the non-disclosure

agreement,• have them sign one Non-Disclosure Agreement

per school year, and• collect the Non-Disclosure Agreements and file.

46

Test Security & Training Monitors, cont.

• Topics to cover during your training meeting• Monitors must be impartial observers (cold

hearted?) during the test administration• Have monitors call me with any questions they

may have about test items• reproducing or paraphrasing an item in an email or

in writing is a MAJOR breach in security• discussing items with other teachers is a MAJOR

breach in security

47

Test Security & Training Monitors, cont.

Pencils, calculators, dictionaries, etc.

• Pencils - #2 only, mechanical pencils or pens may NOT be used - schools provide or students may use their own.

• Calculators - schools provide or students may use their own. Students may not share calculators. QWERTY calculators, cell phones, PDAs or translation devices may not be used. (See page 185 in the 2013-2014 Procedures Manual for specifics.)

• Note: Grade level monitor directions indicate on which segments of the math test calculators are allowed.

• Dictionaries, thesauruses and other reference materials – are not allowed.

48

Test Security & Training Monitors, cont.

Materials Not Allowed During Testing

All instructional posters and graphics in the classroom or on a student’s desk that are related to the subject being tested must be covered or removed during the administration of a test assessing the subject.

If the materials are related in any way to the subjects being tested, they must be covered or removed.

49

Test Security & Training Monitors, cont.

Reporting Administration Issues

TEST ADMINISTRATION REPORT (TAR)

• all invalidations of a student’s test must be documented on the TAR

• the name of the person transcribing an answer book and why, i.e. (student’s name) responded orally because of broken arm, (monitor’s name) transcribed

• student moved to the next segment ahead of the class• student used a calculator in a non-calculator segment• online testing issues• send copy of TAR to Robin Lane REA, at 360 Colborne.

50

Test Administration Report (TAR)

51

Test Security & Training Monitors, cont.

Decide on Procedures for Special Circumstances• Lavatory use or illness during testing – collect test

materials from student before s/he leaves the room.

• What to do when students finish the test Remain seated, read a book or leave the

classroom?

• Students who need extra time to complete the segment or test Send student to a different location? Keeping track

of secure materials.

52

Send tracking paperwork & Non-disclosure Agreements to the Testing Office

• Send paperwork to the REA, at 360 Colborne St.• Copy of Monitor Training Sign-in Sheet.• Non-Disclosure Agreements-one for every person that

had access to tests.• One non-disclosure agreement per person per year.

• School Security Checklists, signed.• From the SAC to the Monitor.

• Classroom Security Checklists, signed.• From the Monitor to the Student

• Copy of Test Administration Reports(TAR), if needed.

53

Returning Materials for Processing

• Contact UPS at least 48 hours before you want your materials to be picked up.

• 1-866-857-1501

• Verify the pick-up address or it defaults to the REA, 360 Colborne address.

54

Returning Materials for Processing, cont.

• All paper answer documents must leave your building before May 7.

• All secure non-scorable materials from paper administrations must leave your building before May 14.

• All secure accommodations must leave your building before May 23.

55

Web Addresses

• Minnesota Assessments Portal http://www.mnstateassessments.org/SAC ‘Gateway’ Site to all assessment tasks using AIR

• REA Test Coordinator Sitehttp://www.rea.spps.org/Test_Coordination2.html

56

Contact Information

Robin Lane

District-wide Testing Coordinator (DAC)

Research, Evaluation and Assessment

360 Colborne Street

robin.lane@spps.org

651-767-8257 – Office 651-335-3594 – Cell

SPPS Test Coordinator Web Site

http://rea.spps.org/Test_Coordinator2.html

57