telpas 2014 cindy blair, dtc nicole taguinod danny pacheco january 14-16, 2014

TELPAS 2014Cindy Blair, DTCNicole TaguinodDanny PachecoJanuary 14-16, 2014

Agenda•Security and Confidential•Jigsaw•Break•TELPAS

This training does not replace your responsibility to read and follow all manuals and supplements.READ THE MANUALS!!!

General Information•Grades K-12 LEP students including

parent denials•Components

▫K-1 reading, writing, listening and speaking▫2-12 writing, listening, speaking and on-

line reading test•Test Dates

▫Writing: February 17th to March 7th ▫Reading: March 17h to April 4th (should

not have “absent” students)▫Late arrivals – March 17th or later, reading

test only

Dates

4

E11 DeadlineLEP & Special Education Students •The ARD and LPAC committee meet TOGETHER to determine domain by domain for rating and testing students. •Documented on “ESL/Bilingual & Special Education Test Assignment and Accommodations” Form•Deadline is February 21, 2014

NO BLANKET EXEMPTIONS.

Test Security and Confidentiality

•Protect the contents of all online assessment and student performance (ratings and writing samples) documentation

•Trained and oath prior to handling testing material. Oaths for each role

•Administered in strict accordance with instructions

•No viewing, discussing, providing answers to secure testing materials (paper or on-line)

Campus Test Coordinator Responsibilities

TELPAS

• Read all manuals• Attend required test

coordinator training sessions

• Identify and train a sufficient number of TELPAS raters and test administrators▫ District Bilingual

Coordinator will oversee the remediation training for raters that fail to meet standards after the second set, however TEA establishes this as a campus coordinator responsibility to ensure that raters are trained and qualified

• Identify and train a writing collection verifier

• Train appropriate personnel to enter/verify student information in the online system or do it yourself

• Ensure computer systems have been checked before testing▫ Contact District

technology if you have computer issues

Campus Coordinator Responsibilities

• Ensure that all eligible students are identified and tested

• Oversee the implementation of validity and reliability

• You and your principal are responsible for test security on your campus

• Supervise and actively monitor testing

• Be the campus contact for all questions about testing

• Report testing irregularities and security violations immediately to the district test coordinator

• Campus documentation transfer to DTC

Campus Coordinator Responsibilities

Responsibilities of Testing Coordinators for Holistic Rating

Training• Ensuring raters understand the importance of being properly trained on the holistic rating process

• Ensuring new and returning raters understand which training to take and for which grade clusters

• Monitoring that all raters complete their training requirements and receive supplemental training support if needed

• Ensuring that any individual who serves as a rater but is not successful on the calibration portion of training is provided rater support during the TELPAS administration

12

• Attend training session on administration procedures

• Complete holistic rating training requirements

• Assemble and verify student writing collections

• Rate writing collection• Complete required

documentation• Maintain security and

confidentiality of student’s writing collections and ratings

• Report test irregularities• Sign all oaths

TELPAS Rater Responsibility

• Not a TELPAS rater or the CTC• Attend campus testing training• Complete online requirements• Verify writing collection in accordance with manual and

complete documentation

TELPAS Verifier Responsibilities

Rater Credentials•Have student(s) in class in spring assessment

window (elementary have PE or fine arts teacher trained as a backup for primary rater)

•Be knowledgeable about student’s English ability

•Be trained in rating process•Passed with a 70% or better•Two attempts•Prior to third attempt receive supplemental

training

Training

•On-line at Texas Training Center https://texas.pearson.desire2learn.com/▫Site code: telpas2014

•Test administration training for:▫Raters▫Verifiers▫On-line administrators▫Technology

Training

Note: If a rater has not calibrated in the last three years they are “new” and must to the New Raters training and calibration

Assembling and Verifying Writing Collections

•2 – 12▫Five writing samples to include at least one

narrative about a past event and at least two academic writing samples from math, science, or social studies.

▫All samples must have student’s full name and date accomplished on them

▫Only writing samples on or after February 17th may be used

•May be a “clean” copy from work by the student to include a journal

•No corrections by teacher or peers•May be typed but spelling and grammar

checker must be off•The writing collection cover sheet and

verification from Appendix A must be completed and attached on top of the samples for each student

Assembling and Verifying Writing Collections

What Not to Be Include in Collections

•Copied from a textbook, lesson, or other written sources. In students own words

•Papers done with heavily use of a dictionaries or thesaurus

•Papers with teacher’s , peers, or parents corrections

•Written primarily in another language than English

•Worksheets or Q and A writing assignments

•Brief, incomplete, or rushed papers

Verifying the Collection

•Principal and CTC designate one or more campus verifiers▫They complete training on the Texas

Training Center and are trained and sign an oath on test administration

▫Raters are responsible for assembling the writing collection and providing to verifiers. Writing collections are to be kept secure like an answer document

On-line Reading Test•Requires the TA to be trained and sign

another oath if they were a rater or verifier.•Students that take by paper will still have

to have their answers transcribe into the TAMS. There is a special form and group that you will have that you will have to use in the on-line testing. This same process as for STAAR L

•You may sign up for one session on either February 20th 21st, or 24th. If session is full you must choose another time slot

• Years in US Schools is often confusing because pre-K and Kinder are not included in the count. It starts with grade 1

• New 60 day rule to be released• Years in U.S. schools are important because they

are used to determine accountability performance requirements for AYP and the Progress Measurement

• For more information refer to the LPAC Manual

Years in U.S. Schools

•TELPAS reading is conducted as an online only assessment

•Administered to all LEP students in grades 2-12

•Since it is online, there are no test booklets or answer documents to handle or process

•There is a separate training for TAMS on February 20-24, 2014. This training will cover in detail the TELPAS online system

TELPAS Reading

• Refer to on-line accommodations• It is possible that a required accommodation is

not available with online testing. In those cases, we will have to request approval from TEA to give a paper version of the test and order the materials. This is not a last minute process. Plan Ahead!!

TELPAS Reading Accommodations

• All students must be assessed within the assessment window

• If a student is absent the day you have them scheduled to take TELPAS reading then move them to another session that will test later within the TELPAS assessment window

• The TEA expectation is that we test every eligible student within the TELPAS assessment window

TELPAS Reading Make-Ups

• TEA requires districts to implement one or more rating support and verification procedures for every campus with TELPAS-rated students

• SAISD has developed a TELPAS validity and reliability plan that meets TEA requirements

• Campus test coordinators will be expected to submit required documents to the district test coordinator by the requested deadlines in order to comply with our district validity and reliability plan

• An internal audit will be conducted by the Bilingual Department

Validity and Reliability of TELPAS

• For all language domains – grades K-12: Raters will collaborate with other teachers of the students in determining the student’s rating. One collaborator will initial the TELPAS Rating roster for each child

• For writing – grades 2-12: ▫5% of all writing collections will be randomly

pulled for assembly verification by the campus test coordinator

SAISD TELPAS Validity and Reliability Procedures

•TEA has optional tutorials for students

•Students are required to have seen and accomplished a tutorial prior to testing (not the day of testing)

Tutorials to Prepare Students for online TELPAS Reading

Testing

Available Reports for Online Training and Calibration

• TELPAS Returning Rater Planning Roster• TELPAS Confidential Course Completion Roster

▫ Lists online basic training course completion and in-progress status and performance by user for the current year

• TELPAS At-a-Glance Training & Calibration Report▫ Provides a comprehensive list showing basic training course

and calibration completions for all registered users for the current year

• TELPAS Confidential Calibration Summary Report▫ Provides calibration summary information by grade cluster

(K–1, 2, 3–5, 6–8, 9–12) and for grade clusters combined

30

Who Can Access Reports from the Texas Training Center

•Campus testing coordinators receive administrative access upon approval by district test coordinators or district coordinator assistants

31

Important Notes about Reports

• Personnel with administrative authorization are able to access reports on demand to monitor TELPAS online training and calibration.

• The reports are updated nightly. • In order for users to appear in the correct reports,

their location (region, district, campus) must be up to date in the My Info section of the Training Center.

• Users who have registered in the Training Center and have started but not completed a calibration set are not included in the summary reports. Only completed sets are presented in the reports.

• However, users who have started a training course will appear in the course roster as being “in progress.”

32

Materials

•You need to let us know if you need extra manuals by Friday, January 17th

•If you need a paper test in lieu of the on-line reading, you must submit the waiver request information the DTC by Feb 17th

Documentation•Oaths

▫Four different (rater, verifier, on-line TA, and technology)

•Rater Roster▫Do not use one in back of manual, use the

one from the Testing Web site▫All information must be completed and all

signatures accomplished•Required Documentation Checklist

▫All necessary forms

Tutorials•All students are required to take the

tutorial prior to the day of the test. May take as many times as campus wants. Same with all on-line tests

•Tutorials are about how to use the computer not necessary the type of test questions

•Keep a student roster for documentation of the tutorials

• Information on page T-32 of the 2014 District and Campus Coordinator Manual

• Required to be submitted for ELLs in grades 1–12 with special circumstances that cause extenuating needs

• Identifying ELLs with extenuating needs will allow—▫districts to better monitor and adjust

instructional interventions and evaluate effectiveness of instructional programs

▫the state to inform and evaluate ELL assessment and accountability policies

TEA Spring ELL Assessment Update

36

TELPAS Additional Data Collection

•Unschooled Asylees/Refugees▫Lack literacy skills in first language and basic

subject-matter knowledge and skills▫May also lack basic social skills and may have

experienced trauma as a result of previous circumstances

▫This information is necessary to exclude eligible students’ STAAR results from state accountability ratings and will NOT be gathered during STAAR data collection


37

Special Circumstance

• Students With Interrupted Formal Schooling (SIFE)▫Attend school in the U.S., withdraw and

leave the U.S. for a period of time, and return to the U.S. Gaps in schooling (in the U.S)

significantly affect growth in English and learning of subject matter


38


• Disabling Condition▫This disabling condition significantly

affects growth in second language acquisition and academic achievement Should be determined by the ARD in

conjunction with the LPAC


39


Ratings

•If a student is not rated in one or more domains, select one of the following:

E = Extenuating Circumstances

X = ARD Decision

DOMAINS LEVEL

Listening Beginning

Speaking Intermediate

Reading Advanced

Writing Advanced High

Entering Ratings

•TELPAS coordinators responsible for creating and managing Rating Entry Groups.

•Students may be placed in rating entry groups by grade, teacher, or program.

•Who can enter ratings: TELPAS Coordinator Rater Rating Entry Assistant

Entering Ratings•K-1 need to be grouped in a Rating

Entry Groups so that student ratings can be entered online. Ratings entered for K-1 include listening, speaking, reading, and writing.

•2-12 can be sorted one way for entering ratings and for reading another way. Ratings for students will be entered for listening, speaking and writing.

Prepare for TELPAS Reading GR 2-12

•Links to the web-based tutorials available for each grade cluster on Testing Department website.

•No downloading or installation is necessary to access and use the tutorials.

•With NO sample items in the actual test, make sure to schedule lab time for students to practice with the tutorial.

DATES•On-line reading begins on March 17th

•Schedule of schools ▫High schools being on March 17th - 21st

▫Middle schools and academies on March 17th – 21st

▫Elementary schools on March 24th – March 28th

▫If you need to deviate from the schedule you must let us know so that technology will know who is testing. An email will be sent out requesting your planned testing dates

TELPAS Reading

•Students in grades 2-12 are assessed through an online multiple-choice test.

Grade Clusters

2

3

4-5

6-7

8-9

10-12

Testing Accommodations

•Refer to the TELPAS Reading manual (page 9)

•Not Permitted:▫Reading assistance▫Reference materials▫Test questions or selections

translated▫Test questions, answer choices, or

selections clarified

Reading Test Administrator • Reading Test Administrator is the person

who, during the test session, guides students through opening their tests, and begins the test itself.

• The test administrator is responsible for maintaining test security and for managing breaks/interruptions.

• Reading Test Administrator:▫ Rater▫ Certified Teacher

Computer Check

• Must turn on computers BEFORE testing

• Must complete TestNav System Check▫Link available on Testing

Department Website▫Select 2014 Spring TELPAS

Grades K-12

Computer Check

•If computers FAIL the system check and/or FAIL to launch TestNav:▫Contact the SAISD Helpdesk @ 244-2929

with the following info ready: Campus Name Room Number SAISD Tag Number

Student Authorization Letters

• Each student must have a Student Authorization Letter in order to log in to a test.

• The authorization letter contains the web address that students enter to access TestNav with the unique username and test coded needed.

• A password is not required to log into a test, so the password field will be blank.

• You can print these letters any time before students in the session are to log in to the test. The letters must be kept in a secure location until the test is administered and turned in to the campus coordinator after the test session.

• Click the GET AUTHORIZATION button on the Session Roster screen to access.TELPAS Reading Manual p: 19

Materials Needed for Testing

•Copy of manual•Seating Chart•Test Session Roster•Student Authorization Letters (secure

documents)•Scratch paper for each student•Pencils for each student

TELPAS Reading Manual p: 19

Testing Environment• At least one trained administrator for

every 30 students.• Computer monitors prepared to

discourage students from viewing each other’s monitor.

• Bulletin boards and instructional displays that might aid students during testing must be removed or covered.

• The testing room should be quiet, well lighted, comfortable, with enough space to work.

• “Testing-Do Not Disturb” sign posted outside the testing room.

Testing Procedures• Seating chart is completed to include students’ names,

locations, and test administrator information.• The test is untimed.• Work stations are cleared of books and other materials.• Student MUST remain seated and no conversing while

testing.• Each student must be allowed to work at his or her

individual speed.• NO reference materials are allowed.• Allowed to use scratch paper, but all scratch paper must

be turned in to the campus coordinator after testing.• Active monitoring during the test session.• After students have finished, they may read or leave the

room.• BEFORE a student who has finished testing leaves the

room, test administrator must ensure the student’s test is in “Submitted” status.

• IMMEDIATELY after testing, turn in all test materials and sign the bottom portion of the reading test administrator oath.


Other Testing Issues

•Answering student questions •Computer monitor glare•Student breaks•Lunch•Cell phones•Emergencies•Changing rooms

TELPAS Manual p: 22-23

Starting a Test

A test session MUST be started before any students can log in to TestNav and begin the test.

A test session does not start until the TEST ADMINISTRATOR clicks the Start button on the Session Details screen, regardless of the scheduled start time and date.


Launching the Test

• Before students in GR 2-5 can begin the test, TestNav must be launched on each student’s computer, and the login ID and test code found on each Student Authorization Letter MUST be entered by the Test Administrator.

• Do NOT begin a test for an ABSENT student.


•Test administrators guide students through the login process for GR 6-12

Launching the Test


Monitoring Sessions

• Session Details screen

• Periodically click Refresh

• Real-time test status

STATUS:•Ready•Active•Exited•Resumed •Resumed-Upload•Completed•Marked Complete


Resume• If a student exits TestNav---

▫Return to Session Details and select the checkbox next to that student’s name.

▫A resume checkbox is only available if that student’s status is Started, Exited, or Resume.

▫Click the Resume Test button to resume all students you checked.

▫Students launch TestNav and login using same Login ID and code from authorization letter.

TELPAS Manual p: 25

Submitting Answers•Student needs to click Final Submit

before they are done•Exiting TestNav alone does NOT

submit answers•Refresh to ensure students status are

Completed

“Do Not Score”•Session Details screen select

student’s name.•Click Edit button. •Select Reading “Do Not Score”

Score Code. •A designation must be selected. •Absent students are to be MOVED

into a make-up session prior to stopping the session.


Stopping a Session•Ensure each student’s status is

Completed or Marked Complete on the Session Details screen.

•Click the Stop button to stop the test session.

•Call us if you have questions/concerns

Secure TELPAS Information• Content of the online reading test is

secure and confidentiality must be maintained.

• Student Authorization Letters are to be kept secure until needed for testing.

• All student data in the TELPAS system or entered into the system is confidential.

• Passwords and user IDs used in the TELPAS system are secure and should be kept confidential.

TELPAS Reading Training

•Reading Test Administrators must be trained and sign the specific oath.

•Test administrator MUST read the TELPAS Reading Test Administrator Manual.

Reading Training Deadline

Friday, March 7th

Campus Coordinator Documentation

•Collect signed oaths from all raters•Collect TELPAS Student Rating

Rosters and retain for 1 year.•Collect and put Student Writing

Collections in the students’ permanent record files.

•Process not changing•Paper test booklets (including large print,

if applicable) approved by TEA in rare circumstances• Accommodations that are not available in

TestNav• Unavoidable technological problems that make

online testing impossible• Other special situations (e.g., homebound

students, JJAEPs, etc.) 68

Paper Administrations of TELPAS Reading

Spring 2014

Set up test sessionChoose correct form group type (transcribe paper

form, not operational online test form)Transcribe responses

Each question has one screen; test administrators will go screen by screen to transcribe the response to each question

Responses must match exactly the responses indicated by the student in the test booklet

Submit test for scoringFor TELPAS, students must be put into rating

entry groups so proficiency ratings and rater information can be entered 69

Paper Administrations of TELPAS Reading

Process for Transcribing Student Responses

Paper testing won’t be approved on basis that student knows very little English has limited exposure to computers

Don’t forget the TELPAS online student tutorials!

70

Keep in Mind…

Scenarios•Ms. Smith is new to your campus and

teaching this year. Assigned to her are 6 LEP students. Four are current LEP, of which 2 are parent denials. The other 2 of the six are in first year monitoring status.

▫What training and how will you monitor the training Ms. Smith needs?

▫https://texas.pearson.desire2learn.com/▫Which students will Ms. Smith need to rate?

• Ms. Smith reports to you that she failed the first two calibration sets. • How do you confirm this?• What training does she need now?• Who do you contact?• What action do you take if she fails the

third set?

• Ms. Smith has successfully completed the third set. However, she notifies you that one of her students that is a current LEP is also a special needs student and that the ARD has exempted them from all TELPAS domains.

• Is this allowable?• How will this be indicated to

Pearson/TEA?• What parties need to be included in the

ARD?

• Ms. Smith just notified you that one of her LEP students has been restricted from using computers. • How does this impact the TELPAS

reading test?• What actions do you need to take?• Who will input the student’s answers

into the on-line system?

• Ms. Smith has completed her writing collections. She gives you a folder that contains the following samples for a student:

• A writing sample on steps to solve a math problem

• A narrative about something that happened during the holiday break

• A worksheet from science• A copy for the student’s social studies

journal about a historical figure contributions

• A writing about a familiar process• Are these acceptable samples?• What information must be on every

sample?

• Ms. Smith has a out of state student enroll in her class on March 20th that the parent check as LEP.

• What does Ms. Smith do in regards to TELPAS testing for this student?

• Would the answer be different if the student enrolled from another Texas school?

• Ms. Smith’s late arrival student has had his LPAC on April 4th. Does this student take the on-line reading test?

• Ms. Smith has completed her paperwork. What form does she use to record the domain results on?

• What other information must be completed on the form?

• Whose signatures must be on the form?

• What are the requirements for validity and reliability?

• Ms. Smith will be an on-line test administrator one day during the window.

• What training does Ms. Smith need to do this?

• Can the oath she signed for being a rater cover her for being the on-line test administrator?

• What access does she need in TAMS?

TELPAS Lab Time• February 20, 21 and 24th• You will need:

▫Laptop▫LEP Student Roster▫TELPAS Manual▫Know how you want to group

students for rating entry and reading test

▫Know dates you are going to administer the reading test

▫Reading Test administrator name(s)

Questions

telpas 2014 cindy blair, dtc nicole taguinod danny pacheco january 14-16, 2014

Documents