data coordinators meeting coordinators meeting packet- march... · l2rpt sirs report changes ......
TRANSCRIPT
Data Coordinators Meeting Remote Zoom Meeting
March 11, 2019 9:00 – 10:00
_________________________________________
Agenda:
State Reporting (p. 1-4)
Assessments (p. 5-19)
Regents, LOTE
3-year trend report
3-8- Paper-based and CBT
State Reporting
M.A.A.R.S. Contacts:
Laurie Hazard 349-9051 [email protected]
Daron Lowell 349-9064 [email protected]
1
2
L2RPT SIRS Report Changes
SIRS-335 Career Pathways Verification Summary Report (In Annual Outcomes folder) o This report will no longer be updated as the same information is available in the SIRS-203 o It will remain available and will contain historical data: 2017-2018 and earlier
SIRS-203 Total Cohort Career Pathways Summary Report (In Total Cohort Report folder) o This report replaces the SIRS-335 o Shows Career Pathways data by cohort membership
SIRS-650 English Language Learner Profile (In Annual Outcomes folder) o Provides a summary current ELLs o Detail report provides NYSITELL and NYSESLAT information as well as duration of LEP
Suspension Data & ESSA Accountability Status
Beginning with 2018-19 school year results, a Level 1-4 will be reported for the performance of accountability groups on the Out-of-School Suspension indicator
o Elementary/Middle Level is for students in grades 1-8 o High School Level is grades 9-12
o Out-of-School Suspensions: Out-of-school suspension rate is calculated by dividing the number of students who were suspended from school (not including in-school suspensions) for one full day or longer anytime during the school by the number of students enrolled on BEDS day of that school year. A student is counted only once, regardless of whether the student was suspended one or more times during the school year.
Be sure to report Out-of-School Suspension (OOS) data accurately on the Student Daily Attendance template
o Students who are suspended for a full day should be reported as suspended for that day o Students who are suspended for a half day should NOT be reported as suspended for
that day
Data is due Thursday, August 22, 2019
Student Data Reporting (Districts & Charters)
March 22nd - BEDS Day data extracts (SIRS 312, 313, 314, 316, 319, 323, 350)
o 2nd BEDS Day data extract
o BEDS Day Enrollment - enrollment by grade, district of residence, district Pre-K, and supplemental enrollment counts are collected for calculating preliminary State Aid allocations
Program Service codes 902 Universal PreK, 990 Other PreK, and Universal PreK Setting code (see SIRS Manual)
o BEDS Day Immigrant Student Counts – Counts of immigrant students will be pulled again for Title III immigrant allocations
Program Service code 8282 Immigrant Children and Youth Status
o BEDS Day FRPL – FRPL counts used for data submission to USED and preliminary State Aid allocations
Program Service codes 5817 Free Lunch, 5806 Reduced Lunch, and 0198 Poverty
3
o Data due Thursday, March 21, 2019
March/April – BEDS Day ELL Counts data extract
o Counts of ELL Eligible students will be pulled for Title III Biennial Evaluation Report.
o Program Service code 0231 – ELL Eligible
Cohort Reports – It’s never too early to start looking at your Cohort Reports! (SIRS 201, 202)
Staff Data Reporting
2018-2019 TSDL and Staff Assignment Data (Districts and BOCES Only)
Teacher Student Data Linkage (TSDL): Course Rosters in TAA – Identifies the Teacher of Record and course rosters for the purpose of calculating Teacher State-provided growth scores as related to APPR
o Staff Snapshot & Staff-Student-Course templates
o Staff Snapshot data refreshed daily in L2RPT
o Staff-Student-Course data refreshes weekly on Mondays
o Grades 3-8 ELA/Math and Math Regents teachers can start verifying course rosters in TAA
o SIRS-315 Teacher Student Data Linkage Verification Report
o TSDL data due Thursday, June 13, 2019
o Certification Friday, June 21, 2019
Staff Assignment – Principals only (Districts and BOCES Only) – links principals to schools & grade levels for the purpose of calculating Principal State-provided growth score
o Staff Snapshot & Staff Assignment templates
o SIRS-318 Staff Assignment Verification Report
o Staff Assignment data due Thursday, June 13, 2019
o Certification Friday, June 21, 2019
SIRS Memos & Timelines
2017-18 Reporting Memo & SIRS Timelines
o 2018-19 Reporting Memo: http://www.p12.nysed.gov/irs/documents/2018-19SIRSReportingMemo.pdf
o 2018-19 SIRS Timeline: http://www.p12.nysed.gov/irs/documents/SIRSReportingTimeline2018-19v2.pdf
4
6
Data Warehouse
• Important! Please do NOT load regent’s scores from your SMS to Level 0, with the exception for braille or restricted exams. MAARS exports the files from ASAP, our scoring database, and loads to the DW on behalf of all schools. Extensive, investigative work is required by NYSED when the fact records do not match the response files. Please do not hesitate to contact Brenda Fagan at 349-9022 if you have any questions or concerns.
June 2019 Regents
• Online ordering of June 2019 exam materials from OSA due by NOON April 12, 2019: o Procedures for Requesting and Storing the June 2019 Regents Examinations are
available on the OSA Department's website at http://www.p12.nysed.gov/assessment/hsgen/.
• Pre-Printing and Processing Order Form for MAARS: o Will be sent to all schools by the end of March and will be due April 18.
• Pre-Printing answer sheets using staff/student/course data from Level 0: o Deadline to have the most current student data in Level 0 is May 10. o ASAP rules for pre-printing teacher names on the answer sheets, using Level 0 data,
depend on Teach IDs. If a course section has multiple teachers, the name of the teacher with the lower Teach ID will print.
• Pre-Printing answer sheets from files: o All schools may provide MAARS with files of required student information and
upload them to the FTP site by May 10. o ASAP retains the teacher name and course section when pre-printing using a student
file. All reports and files will show the same teacher and course that was printed on the answer sheet, regardless of what’s in Level 0.
• Global History & Geography courses: o Grade 9 Global History & Geography (New Framework) mapped to 04051. o Grade 10 Global History & Geography (New Framework) mapped to 04052NF.
▪ New Regents exam on June 3. ▪ Schools will receive the teacher scoring materials on the day of the exam.
Schools can choose to either teacher score this exam right away or wait until regents exam week. Final scores can’t be processed until the conversion chart is released by NYSED, which will be no later than June 26.
o Global History courses aligned to the Transition Global History & Geography curriculum mapped to 04052.
o AP World mapped to 04057. **If these students are taking the regents, a file will need to be submitted with the regents state course code for preprinting answer sheets.
• More information, to help with preparations for June Regents exams, will be sent out from MAARS by the end of March.
7
LOTE Update
• Information to order the BOCES 1 and BOCES 2 regionally developed Checkpoint A and
Checkpoint B exams will be sent to Administrators in the next few weeks.
• For those schools participating, MAARS will send a letter with an order form to order
preprinted answer sheets and to choose an option for processing these exams.
o Student files for preprinting will need to be posted to the FTP site by May 10.
8
Data-Driven Instruction
M.A.A.R.S. Contact:
Lorena Stabins
(585)349-9068
9
10
3 Year Standard Trend Report for 3-8 ELA & Math and Regents
Found in Level 1 (a.k.a.) WNYRIC Data Warehouse Path to Report: Team Content>Instructional Reports>Item Analysis Reports>
“Elementary & Middle ELA & Math Item Response & Analysis Reports” folder “Regents Item Difficulty & Response Reports” folder
Why do DDCs need to know?
This is a fairly new report.
You will not likely be asked to run it because only a few administrators, teacher leaders, instructional coaches know about this report.
I encourage you to share this report with the instructional leaders in your district.
Why is this report helpful at this time of year?
Teachers and students have a few more weeks to do any final review for the NYS ELA & Math Assessments.
It makes sense to spend time reviewing standards that are most heavily assessed.
This report show how many questions aligned to each standard have been assessed over the last 3 years.
How can I help those in my district know how to use it?
Videos on MAARS website: http://www.monroe2boces.org/maars_home.aspx Located on the Data-Driven Instruction Tab - “Related Links” (see screenshot below)
Finding the 3 Year Standards Trend Report https://ensemble.monroe2boces.org/Watch/finding3yearstandardtrendreport
Using the 3 Year Standard Trend Report https://ensemble.monroe2boces.org/Watch/using3yearstandardtrendreport
11
12
14
3‐8 Paper‐based Assessments
Answer Sheet Shipped to districts – Available for Charter/Non‐public school pick‐up ELA March 18th
Math April 9th
NYSESLAT April 22nd
Science 4 & 8 May 1st
Returning Answer Sheets for Processing
• Answer Sheet Prep. & Packing:
o Make sure to follow our answer sheet packing directions (directions sent with your printed answer sheets)
o Please do not put large envelopes into boxes of answer sheets. o Schools whose answer sheets are not packed by the directions: We will contact the
school and have them send someone here to MAARS to put them in the order they are needed for processing.
o Use of Preprinted Blank Answer Sheets: Please make sure to instruct teachers/proctors to write in the student ID number in the appropriate ID number box on both sides of all answer sheet pages.
• Answer Sheet Delivery Deadline for Processing: Due To MAARS
ELA April 17th (April 12th)
Math May 16th
NYSESLAT May 31st
Science 4 & 8 June 14th
o Please Note: This year NYSED ELA deadline for delivering answer sheets to us for processing is April 17th.
o This deadline happens to be during Spring Recess in which schools are closed. o If you will not be working that day or week, your school MUST deliver these answer
sheets by end of day Friday, April 12th.
15
3‐8 Computer Based Assessments
CBT Proctor Training & Best Practices Webinar (March 15th)
• Registration Open: 2019 New York State Computer‐Based Testing (CBT) Proctor Training & Best Practices Webinar
Nextera Admin: Students Changes between Districts/Schools (hand entering into Nextera Admin)
• If you attempt to hand enter a student into Nextera Admin and receive a message stating “student already loaded…” contact us and we can help you to resolve this and get the student entered.
Nextera Admin: Student Identification
• Please remember that both a NYSSIS ID and a Local ID are required for all students. • If you need help getting a NYSSIS ID on a student, you can contact us and we will help you
get the needed NYSSIS ID.
Nextera Admin: Accommodations
• Multi‐Student Edit: This feature allows you to add accommodations to a group of students at the same time.
o Note: Multi‐Student Edit will override any previously assigned accommodations for the students being edited. If you use this feature, it is recommended to begin with the Multi‐Student Edit, then make necessary individual changes to assign accommodations to individual students.
• It is strongly recommended that you have someone review the accommodations before testing day using the Nextera Admin reports.
• Remember that the changing of some accommodations could take up to 24 hours before the test system is ready for the student. (For example: changing of a language or to text‐to‐speech.)
Nextera Admin – TEST tab
• Will be available 2 weeks before the exam testing window, for printing login tickets Documentation: How to Print Student Login Tickets
Proctor Pins
• Are a part of the secure materials and should be distributed to each testing classroom with the secure materials packet. (NYSED’s #1 call on questions concerning this topic)
• These are Building‐specific. • Proctors within the same school building will use the same Proctor Pin. • Do not share proctor pins with students.
16
3‐8 Computer Based Assessments (cont.)
Proctor Pins vs Access Codes
• There has been feedback from schools that the Proctor Pin and Access Code screens/prompts are very similar.
• NYSED/Questar will look into ways to add a better distinction between these 2 screens for next year.
• For this year, please make note of the title on each of these screens • What may also help is to keep in mind that the Proctor Pin is always required before the
Access Code. • Also good tip to remember, Proctor Pins are 8 digits and Access Codes are 4 digits.
Quick Note on Highlighters use during testing
• Students cannot have the highlighter tool enabled and also type in the CR (constructed response) box.
• If a student is having issues with typing in a CR box, have them check to make sure the highlighter is disabled.
• NYSED will eventually post a “Proctor Tip” to CBTsupport on this.
17
3‐8 Computer Based Assessments (cont.)
Best Practices
• A MUST READ: Best Practices: Computer‐Based Testing "Tech Tips"
• Best Practice: Staggering Student‐Testing Start Times • Video & Presentation: CBT Best Practices and Tech Tips, 2018 (created 2018 updated 2019) • Keep a log of your students and their testing device identification
o Some schools have their students write the testing device identification on the back of their log‐in tickets.
• If there is a problem with a student’s device after student starts the test and may need to change devices. (See revised notes below)
o Before having the student move to a new device, contact Questar. If your school’s technical person & Questar cannot resolve the issue on that device… The student should be able to complete the remainder of the test on another
device. However, the student would need to pause/log out of the first device they were working on or they will not be able to log into the second device.
Student should be able to complete the remainder of the test on the second device, where he/she had left off.
Work with Questar as to how the student’s assessment should be submitted from both devices.
Quarantine the student’s original device until Questar and your tech. person can resolve the issue – do not use that device for anything else until the issue has been resolved and the student’s assessment data successfully retrieved and sent to Questar.
How to handle loss of Internet Connection during testing
• Student may continue to respond and work on their test. Their responses are stored in the local cache on the device they are using.
• If the connection is restored before the student completes the test, the system will restart the “heartbeat” (transmission of responses to the Questar’s system).
• If connection is not restored, student responses remain on that device.
o Student can log out of the test but do NOT submit. o Once connection is restored the student should log back in on the original device
and submit their test.
(Note: device should be quarantined until that student’s test responses have been successfully submitted. Do not allow other students to use that device)
• Do not attempt to submit a test when internet connection is down. • If the student has completed their test and there is still no internet connection, have them
log out of the test.
o Quarantine the device o You may also want to label that device with the student’s name.
• Nextera Setup & Installation Guide
18
3‐8 Computer Based Assessments (cont.)
How to handle loss of Internet Connection at test Submit
• If a large number of student devices were offline at the end of a test session it is recommended to label the devices with the student name and keep them connected to power.
• This will make it easier to track which students need to sign back into which device and submit their test when the connection is back online.
• Nextera Setup & Installation Guide
Reason Not Tested (Not Tested Codes)
• Can be entered into Nextera Admin before testing, if you know the student will not be taking the CBT test.
• (Tip) Proctors can use the back of the student login ticket to indicate “Reason Not Tested”. To use as a reference for entering into the Nextera Admin system.
• On the last day of the testing window…
o Export the Testing Status Details to be sure every student has either tested all sessions or a Not‐Tested code has been assigned
o This list can also be used to help identify students for makeup tests o Please note that if a student is loaded into Nextera Admin but is taking the test via
paper answer sheet, you need to enter a not‐tested code in both of the student’s test session as “Testing on Paper”. The same must be done for students that are “Taking Regents”.
• Documentation: How to Set Not Testing Codes
Communications (before, during and after testing)
• Strongly recommend that each district/school have at least one person with a login to CBTsupport webpage AND setup as “following” each category in “Grades 3‐8 ELA and Math Computer‐Based Testing”
• We will continue to send updates via our Weekly Digest • I will be sending out emails, when needed, via an email listServ we have created just for our
Operational CBT schools. • You know where to find us …. Questions… concerns… need help… • Happy Testing!
19