office of superintendent of public instruction · 8/31/2016 · topics for the ospi assessment...

Assessment Update

SY 16-17 UPDATE #1

AUGUST 31, 2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

1

Topics for the OSPI Assessment Update WebinarAugust 31, 2016

Operations: TIDE Appeals, Manuals, Key Dates

Data Update

Technology Update

WA-AIM – Retakes, Recruitment Opportunities

ELPA21 – Score Reports, Screener

WELPA – Placement Test Materials

COE

Graduation Alternatives – Update

Digital Library – Enhancements and Upcoming Changes

THSS – Interim Updates

AIR Ways Reporting

Assessment Content Development

Mandatory Survey Reminder

2

Alphabet SoupAssessment and Registration Tool (ART)

◦ Digital Library (DL)

Test Information Distribution Engine (TIDE)◦ Managing and editing users/students

◦ Registering students for tests

◦ Selecting supports and accommodations

◦ Processing and viewing test invalidations

Test Delivery System (TDS)◦ Test Administrator Interface

◦ Student Interface


3

Alphabet Soup• Teacher Hand Scoring System (THSS)

• Online Reporting System (ORS)

• AIR Ways formerly AIR360 and IRV

• Assessment Viewing Application (AVA)

• Washington Assessment Management System (WAMS)

• Education Data System (EDS)


4

Operations


5

Printed Individual Score Reports (ISRs) for FamiliesHard copy reports for Smarter Balanced, MSP, HSPE, Off-Grade Science, and EOCs arrived in districts by Aug 16, 2016.

Translated text of the ISRs will be available in Chinese, Khmer, Korean, Punjabi, Russian, Spanish, Tagalog, Vietnamese and post to the OSPI web site at http://www.k12.wa.us/assessment/StateTesting/ScoreReport.aspx


6

Resources for Educators and FamiliesThe Graduation Toolkit http://www.k12.wa.us/graduationrequirements/GraduationToolkit.aspx is being updated to include the Class of 2020. Included in the Toolkit are:• State Graduation and Testing Requirements• Washington State Minimum Credit Requirements• Graduation Alternatives• Appeals, Waivers, and Direct Access• Options for Students Not Graduating After Four Years of High School

Your Child’s Progress (YCP) http://www.k12.wa.us/Resources/YourChildsProgress.aspx is a parent-friendly resource for any parent who has children in grades K-12. This publication is specific to school year 2016-2017 and, by grade, provides a brief listing of learning goals, state tests available, testing windows, and achievement level descriptions. Updates to YCP are in progress and will be posted early September.

Test Results Letters http://www.k12.wa.us/resources/LetterTemplates.aspx are templates for districts to use when sending ISRs home to parents. These revised letters posted mid-August.


7

http://www.k12.wa.us/graduationrequirements/GraduationToolkit.aspx

http://www.k12.wa.us/Resources/YourChildsProgress.aspx

http://www.k12.wa.us/resources/LetterTemplates.aspx

Manuals, User Guides, and Modules TAM updates for 2016-17

– Fall TAMs available 9/22

– Spring 2017: consistent terminology and reduction from 8 TAMs to 2 TAMs!!

AIR System User Guides – Available Now (THSS, AVA, and Technology Coordinator User Guides)

– Available the week of 9/12 (TIDE, ORS, and TA User Guides)

Modules and PowerPoints– OGL Translated CD Demo available 9/22

– Available Now (Technology Coordinator Modules)

– Fall Coordinator and TA Training PowerPoints available 9/27


8

Training for School and District Staff Assessment training is required at the beginning of each spring test administration

This should be followed by providing assessment training updates specific to each retake administration

AIR System Modules support users within the AIR systems/applications

Assessment webinar updates are high level informational sessions for district assessment offices

TA Certification is highly recommended as a part of your training plan

‒ TA completion of training available for download in TIDE

Technology and Test Coordinators collaborate on review of training materials and implementation of assessments


9

Training ModulesAIR-developed system training modules (Technology, TIDE, AVA, TDS, THSS, ORS, AIRWays) will not be presented as webinars.


10

Subject Date Posted to Portal

Technology Requirements (technology coordinators) 8/23/2016

AVA 9/6/2016

THSS 9/13/2016

TDS 9/16/2016

ORS 9/16/2016

TIDE 9/6/2016

AIR Ways (formerly IRV) 9/20/2016

2016-17 Assessment Update Webinar ScheduleDATE TIME

Webinar - August 31 3:30 – 4:30

Webinar - September 29 3:30 – 4:30

Webinar - October 19 3:30 – 4:30

Webinar - November 21 3:30 – 4:30

DECEMBER – SKIP

Webinar - January 10 3:30 – 4:30

Webinar - February 14 3:30 – 4:30

Webinar – March 14 3:30 – 4:30

Webinar – April 12 3:30 – 4:30

Webinar – May 16 3:30 – 4:30

Webinar – June 21 3:30 – 4:30


11

Fall Administration ScheduleSmarter Balanced, and Off-Grade Level

Fall administration window opens early: October 24 – November 18

Paper pencil testing window remains the same: October 31 – November 18

All students loaded into the online testing engine

Paper-testers materials are ordered through the Additional Order TIDE application‒ Order can be placed from October 12 – November 18


12

Excel Key Dates CalendarAn Excel calendar of key dates to support district assessment offices in task planning for the 2016-17 school year.

Includes all administrations and assessments

Ability to filter or sort by different labels

Critical timelines column

Detailed information to support task including location of additional support material

Acronym tab


13

Excel Key Dates Calendar


14

TDS Enhancements and AlignmentsThe Test Delivery System is undergoing enhancements for 2017.

TA Interface Increased visibility of Test Approvals More information for TAs

Student Interface New calculator integration is available for practice, training, interim

and summative tests. Color formatting for different tests Enhancements on item display System messages

User Guides, Guidelines, Manuals, and Systems are being aligned

A PowerPoint will be available to support enhancements


15

TIDE AppealsTIDE Appeals system overview Feedback from DCs on the 2016

administration appeals processing, once redirected

11,129 total appeals processed in spring 2016

We may be able to reduce the number of appeals submitted in 2017 by 50%

Ongoing collaboration with AIR and other states for 2017 enhancements


16

*Other: includes appeal comments not including enough information to categorize (e.g., a, scoring, 23233, #2)

WAMS EnhancementsProfile Page

Profile page enhanced


17

WAMS EnhancementsTest Material Delivery Page

Delivery Date for Test Materials moved under the Assessment > Test Materials tab


18

WAMS EnhancementsFile Downloads

Files Downloads page moved to its own tab


19

Data


20

TIDE Rollover: Where are we now?User Account/Role Creation: Working just fine now – all formats and all user roles can be created normally, including upload

◦ All 3 file formats upload successfully (.xls, .xlsx, and .csv)

◦ No “Lateral” account creation currently (e.g. DAs can’t create other DAs).

◦ IF a user needs a DC role assigned OR a DC user has not received the ‘Welcome’ email, contact [email protected] AND [email protected]

Student Records: ◦ Nightly files are processing normally

◦ “5 Minute files” – AIR finalizing configurations to process files evening of 8/30 (yesterday), but OSPI pulled all unprocessed files into a single file to catch up

Rosters:◦ 2015-16 Rosters are preserved and linked to teachers by email address

◦ Once TA roles are created for 2016-17, TAs should be able to see previous years’ rosters in ORS by selecting the appropriate “Who” in ORS (students who were mine when they tested OR students who were mine at the end of the selected administration)

◦ Contact [email protected] AND [email protected] if they still cannot OR if a teacher’s email address changed (name or domain)


21

mailto:[email protected]




WaKIDS: Big Picture of new system in GOLD®initial launch to auto-pilot

1) OSPI Student Information sends kindergarten student file to GOLD® (all the kids we think are 2016-17 kindergarteners) 2) OSPI WaKIDS Administrative Assistant creates user names for all DACs in GOLD®3) Before teachers can really administer WaKIDS:

1. District CEDARS administrator either submits CEDARS data for kindergartners (full 2016-17 submission) or requests SSID numbers for additional kindergartners to submit to GOLD® [In language familiar to CEDARS administrators, the district will run SSID Issuance for Assessment (kindergarten student’s name, grade, and class) for purpose of WaKIDS.]

2. ESD administrative assistants create teachers’ user names and class names in GOLD® just before the teacher attends WaKIDS 101.

3. ESD trains teachers in WaKIDS 101 (including IRR)4. DAC (or school admin) organizes students in classes within GOLD®

4) CEDARS admin goes about business as usual (submitting data, issuing SSIDs to new students).


22

WaKIDS: Loading GOLD - InitialInitial file handoff date: Early-mid August TBD (Target: by 8/10)

Who is OSPI loading in the initial WaKIDS load as “2016-17 Kindergarteners”:

1) All KG students enrolled in 2017 CEDARS. (not likely – 2016-17 CEDARS data will not be available at thattime)

2) All KG students created in issuance since 9/1/15 but only if they aren’t in CEDARS or were PK for the 1516 school year.

If a record does occur in both issuance for KG and full 2017 CEDARS then we will use the record that was created most recently.

3) All PK student enrolled in 15-16 CEDARS.

4) All PK issuance records created since 9/1/15 but only if they aren’t in CEDARS or were PK for the 15-16 school year


23

WaKIDS: Updating GOLD – Nightly FilesNightly Files will Add, Edit, and Move student records

Two ways to update records in GOLD via CEDARS:

1. Updates made in routine CEDARS submission (student moves to new school or student demographics updated)

2. Student issued an SSID for assessment purposes

This can be used to create a GOLD record if a student enrolls in a new school between CEDARS submissions and a record is needed to record observations

Records are compiled nightly - updates reflected the next day

If a record is created through both means on the same day, full enrollment record wins out


24

WaKIDS Nightly Handoff: Where are we now?Nightly Files:

◦ OSPI has been sending nightly files for roughly 2 weeks

◦ Teaching Strategies is finalizing SFTP configuration to extract and load nightly files

◦ As of 5pm 8/30, TS believes the process is set but we are monitoring closely

◦ Files are being manually loaded each morning by Teaching Strategies until automation is complete (expected end of this week)

Student Records

◦ “Pre-K” records sent by OSPI will be cleaned up such that only students of legal Kindergarten age are in GOLD under the OSPI contract

◦ Our net was too broad due to assessment/CEDARS miscommunication and included some Birth-to-4 students

Assigning Students to Classes

◦ Currently, this must be done manually through ‘Manage Students’

◦ Looking into bulk solutions within GOLD for 2017-18; will communicate ASAP if a solution for this fall is workable


25


26

Technology Update

Technology Update – Windows/Mac/LinuxSecure Browser version 9.0 for Windows/Mac/Linux for 2016-17 school year has been available since mid-July, download ASAP if you are planning to do Interim assessments this fall (version 8.0 support ended Aug.29)

All versions of 2016-17 Secure Browser include a new splash screen that informs the user of the current SB version (e.g., Version 9) and prevents user from landing at a blank white page until an Internet connection is detected


27

Technology Update – ChromeOS & iOSNo new Secure Browser for 2016-17 school year is needed for Chromebooks, be sure your Chrome OS is updated to at least v.51 (minimum version that will be supported)

Updated iOS Secure Browser for 2016-17 is not yet available, as iOS 10 has not been released (currently on beta v.7). If you are using iPads for Interim assessments, do NOT update immediately to iOS 10 when it is released (likely in Sept), until you are notified that AIR has released the updated iOS Secure Browser.


28

Technology Update - Training ModuleTechnology Director’s Requirements for Online Testing Training Module for 2016-17 is substantially complete, and the PowerPoint has already been posted on the WCAP portal at http://wa.portal.airast.org/resources/?section=4 under Resources. Audio recording should be posted shortly as well. Note: this takes the place of the Technology Directors webinar we have conducted in the past, and can be viewed on demand at any time.


29

http://wa.portal.airast.org/resources/?section=4

WA-AIM


30

WA-AIM HS Fall Retake AdministrationWindow: September 12-November 18, 2016

Who: 12th graders eligible for alternate assessments

What: Off-level administration for students needing to fulfill CIA

Scores: Mailed to district January 2017

9/1/2016


31

Content Available Grades Required Achievement Level

ELA/Mathematics 3 or 6 Level 3

Science 5 or 8 Level 3

WA-AIM Graduation Cut Scores

WA-AIM High School Graduation Cut Scores

ELA Mathematics Science

104 103 104

9/1/2016


32

Students who met the following scores on the 2015-2016 Grade 11 WA-AIM have fulfilled the CIA requirement for that content area.

Students who participated in the Grade 11 WA-AIM via the Engagement Rubric have had the CIA requirement waived- the Engagement Rubric replaces the prior Awareness Waiver.

WA-AIM User Roles and ActionsRole Action Where When

OSPI Pre-ID students sent to Engrade OSPI Completed on 8/20/2016

DTCs, BTCs, IEP teams and teachers

Identify grade 12 students needing to participate in WA-AIM Fall HS Retakes

Local Prior to September 12

DTCs Create accounts in Engrade for new:• DTCs• SBTCs• Teachers

Engrade September 12

DTCs/BTCs Add new grade 12 students to School Roster


Teachers Administer Performance Tasks Local Sept 12- Nov 18

Teachers Create Class(es) and Add Students to Class(es)


Teachers Document student performance Engrade Prior to Nov 18 @5:0pm

9/1/2016


33

Important WA-AIM Information•Engrade online data collection platform will be used for FALL ONLY• Spring Administration will move to DRC’s Data Collection Platform

• Spring Administration information and training will be updated by mid-September

• Spring Administration will include a new student rostering process for WA-AIM participants as well as Engagement Rubric registration

• MORE INFORMATION TO COME

• Training and docs relevant to WA-AIM Fall HS Retakes posted on WA-AIM website

• Additional Item/Question Library is available!!• Hundreds of teacher created and teacher vetted items/example are available by grade-content-

standard-access point

9/1/2016


34

http://www.k12.wa.us/Assessment/WA-AIM/default.aspx

WA-AIM 2016-2017 Teacher Recruitment Needs

Activity Purpose When Anticipated Duration

WA-AIM Alignment Study To review the current WA-AIM examples, Performance Tasks, and Access Points to ensure their alignment to our state learning standards.

Special and General Educators(math, ELA, Science)

Early November

2 days

Science Development-Performance Expectation Selection

To select the NGSS Performance Expectations to be used for the new WA-AIM Science aligned to NGSS

Special and Science General Educators

Early October 3 days

Science Development- Access Point Frameworks

To develop the Access Points and draft the Performance Task Requirements and Restrictions


Early November

3 days

Science Development-Performance Task work

To write the example items and questions for the Performance Tasks


Late January 4-5 days

Science Development- Content and Sensitivity/Bias Review

To review the Performance Tasks and example items and questions for content, sensitivity and bias


Mid to late Spring

2-3 days

9/1/2016


35

ELPA21/WELPA


36

ELPA21 Score Report DataELPA21 Score File and TBIP Placement Decisions for 2016–17

Preliminary ELPA21 electronic score files are currently available.• Districts have access to the electronic score file through the Washington Assessment Management System (WAMS).

• The score files contain ELPA21 domain levels and overall proficiency status.

Preliminary data was released to inform determinations for students’ continued Transitional Bilingual Instructional Program (TBIP) support and district staffing and scheduling decisions.

These score files are preliminary as the supporting data set has not been through all applicable quality checks to ensure completeness of the student information

OSPI acknowledges that the preliminary data may not, at present, fully represent all students in your district or school(s).

Data may not represent the final status of the state’s information; OSPI continues to work with the ELPA21 consortium and AIR to finalize score files.

9/1/2016


37

ELPA21 Proficiency Status

9/1/2016


38

The data record will contain a performance level (1–5) for each of the four domains assessed on the ELPA (i.e., Reading, Writing, Listening, and Speaking).

• These performance levels will correlate with specific knowledge and skills that the student demonstrated with respect to his or her English language acquisition.

Each student’s proficiency status will be categorized as:1. Emerging (qualifies for program)2. Progressing (qualifies for program) or3. Proficient (exits program)

Students with an Emerging or Progressing determination will continue in TBIP, while Proficient students should no longer receive language development services.

• Proficient students should be provided academic support as exited TBIP students on an as needed basis.

ELPA21 Score Reports Continued…

9/1/2016


39

As was communicated earlier (through monthly webinars and Washington Assessment Weekly newsletters), student score reports from the spring 2016 ELPA21 administration will not be available in hard copy prior to the start of the 2016–17 school year, but will be shipped to districts in early to mid-October. More information about the specific date of delivery will be shared as soon as it is available.

For additional details please refer to Memorandum 045-16http://www.k12.wa.us/BulletinsMemos/memoranda2016.aspx

http://www.k12.wa.us/ELPA21/default.aspx

http://www.k12.wa.us/BulletinsMemos/memoranda2016.aspx

ELPA 21 Screener Pilot

9/1/2016


40

While the Washington English Language Proficiency Assessment (WELPA) screener will be used for the 2016–17 school year, the ELPA21 Consortium is currently identifying a vendor who will support the ELPA21 Screener pilot test administration.

• Late September, OSPI and the chosen vendor will solicit district participation for the screener pilot test, currently scheduled for late October 2016.

When the ELPA21 Screener becomes operational, it will be used by educators and other school/district staff making program placement decisions for students who are potentially eligible for TBIP services.

• Results of the operational ELPA21 Screener will be reported to parents and federal agencies as required by Title III.

• Initial operational use of the ELPA21 screener will be spring (May) of 2017 for incoming students starting school for the first time in the 2017–18 school year.

WELPA Placement Test Materials

9/1/2016


41

For the 2016-2017 school year districts will continue to use the WELPA Placement Test to determine initial student eligibility for TBIP services.

WELPA Placement Test materials were delivered to districts August 4 or 25. Test materials for each district were generated using historical data to account for growth. District Test Coordinators should review all materials before requesting additional materials through the Assessment Operations office. Schools not accounted for in the previous year's data may contact Assessment Operations to place initial orders.

The WELPA Placement Test Training can be accessed by Test Coordinators in WAMS.

COE


42

Achievement Level set by State Board•On August 15, 2016, the State Board of Education set the cut score for the Exit Exam ELA and Math COE.

◦ ELA – passing score of no less than 24 out of 68 points

◦ Math – passing score of no less than 14 out of 40 points

•An “equal impact” process was used to derive new cut-scores. ◦ “Equal impact” aims to not penalize students during the state’s transition to the new Exit Exam COEs.

◦ Across the last 3 years approximately 80% of students passed on the reading & writing COEs and the previous math COE.

•OSPI derived how many points would have to be earned on each of the new COEs for 80% of the students to pass.

9/1/2016


43

Graduation Alternatives Update


44

Overview of topics for todayGraduation Alternatives

◦ CAA

◦ CIA

◦ Waivers

Graduation Alternative Application◦ Phase 1 Updates

◦ Phase 2 Updates

Webpage is being updated to provide the most accurate information for the 2016-2017 year.

9/1/2016


45

Graduation Alternatives – CAACollection of Evidence (COE) – no major changes

◦ June COE scores will be ready August 31 (for all content areas)

◦ CAA/CIA and WAMS – Sept. 2

◦ Blue Dots – Sept. 7

◦ Score reports will ship – Sept. 30

GPA Comparison◦ The GPA Comparison Calculator has been updated and embedded in the Graduation Alternatives Application. It will now pull all needed data from CEDARS,

CAA/CIA database and State Test Query to run the calculation.

**Attention: The GPA Comparison Form is currently undergoing a fix regarding a software bug in the validation. The form may still be used to calculate and save a student’s GPA Comparison results, but will be unable to be submitted for signature until a fix is implemented. Estimated release of fix: mid- to late-October

College Admission/AP/IB Tests◦ SAT with Essay (new test) – An SAT ELA cut score of 410 and mathematics cut score of 430 were approved by the State Board of Education on August 15 for

use with the class of 2017 and beyond.

◦ ACT with Writing – An ACT ELA cut score of 14 was approved by the State Board of Education on August 15 for use with the class of 2017 and beyond.

◦ AP and IB Tests now have a English Language Arts (ELA) subject area for the class of 2017 and beyond.

9/1/2016


46

Graduation Alternatives – CIACertificate of Individual Achievement Cut Score on Regular Assessment/COE

◦ No changes

Off-Grade Level Assessment on Regular or Alternate Assessment*◦ No changes

Locally Determined Assessments◦ ELA content area options (combination of Reading and Writing) have been added for the class of 2016 and

beyond.◦ Please remember: there is no longer a “paper version” of the LDA registration form. All LDAs should be

submitted via the Graduation Alternatives website along with their accompanying score reports.**Attention: The signature function of the LDA form is currently undergoing a fix regarding a software bug. Estimated release of fix: mid- to late-October

9/1/2016


47

* Use of the off-grade WA-AIM is intended for the students who meet the participation criteria for the Alternate Assessment

Graduation Alternatives - Waivers

Out-of-State Transfer Waiver◦ Addition of OOS Transfer waiver options for students receiving Special Education Services

◦ L2 Cut score on another state’s Regular Assessment

◦ Alternate Assessments (used for Federal Accountability) from other states

Special, Unavoidable Circumstance Appeal Waiver◦ Updating the “transfer by” date for students who transfer into a Washington public school during their senior

year to: the end of the first term or February 15th, whichever is first.

◦ Updating that students who have transferred into WA by the date above must also demonstrate attempts towards meeting the assessment graduation requirement using the Graduation Alternatives available to them.

◦ Clarifying the intent of the Special, Unavoidable Circumstance Appeal.

9/1/2016


48

Graduation Alternatives ApplicationPhase 1 Updates

1) Updated the Eligibility Calculation to stay in line with the intent of RCW 28A.655.061(3)(d) and WAC 392-501-510 using an embedded calculation:

◦ Application will be available to 12th grade only

◦ Application will calculate transfer waiver students now (removal of the eligibility request)

2) All Graduation Alternative forms will have ELA as an available content area ◦ for the class of 2017 and beyond

3) New! GPA Planning Tool**Attention: The GPA Planning Tool is currently undergoing a fix regarding a software bug. Estimated release of fix: mid- to late-October

4) Out-of-State Waiver updated

5) New! Out-of-State Waiver Test Table

6) New! Tool Tips

7) Additional Communication and Data Quality Features

9/1/2016


49

Graduation Alternatives ApplicationPhase 2 Updates

1) Embedded Audit Function and Audit Status

2) Student Level Contact Form

3) Additional updates to Existing Features be found on the application’s webpage

Please visit http://www.k12.wa.us/assessment/GraduationAlternatives/GraduationAlternativesApplication.aspxfor:• Detailed information regarding the Graduation Alternatives Application Updates

• To sign up for our email alerts, which include our newsletter on software updates, bugs, their status, and impacts to application functionality

Questions about the Graduation Alternatives or the application can be directed to the Graduation Alternatives team at: [email protected]

9/1/2016


50

http://www.k12.wa.us/assessment/GraduationAlternatives/GraduationAlternativesApplication.aspx


COE – Nightly eCOE Record UpdatesCurrent Development: Updates to student records in eCOE will be Automated

TARGET: Late September Go-Live

Two Types of Updates: Add Students – same mechanism to create new student records as for TIDE (enrollment and

issuance)

Eligibility to do a COE – when new scores are added or Graduation Alternatives Eligibility is updated, a record is sent overnight

NOTE: SSID-Only linking in CAA/CIA means fewer eligibility updates from ‘dropped’ tests in CAA/CIA


51

Digital Library Enhancements


52

Digital LibraryAdministrative Enhancements (ART)• Improved Search Performance

• School and District Coordinators can see ALL users with roles in their domain.

• Users can edit their own information including changing their own email address.

• Password reset email includes contact info for the coordinator that initiated the reset.

• Export and Import formats within ART are the same.

• …as in the same columns you import are the columns in the export, NOT the same as previous years


53

Digital Library: What’s new and exciting now?SEARCH functionality:

New filtering to narrow search results

Re-tagging effort Focusing CCSS standards (and practices for math) to narrow search results

Clarifying Subjects and Domains (i.e. ELA-Reading Literature), and grade

Become a new SNE (State Network of Educators):

Create, submit and review resources

Earn honorariums ($$$)

Participate in collaborative professional learning opportunities

9/1/2016


54

Applications now being accepted

http://sgiz.mobi/s3/SNE-Application-2016

Digital Library: Upcoming EnhancementsSmarter Balanced is working with a new vendor to make enhancements to the Digital Library based on feedback from educators and focus groups within the consortium

9/1/2016


55

Phase 1 – Late October 2016 Improved search speed• Decrease time spent by about 40%

Playlists – NEW collection of resources connected to same topic• Progression of skills/understanding – Aligned to interim blocks• Grouping of resources – connected to CCSS or other

Self-Registration Tool – users will be able to manage own account• available December

Digital Library: Upcoming Enhancements

9/1/2016


56

Phase 2 – Early January Improved Resource Tagging Options

• Resources will be able to be tagged with Smarter Balanced Assessment targets

Favorites Collections• Users can create favorites collections and share in forums

District and Regional Forums• Local groups can discuss, build, and review resources together

Interim Teacher Hand Scoring System (THSS)All materials for THSS loaded into TIDE under the General Resources drop down menu

All materials revised to systemize format, language, copyright—slightly different than last year’s materials

◦ Mathematics: no change to content of materials, and no new materials

◦ ELA: One replacement for grade 11 Performance Task

◦ Materials are replacing “Marshmallows” (loss of permissions)

◦ New materials are for “Learning Styles”

Note: These same materials are available in THSS during hand-scoring

9/1/2016


57

AIR Ways ReportingFormerly known as Interim Reports Viewer (IRV), beta tested last year

Allows viewing of interim items, student responses to interim items, and student score on interim items

Currently live

Requires that students have taken interims

If any hand scoring is required, that scoring must be completed in THSS prior to reports populating in AIR Ways Reporting

A few notable features:◦ Identifies 5 items within an interim assessment for which student performance was the lowest◦ Identifies 5 items within an interim assessment for which student performance was the highest◦ Provides difficulty estimate based on summative field test/operational data, e.g., Easy, Difficult◦ Many items include scoring information not presented in AVA

9/1/2016


58

Reporting: Target Reports in ORS“Relative to the Test as a Whole”

Indicates where the group as a whole over/under/similarly performed on targets compared to how they performed on the test as a whole

This is a “norm-reference” comparing the group to itself

A “low performing” class and a “high performing” class could have a very similar report

“Relative to Proficiency”

Indicates whether the group as a whole was above/below/at or near proficiency on targets, as described in the ALDs

This is a “standards-based” reference

A “low performing” class and a “high performing” class likely have a very different report


59

Reporting: Writing Rubric Feedback in ORS

Shown at student level

NOT the same as the writing claim

Claim incorporates both full write and CAT items related to writing

See the Test Blueprint for more information: (http://www.smarterbalanced.org/assessments/development/)

Feedback is based on how to assign raw score points to full write using the scoring rubric

Does not take into account task difficulty within Performance Task families


60

http://www.smarterbalanced.org/assessments/development/

Assessment Content Development


61

Tentative Science Assessment Timeline


62

Year Grade 5 Grade 8 High School

Spring

2017

Measurements of Student

Progress (MSP)

Measurements of Student

Progress (MSP)

Biology End-of-Course

(EOC)

Spring

2018

Next Generation Science

Assessment


Assessment


Assessment for

accountability

(11th grade )

Biology EOC to meet the

graduation requirement

(classes 2017+) ?

Tentative Science Assessment Timeline


63

Legislative intent regarding high school science assessment

2013 Engrossed House Bill 1450

2015 Senate Bill 6145

Classes of 2017 and beyond must pass the state science exam to graduate

Biology EOC until a comprehensive NGSS Test is administered (Spring 2018)

Transition period where either the biology EOC or the high school NGSS assessment could be used for graduation purposes, much like math’s transition to Smarter Balanced assessments.

Science Assessment Events


64

Event

Development Round

Round One

Grades 5 & 8

Round Two

Grades 5, 8, &

High School

Round Three

Grades 5, 8, &

High School

Item Cluster Writing* October 2015 March 2016 October 2016

Content Review* December 2015 July 2016 December 2016

Bias and Sensitivity

ReviewDecember 2015 September 2016 December 2016

Pilot/Field Testing Spring 2016 Spring 2017 Spring 2017

Pilot Rangefinding and

Rubric Validation*Summer 2016 Summer 2017 Summer 2017

Content Review with

Data*October 2016 Fall 2017 Fall 2017

Science Assessment Events


65

EventTiming

Test Blueprint Meeting* Fall 2016

Item Specifications Fall 2017

NGSS Training Tests

5, 8, & High SchoolFall 2017

Alignment Study* Early 2018

First Operational Tests Spring 2018

Achievement Level Setting* Summer 2018

High School Next Generation Science Mini-PilotOnline

When: May/June 2017

Grade: 11th

Time: No longer than one class period, 10-12 items

Recruitment: Voluntary by district

Scores will not be provided


66

Smarter Balanced Mathematics IABs –New for 2016–17

Grade 3

◦ Number and Operations in Base Ten

Grade 4

◦ Geometry

◦ Measurement and Data

Grade 5

◦ Geometry

◦ Operations and Algebraic Thinking


67

Grade 6

◦ The Number System

◦ Statistics and Probability

Grade 7

◦ Geometry


Grade 8

◦ Expressions & Equations II (w/ Prob/Stat)

Grade 11


Smarter Balanced ELA IABs –New for 2016–17

Grade 3◦ Editing

◦ Revising

◦ Language & Vocab. Use

Grade 4◦ Editing

◦ Revising


Grade 5◦ Editing

◦ Revising

◦ Language & Vocab. UseOFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

68

Grade 6◦ Editing

◦ Revising


Grade 7 ◦ Editing

◦ Revising


Grade 11◦ Editing

◦ Revising


Previous Edit/Revise IAB has been split into 3 new IABs: Editing, Revising, and Language & Vocabulary Use, except grade 8 Edit/Revise IAB, which has not been updated yet

Reminder: Mandatory Survey


69

Inventory of Time Students Spent Testing for the 2015-16 School YearBulletin No. 028-16: Action required by October 15, 2016

Use the worksheet (attached to the bulletin, also linked in survey) to gather data from schools

Enter official district level response in the online survey

Response to date: 71 partial, 29 completed


70

http://www.surveygizmo.com/s3/2849481/Inventory-of-Time-Students-Spent-Testing-for-the-2015-16-School-Year

WCAP USER SUPPORT

Questions regarding information in the Test Administration Manuals • TAs and School Test Coordinators, contact your District Test Coordinator.

• District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].

Policy or Test Administration Questions • TAs and School Test Coordinators, refer to the Test Administration Manual. If additional support is

needed, contact your District Test Coordinator.

• District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].


71

WCAP ContactsAIR Help Desk for Technical, Network, and password issues

• AIR Help Desk: [email protected] 1-844-560-7366

OSPI Assessment Analysts for student data issues• OSPI Assessment Analysts: [email protected] 360-725-6109

OSPI Assessment Operations for assessment policy and test materials• Assessment Operations [email protected] (360) 725-6348 or (800) 725-4311,

press option 3

The Smarter Balanced Assessment Consortium has updated its website. Check out the revamped and more user friendly site launched this week at http://www.smarterbalanced.org/.


72




http://www.smarterbalanced.org/

WCAP Contacts for Technology, System, or Program Issues

• TAs, School Test Coordinators, and District Test Coordinators contact the WCAP Help Desk (TAs and School Test Coordinators must also alert the District Test and Technology Coordinators of issues).

• The WCAP Help Desk is open Monday–Friday from 6:00 a.m. to 6:00 p.m. PT (except holidays or as otherwise indicated on the Washington Comprehensive Assessment Program Portal).

• Washington Comprehensive Assessment Program Help Desk

Toll-Free Phone Support: 1-844-560-7366

Email Support: [email protected]


73

Revision Log

Updates to the Module after the August 31, 2016 webinar.


74

Section Slide Description of Change Revision Date

Overview 4 Changed IRV and AIR360 to AIR Ways 9/1/16

Operations 8 Added OGL Translated CD Demo available 9/22

9/1/16

Operations 10 • AVA module available date changed from 8/30/2016 to 9/6/2016• TIDE module availability changed from

9/16/2016 to 9/6/2016

9/1/16

Welcome to the New School Year!


75

office of superintendent of public instruction · 8/31/2016 · topics for the ospi assessment...

Documents