7EA ® Texas Education Agency

STAAR Interim Assessments Texas Assessment Conference

November 4, 2019

Texas Education Agency

Agenda

STAAR Interim Assessments Overview

Updates to the 2019–2020 School Year

2018–2019 Data

Stakeholder Feedback

Resources

Objective: Attendees will understand the purpose of STAARinterim assessments to inform student progress monitoring.

2

7EA ® Texas Education Agency

STAAR Interim Assessments Overview

3

Texas Education Agency

What are STAAR Interim Assessments?

The STAAR interim assessment is a free, optional online tool for school districts and open-enrollment charter schools that provides actionable data to help educators monitor progress and predict student performance on the State of Texas Assessments of Academic Readiness (STAAR®).

Interim assessments include test questions developed with Texas teachers and STAAR summative test questions from previous years.

Interim test questions have been field tested and are fully aligned to the Texas Essential Knowledge and Skills (TEKS).

4

Texas Education Agency

The STAAR Interim Assessment…

IS…. a way to monitor academic improvement, especially for students who

are consistently performing below grade-level. a tool to inform interventions for students or groups of students based

on predictions of STAAR performance. a benchmarking instrument at the campus or district level.

IS NOT…. an item bank intended for building classroom quizzes and assignments. a source of test questions for tutoring or small-group instruction. a classroom formative assessment tool designed to provide performance

data on specific student expectations

5

Texas Education Agency

#it ....... ....

Pulse Check

True/False: interim assessments are a tool designed to provide performance data on specific student expectations.

6

Texas Education Agency

Assessment Types: What’s the difference?

Classroom formative assessments measure student performance on specific student expectations to inform a teacher's instructional choices, immediate adjustments to unit plans, and changes to lessons. (Examples: class quizzes, exit tickets)

Interim assessments measure a student's understanding of a broader span ofstudent expectations to monitor progress, predict summative performance, and identify students for intervention. (Examples: benchmarks, STAAR interim assessments)

Summative assessments measure student mastery of a broader span of student expectations at the end of an instructional unit to determine the effectiveness of the program. (Examples: student portfolios, STAAR summative assessment)

7

7EA ® Texas Education Agency

Updates to the 2019–2020 School Year

8

Texas Education Agency

Updates for 2019–2020 (1/2)

New STAAR interim assessments will be available for science and social studies (in English and Spanish where applicable).

Unlike the TEKS for reading language arts (RLA) and math that tend to include similar skills over the grades but build in complexity, the science and social studies TEKS tend to contain discrete skills, facts, and concepts. Therefore, the Texas Education Agency (TEA) is planning to only offer one testing opportunity and recommend that it is administered after the majority of TEKS have been covered

9

Texas Education Agency

Updates for 2019–2020 (2/2)

Interim assessments for math and RLA will continue to be available, but there will only be one testing opportunity for grades 3 - 8 reading. This is because the RLA TEKS have been revised and only overlapping standards will be assessed in grades 3 - 8 at this time.

For the Spanish interim assessments, content and language supports in Spanish will now be available.

Refreshable braille is now offered for reading, English I, English II, grade 8 social studies, and U.S. History.

10

Texas Education Agency

Opportunity and Registration Dates for 2019-2020

First testing window (Opportunity 1)

Second testing window (Opportunity 2)

Registration opens: Assessment window: August 12, 2019 August 15, 2019 -

March 31, 2020

Registration opens: Assessment window: November 15, 2019 November 22, 2019 -

March 31, 2020

11

Texas Education Agency

Opportunity Availability by Subject

Two testing opportunities (available during Opportunities 1 and 2) • grades 3 - 8 mathematics • Spanish grades 3 - 5 mathematics • Algebra I • English I • English II

One testing opportunity (available during Opportunity 2 only) • grades 3 - 8 reading • Spanish grades 3 - 5 reading • grade 5 science (new) • Spanish grade 5 science (new) • grade 8 science (new) • grade 8 social studies (new) • Biology (new) • U.S. History (new)

12

Texas Education Agency

#it ....... ....

Pulse Check

Why are 3-8 RLA tests only offered for one testing opportunity this year?

Which opportunity are they offered in: opportunity 1 or opportunity 2?

13

7EA ® Texas Education Agency

2018–2019 Data

14

Texas Education Agency

••• ---

During the 2018–2019 school year…

~1.7M interim assessments were completed.

~600 districts participated in interim assessments.

868k unique testers submitted an interim assessment.

Average testing time was 1 hour 37 minutes total.

15

TEA® Education Agency Texas

l

■

Tota l Test Sub missions

0

10,000

20,000

30,000

40,000

45,852

.... . --- -­-'•• ........

: . i • .

• • . . . . . · ··: • • •

. .

•

• . . . • • ----:· e ·

• •

Chihuahua

'. )

•

· . . , ... , ... _, ;''··· -• ... \:•' '•··--• .. ,·~ .. ,_: }

)·

Coahuila de Zaragoza

• •

. •

Oklahoma

····•·."· .. '

'---.. • . \,>,,,-•-, -~,-- ~--· -~ ·:_ > ·---i __ "•

. •

. . -..· .. •· •.. . . . . . . ·; • ·-~ .•. .:; \i i . . .

• • • • • . -·~ ... . • .. . .~-: .. . ..

: ...... ·.• ·, : ~- "'-_ ... : ·- . . . •e:•;.·. .. • • . •; . • .• ~ ·.. . . . . . .. i • • • •• • •

.. Tex:..s

.....

··•.

• •

• . , •

• • .- c •

Interims have tripled in participation

0.4M

1.7M

0.0M

0.2M

0.4M

0.6M

0.8M

1.0M

1.2M

1.4M

1.6M

1.8M

Uni

que

Test

Subm

issi

ons

During the pilot year, interims were

only available by application

As interims became available to all districts, participation increased by 1.3M

Last year, interims became available to all

districts

2017-2018 (Pilot) 2018-2019

Actual

16

Texas Education Agency

New ~eXJCO

- - ------------------------------- -YSL ETA ISD ECTOR COUNTY ISD

Chihu~hua

-·,.,•-.. ,: ;·--·

Coahuila de Zaragoza

Nuevo Leon

·--

Texas

~-·-----------

Oklahoma

,-,,

,_ ••• '-: ,·'(~- .,_ ,,·c, •• _,:. -- •• - • ..__ • .--. ·• .... . ,. __ , ...

CARROLLTON-F.!111 BRANCH ISD

AUST IN ISD •

• __ / BROWNSVILLE 15D

Interims serve districts across Texas

Top 10 Districts Total

SPRING ISD 76,710 YSLETA ISD 66,441 ECTOR COUNTY ISD 55,493 PFLUGERVILLE ISD 52,631 BROWNSVILLE ISD 44,914 TOMBALL ISD 38,176 CARROLLTON-FARMERS BRANCH ISD 36,250 LUBBOCK ISD 35,847 MESQUITE ISD 35,239 GRAPEVINE-COLLEYVILLE ISD 28,086

17

Texas Education Agency

• ••• ---

2019–2020: Where are we at today?

252 districts statewide have registered for over 1 million interim assessments.

119 districts statewide have completed 80,961 interim assessments.

*Reflects data pulled on 11/05/2019

18

Texas Education Agency

#it ....... ....

Pulse Check

What percent of districts participated in STAAR interim assessments in 2018-2019?

About how long does it take to complete an entire interim assessment?

What happens if a student doesn’t finish in this amount of time?

19

Texas Education Agency

Stakeholder Feedback

20

Texas Education Agency

• •

• •

Positive feedback from stakeholders

“

Stakeholders believe interims help students practice for the online STAAR…

The students were able to practice using theonline system.

It is helpful for students that will take the STAAROnline test.

I think the format will help prepare them for theonline assessment.

I liked having this opportunity for students andfor them to experience an online testing format.

I think the tool is useful for students who will test online with embedded support. It gives them extended exposure to the testing platform.

…and provide useful data to better support students

“ It will help me to target specific students and identify trends.

For years, we have needed a system that canprovide real-time feedback that is aligned to statestandards and the STAAR exam. This systemprovides that. Thank you!

Teachers will DEFINITELY be able to use this for help in preparing students for the spring assessments

It provides a starting block upon which we canmonitor and support personal achievements. “ “

21

Texas Education Agency

I I -------------------------------------r---------------------r----

89% of DTCs and 63% of teachers believe interim assessments will improve summative outcomes

Respondents that agree with the statement: The interim assessment tool will improve outcomes on state

assessments

Total

Other district/campus staff

Classroom teacher/test administrator

Campus Testing Coordinator

District Testing Coordinator

TEA solution: Roles and Permissions as well as new Group-Rostering capabilities in TOMS have been updated to allow districts more flexibility in assigning teacher roles.

Lower teacher responses may be due to lack of access to data • “If teachers don't have access to results,

there is no way this will improve work of the students.”

• “I was not given access to the results and have not been able to use any data.”

0% 20% 40% 60% 80% 100%

22

Texas Education Agency

What can you do?

Follow the Best Practices Make sure teachers read the FAQ. Understand the purpose of interim

assessments in comparison to formatives. Strategically schedule the tests (November

and February). Confirm that students and systems are

ready for testing. Teachers should understand how to analyze

their students’ results and have access to do so. (Demo of teacher access to Online Reporting Suite.)

23

Texas Education Agency

Read the FAQ

The frequently asked questions document details the overview, purpose, and specifications of interim assessments.

24

Texas Education Agency

#it ....... ....

Pulse Check

How are the STAAR interim assessments administered?

Who do I need to call at TEA to get permission to participate?

Are the STAAR interim assessments a part of my school’s accountab ility?

25

Texas Education Agency

Strategically schedule the tests

Because STAAR summative predictability is based on the number of school instructional days, STAAR interims are more accurate when Opportunity 1 tests are administered in November and Opportunity 2 tests are administered in February.

*Schools and teachers should consider their local scope and sequence as well as when to test off-grade.

26

Texas Education Agency

Confirm that students and systems are ready for testing

Are students prepared for interims? Have district IT personnel updated the STAAR Online Testing Platform systems

and ensured that the bandwidth will support students testing? Are test tickets printed? Is school closed down or are students working on interims over time? Have you spoken with parents so that the data you share with them is more

meaningful? Are your students comfortable with the PNPs and Content and Language

Supports? Are your students comfortable with a computer at all?!

Secure Browser for SOTP 27

7EA ® Texas Education Agency

Resources

28

Texas Education Agency

Search TEA Texas Educat ion Agency

A- Z Index Contact Employment

m oOO CJ' About TEA Academics Finance & 6rants Reports& Data Student Testing &

Accountability

Home I Student Testing and Accountability I IH!ing I State of Texas Assessments of Academic

Readiness (STAAR)

State-Developed ST AAR Interim Assessments student Assessment Home I Assessment A-Z Directory I Contact Student Assessment

Overview of STAAR Interim Assessments Tne Texas Education Agency (TEA) tlas created optional online interim assessments ttlat align

to the Texas Essential Knowledge and Skills (TEKS). Test questions for the STMR Interim

Assessments are developed with Texas teachers and include some former STA.AR items. These

assessments will be available at no cost to districts and charter schools, and they are not tied to

accountability

Resources • STAAR Interim Assessments Frequently Asked Questions (PDF posted 08/14/19)

• Best Practices: How to Successfully Implement STAAR Interim Assessments (PDF posted

08/14/19) • Interim Assessments User Manual (posted 08/13/19)

• Assessment Blueprints: Grades 3-8 Mathematics, English I and English II , Algebra I

• (additional blueprints will be available before the second testing window)

Training Opportunities Training opportunities through webinars are available for the 2019-2020 Interim Assessments.

Materials and recordings will be available on the Texas Assessment website

El Sign Up for Updates TEA Correspondence

I'll') ~ Texas Educ.ators Texas Schools

Contact Information

For additional information, contact

Student Assessment Division

1701 North Congress Avenue

Room 3-122A

Austin, Texas 78701

(512) 463-9536

student.assessment@tea.texas.gov

Q What are che STAAR ,men m ass.essmencs.1

The STAA.R interim asse5sments ii,.. offered iilS ii free optiol"WII online tool for sct\O districts and open-enrulmE>flt ch.irmr schoots. The tool pru..-ides Ktionable data to help educators monioor progress and Delp predict student p«fo ma nee on the St.ilte ofTe:w;asAssessments of Academic Re~(t,i_f!~S~_(SJAAR~L

ii1toolto1niormnterv@OllCOSforstudents based onpredlction5 of STAM performance

TEA, . f II , ... a .... ,~. Best Practices: How to Success u y

Implement STAAR Interim Assessments

Resources

More information about interims can be found on the STAAR Interim Assessments website…

…including Frequently Asked Questions (FAQ) and Best Practices

29

Texas Education Agency

Interim Assessments User Manual

Supplement to the STAAR Assessment Mana,gement System User's Guide

2019-2020 ADM INISTRATIONS

Revised 7/ 29/ 2019

St udent Assess ment Divisio n l exas Education Agency 1701 N. Congress Avenue Aust in, TX 78701-1494

l exas Assessment Suppo rt Center 855-333-7770 STAAR3-8@ets.o rg STAAREOC@ets.org

Resources

Detailed instructions on registeringstudents, preparing and administering interim tests, and viewing and analyzing results areavailable through the Interim Assessments User Manual. Pro Tip: Section 8 Making Sense of

Interim Assessments is useful to teachers to orient users to data analysis. Data comes in three forms: District-Level Campus-Level Student-Level

30

Texas Education Agency

D,i str ict Overview Report~

.,........ --

1644

- ________ __:;,:......---r CIiek Students Tested to view a .,_ list of al l campuses with data.

+--- --- --- ----, Hover over status bar to display students tested and registered . ........... "'.~ Cl1ek Find to search for other organization or student reports.

Results are segmented into top and bottom quarters and middle half based on the scale Score Range at the bottom of the page. Cl/eking a segment displays schools Included in the range and the Mean Score for each.

- ---------------------+-Campus resu"s are shown from

·=

• ----~

lowest to highest mean score. Scroll over the bars to Identify campuses. Click a bar to view the campus report.

-------c1,c1<. a Probabilities pie icon to view a detailed pop-up repolt .

Campuses are listed from /OWeSt to highest Mean Score. Number of students who completed testing is a/s,o shown.

- - ---------------------------+-CIiek a campus link to view the campus reporl.

-- - ----- ----- -.:::;:;;:=-- ------- - ---- ~1 Cl/ck the Info Icon to view 4 ---=====::::;~ additional information about the

TEA

• Composite Image from multiple views. CIiek the PDF Icon to download a PDF file of the displayed report.

data displayed.

Resources

District-Level Data In the District Overview

report, districts can view the mean score for their district and results by campus as two reports: one report displaying graphs and the other displaying an alphabetical list of campuses.

31

Texas Education Agency

Potential Strategies

District-Level Data Review the campuses at the top and bottom quarter. Are there similarities among the campuses? Differences? Are there bright spots at certain campuses that should be further investigated to

determine best practices that could be shared with other campuses?

NOTE: As you are answering these questions pay close attention to the number of students taking the test at each campus. Comparisons may not be as strong with small student counts.

32

Texas Education Agency

I'

17

......................

-- -

:.!J~ ;;-..--r Click S· udents Tested to, view the Cam us s tucl m

.._--------- Performanc r:eport. Hove-r over status bar to -------T display stuclents ested nd reg s.tered. ---t- Click nd to search for oth r organJza km or tuden ,rep®.

~ -----t-Resurts are segmented into op nd bo tom quarters and middle,

ha , based cm the Scafe Scote Range shown st he botlorn o he page. Clicking a segment displays a !isl of students and mean- scores. Student resulls -r,e displayed from lowest to bi hest me n score. Scroll over lo view student scores_ Clic o vie v a• st nt report.

Student reslllls indude Soo,e.

:~------=---~~:2~-t~~~~~~~-~-~-~-~~:::Ll Probabilities, and performence by categorr for he, selected segment.

CJk a· s udenr lin ,to Ill ew -ndi ·dual s uden re.suit • --------------...::.........::.:.. ____ _::...__,_....,...._ ____ ___:: ~:::L Click e Info iaJn to ll>iew

addi oo,a,J information a.bout the da ,a displayed.

· Composite ima e fr,orn m I i,ple v·ews. Cftck the PDF Icon to download a PDF 1i · of t e displayed report.

Campus-Level Data In the District Overview

report, districts can view the mean score for their district and results by campus as two reports: one report displaying graphs and the other displaying an alphabetical list of campuses.

Resources

33

Texas Education Agency

Potential Strategies

Campus-Level Data Review the results within the campus. Look at the bottom quarter of the score range within the pie chart. Focus on similarities and/or differences between the students. Identifying results by levels (top quarter, bottom quarter, and middle half) allows

you to quickly identify students who are struggling with the content and studentswho are excelling with the content. This will allow you to develop strategies at each of the different levels.

Look at students that have a greater than 75% probability of obtaining Approaches. How are they doing at the reporting category level? Are there students who are performing well (have a high raw score) in a particular

reporting category? Are there students who have a scale score in the bottom quarter of the score range

and have a reporting category flagged as a strength? What is different or unique for these students in comparison to the other students

in the bottom quarter of the score range?

34

Texas Education Agency

Plubol . . &HI

" .

1650

1,--..~ 1

111~8 · 101:!1'UCorn!d

lllil'FIJ' 1' - "' Q ..... r I po ~ •I .... . -

l1• .., Q,,

s.,. ✓ Q,

n; i;,,,.,. )( Q,

11 S.1 F 1111 °""" ✓ Q,

C....,,..,.2:Aipltlrll t1p1:lt1~cana

a .. ltu b.1 ... 5,j. yl' q

S:t ... I I r• Q,

~, .., Q,

u ~lE .., Q,

Resources

Student-Level Data The reported interim assessment results areintended to answer these questions: What is the scale score that a student

would most likely achieve if he or shewould have taken the STAAR summative assessments at this time?

How likely is it that the student is going toachieve Approaches, Meets, and Masters grade level performance on thecorresponding STAAR summativeassessments in the coming spring 2020 primary administration?

Is the student relatively stronger or weaker in one reporting category?

How did the student do on each item?

35

Texas Education Agency

Potential Strategies

Student-Level Data Review the item-level data for students who took the same test form. Analyze the incorrect answers given to identify student misconceptions about a

concept. Group students who have similar misconceptions together to teach a lesson that

addresses those misconceptions. Go to the released forms or the formative item bank to find additional items covering

that same student expectation and/or concept and give them a few items as an exit ticket after the lesson.

36

Texas Education Agency

o,

--•

-•t-a-1M-•

•t-aNIM~•

TEii

.w o...... c.--11 o _,, olJllhcj ...... o-.,... ..

- ---•- ·-· 0...-,-•--....•c.--... ----~ l\"lWJIJ'l·171a•'J -----

~­- --- =I _....,.

~ - ~-1- Across Years displays performance year-to-year.

Click the radio buttons to switch to a different subject or between district and campus mean and median.

Click selections under Score History to toggle their display. Click and drag the timeline bar (or use the scroll wheel) to adjust report date span.

Scroll over data points to display details (date, time, test type, and score).

Student scores are plotted in the Score graph. Adjusting report date span also changes the X-axis display accordingly to show years, months, days, or times between tests. Tests taken are listed below the Score graph, including summary information tor each test and links to the detailed student report for each test.

..+----:-:--.:r---i-r Score Range displays the student score on the test score range. Cilek an info icon to view test score range.

* Composite Image from multiple views. A PDF report with the data on this page is available for

download.

Off-grade tests are indicated by a pink bubble in the Score graph above and listed here with a pink Off grade test bubble. Scroll-over to view the student's enrolled grade.

Potential Strategies

Across Years view shows student test performance for a single subject across school years. View student scale score results

between opportunities to show improvement. Note where the student may have

taken a below-grade test. Note how the student performed

when that student re-attempted thetest. Follow the student's progression of

primary scores across years. Use the School Year tab to see and

focus on grade and subject results forjust one year at a time.

37

Texas Education Agency

*~ ~;~:ang Sutte Interim Longitudinal Bad to STAAR k~essment Management &,stem Logout

Interim Reports Slate TEA - Texas Education Agency District ETS UAT District #1 New Campus ETS UAT District 1 EL 5

ETS UAT District 1 EL 5 Report 2019-20 INT 3-8 Spring (SC, ss and Op2 MA. RE) Spanish

Viewing: Grade 5 Mathematics All Forms • 1· -Select Roster_ .. ...... ; j .................................. .~! .. O.g.m_9.9I~.P.0.!~~

Report Categories

Mean Score students by Roster(s)

1414 12 07~92 r-~-------~

Campus's Student Scores ; k•f H 1704

1604

1504

"' 1404 Q)

0 ()

rn 1304

1204

1104

1004

904

Campus

District

Students in Each Level ;

11

Mean Score Comparison

1414

1390

Potential Strategies

Use the “All Forms” tab available to view if a student who took a multi-stage adaptable test was routed to Easy, Medium, or Hard.

38

TEA® Education Agency Texas

--

j

. -­-·------

-

n-

·- .... ,

•-~-· _.,

• • • •

• • •

Potential Strategies

The School Year view shows student test performance for a single subjectduring the current school year.

Teachers can use multiple views in student-teacher conferences and conferences with parents.

39

Texas Education Agency

#it ....... ....

Pulse Check

Which assessment type measures performance of specific standards: classroom formatives or interims?

Which assessment type predicts summative performance: classroom formatives or interims?

40

7EA ® Texas Education Agency

You make an impact! THANK YOU!

Contact me at (512) 463-9536 kristina.mcceig@tea.texas.gov