1 amp results overview for educators october 30, 2015

1AMP Results Overview for

EducatorsOctober 30, 2015

Elizabeth Davis, Standards ImplementationElizabeth.Davis@Alaska.gov

Brian Laurent, Data ManagementBrian.Laurent@Alaska.gov

Kari Quinto, AMP Project CoordinatorKari.Quinto@Alaska.gov

Anji Gallanos, ELA SpecialistAnji.Gallanos@Alaska.gov

Deb Riddle, Math SpecialistDeb.Riddle@Alaska.gov

2

3

Content for this hour session:

• AMP Reports available in Educator Portal & other AMP Results sources.

4

This session assumes that the participants:• Are implementing the current Alaska ELA and Math

Standards.• Are aware of the reasons for the changes in

standards, assessments, and accountability in Alaska.• Understand the design and purpose of different

kinds of assessments.• Are familiar with the AMP Summative Assessment

Framework and the terms Claims, Targets, and Evidence Statements.

For further information on this content, please view the Understanding AMP Reports webinar.

Strategies To Use During This Session

Document what you need to learn more about, tell someone, or teach someone.

Apply the information to your context.

Write down your questions and send them to us.

5

Your Learning

At your table group, discuss with a partner:

1. What are 3 ideas or pieces of information that you hope to take away from this session?

2. What strategies will you use to…

• Be fully present knowing that you will have email, texts, phone calls, etc.

• Remember what further learning you may need to do.

• Document your next steps.

6

AMP Assessment System• Formative resources• Interim Testlets: Alaska Instructional

Impact Measures (AIIMs)• Standardized, large scale summative 7

8

Formative Resources

• Activities to elicit student thinking w/teacher guides to interpret student work

• Focus on how student understanding develops: prerequisites, common misconceptions

9

Interim TestletsAlaska Instructional Impact Measures

• Measures & reports student learning at the standard and target level

• Now: individual testlets available

• 2016-17: Ability to bundle testlets into custom interim assessment

• 2018: predictive data for the purposes of intervention

10

AMP Summative Assessment

• Measures at the target level.

• Reports student learning at the Content Area level and student relative strengths at the Claim level.

• The Summative Assessment Framework provides the information of how the AMP summative measures the AK Standards.

Parti

ally

Mee

ts

Stan

dard

sStudent demonstrates knowledge & skills of complex grade level content

Student demonstrates knowledge & skills of current grade level content

Student may have gaps in knowledge & skills but is capable of most grade-level content

Student may have significant gaps in knowledge and skills. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1.

Level 4

Level 3

Level 2

Level 1

Mee

ts

Stan

dard

s

11

12

13

AMP Reports

1. Where they are found.2. How to read them.3. What they tell you and what

they don’t tell you (and why).4. Resources available for

educators. Please provide your suggestions on how to make these first year reports better next year. Email elizabeth.davis@alaska.com orvisit the web-based feedback form in the AMP Results Toolkit.

14

Accessing Reports in KITE Educator Portal

15

Guide available on EED website, AMP Toolkit

Types of AMP Reports in KITE Educator Portal

Student Report

School SummarySchool Detail

District Summary District Detail

16

Packet of report templates

Student Reports• One each: Math, ELA

• Accessible in Educator Portal to principals, district administrators

• Hard copies mailed to districts

• Guide to Test Interpretation available online 17

Student Report

Level 3 & 4 : Meets StandardsLevel 1 & 2: Partially Meets Standards

AMP Meter

18

AMP Meters: School, District, State

Allows comparison of student’s achievement level to median achievement level of students in the same grade in the school, district, and state.

Student Report

19

Score Ranges for Achievement Levels

Shows score range for each achievement level for reported grade and content area.

Scales range from 620 to 780.

Levels 2 and 4 ranges vary by grade and content area.

20

700Grade 8 ELA Score Ranges shown

Achievement Level Summaries

A student who performs at this level can…

21

Student Report

22

Level 1 scores are difficult to interpret. They range from no correct answers to scores that miss Level 2 by one point. There are a number of reasons a student’s performance resulted in a Level 1 score; however, most students whose scores fall into Level 1 likely have difficulty reading, analyzing, and understanding complex grade-level texts. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1.

23

Level 1 scores are difficult to interpret. They range from no correct answers to scores that miss Level 2 by one point. There may be a number of reasons why a student’s performance resulted in a Level 1 score; however, a student whose score falls into Level 1 may have difficulty computing with decimals, explaining place value patterns, or using formulas to calculate volumes of rectangular prisms. Parents/guardians and teachers are encouraged to examine other academic information and discuss possible reasons that a student’s score is in Level 1.

Consider the shift from the previous SBA “Far Below Proficient” to the AMP Level 1 summaries.

24

How might the language in the level 1 summary impact conversations between teachers, students, and their families?

How might it impact conversations between teachers?

25

Student’s Relative StrengthsStudent Report

Shows student’s performance at the Claim level.

Target level (or “strand” level) reporting is not possible due to the small number of items.

Unique scale 100-120

Student’s Relative Strengths (Math)

Claim 1: Concepts and ProceduresClaim 2: Problem SolvingClaim 3: Communicating & ReasoningClaim 4: Modeling & Data Analysis

26

27

Student’s Relative Strengths (ELA)

Claim 1: ReadingClaim 1-RL: Reading Literature textsClaim 1-RI: Reading Informational textsClaim 2: Writing

School & District AMP Reports: Summary, Detail

28

School Summary Report

One for each content area – shows all grades tested.

School Summary Report shows school, district, and state results.

29

School Summary Report

Median Achievement by grade

Shows median scale score for the content area for each grade level, for school, district & state.

Scales for all grades range from 620 to 780. The dotted line represents 700, the minimum scale score needed to meet the standards.

30

School Summary Report page 2

Shows percentage of students in each achievement level by grade for school, district, and state.

31

Meets Standards

Partially Meets Standards

School Summary Report

32The percent of students in an achievement level is shown in ranges when there are small numbers of students.

CAUTION: The size of the bars is NOT proportional!

School Detail Report

One for each grade and content area.

School Detail Report shows school, district, and state data.

33

School Detail Report page 2

Sub-scores – “relative strengths”

Claims

34

For your consideration….

Thinking about who you will talk with about the AMP reports…

Which strategies & resources do you find most effective when explaining new content this?

What resources might you need from EED?

35

36

education.alaska.gov

37

AMP Results Tool Kit Resources

– AMP Results Fact Sheet– AMP Score Setting Fact Sheet– Drop-In Newsletter Content– Understanding AMP Reports

PowerPoint– Parent Brochures– Guide: what a Level 1 (or 2,3,4) Score

means – Comparison of AMP and SBA items– Released AMP Items– Key Messages & Talking PointsMore added regularly…

38

One thing you will learn more about.

One thing you will share with someone

tomorrow (who, what)

One topic you feel more confident about than you did before.

One message you want to communicate to your students &/or

their parents.

AMP

39

Elizabeth Davis, Standards ImplementationElizabeth.Davis@Alaska.gov

Brian Laurent, Data ManagementBrian.Laurent@Alaska.gov

Kari Quinto, AMP Project CoordinatorKari.Quinto@Alaska.gov

Anji Gallanos, ELA SpecialistAnji.Gallanos@Alaska.gov

Deb Riddle, Math SpecialistDeb.Riddle@Alaska.gov

40