interpreting feedback from baseline tests - whole school & individual student data course: cem...

30
Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information Systems for Beginners and New Users Day 1 Session 2 Wednesday 17 th October 2012 Peter Hendry: CEM Consultant [email protected]. ac.uk

Upload: dustin-heath

Post on 20-Jan-2018

219 views

Category:

Documents


0 download

DESCRIPTION

Bands, percentiles, standardised scores… Standardised scores D C B A Percentiles:

TRANSCRIPT

Page 1: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data

Course: CEM Information Systems for Beginners and New Users

Day 1 Session 2Wednesday 17th October 2012

Peter Hendry: CEM Consultant

[email protected]

Page 2: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

‘Everything should be made

as simple as possible but not

simpler’

Albert Einstein

A well known person

‘The goal is to transform data

into information, and information

into insight’

‘Carly Fiorina’

Ex-president and Chair of Hewlett-

Packard

Page 3: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Bands, percentiles, standardised scores…

0

50 60 70 80 90 100 110 120 130 140 150

Standardised scores

DC B

A

105 20 301 40 90 958070 996050Percentiles:

Page 4: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

National Quartile Ability Bands

BASELINE D C B A

ALIS: AV GCSE <5.0 5.0-5.7 5.7-6.55 >6.55

Yellis % >43 43-52 52-61 >61

STANDARDISED CABT MidYIS, Yellis and Alis <90 90-100 100-110 >110

IN ANY COHORT, 25% OF THE POPULATION WILL BE IN EACH BAND.

THE VALUES MAY VARY SLIGHTLY FROM YEAR TO YEAR

BANDS

Page 5: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Nationally, 25% in each band

Alis: year 12 students, two baseline profiles for the same school

Page 6: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…
Page 7: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Band Profile Graph: all MidYIS cohort

Checking this graph each year will give you an immediate overview of your intake.

A school with a ‘completely average’ intake would have 25% of pupils within each band.

Band D Band A

Page 8: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

3526

21 17

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Maths: Percent in each BandYear 7 MidYIS Test 2011/2012

17

37

2025

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Vocabulary: Percent in each BandYear 7 MidYIS Test 2011/2012

Band A Band ABand D Band D

Comments?

1121

33 35

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Non-Verbal: Percent in each BandYear 7 MidYIS Test 2011/2012

2924 26

21

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Skills: Percent in each BandYear 7 MidYIS Test 2011/2012

Page 9: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

2924 26

21

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Skills: Percent in each BandYear 7 MidYIS Test 2011/2012

38

2619 17

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Proof Reading: Percent in each BandYear 7 MidYIS Test 2011/2012

24 23 2330

0

10

20

30

40

50

60

70

80

90

100

D C B A

Perc

ent

Perceptual Speed & Accuracy: Percent in each BandYear 7 MidYIS Test 2011/2012

Page 10: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Vocabulary Maths Non Verbal Skills MidYIS Score

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

Average 100.6 95.9 105.3 99.2 98.1

St. error 1.1 1.1 1.1 1.1 1.1

On another day, with 95% certainty, the score of 100.6 (+/- 1.1 x 2) • would not be higher than 100.6 + 2.2 = 102.8• would not be lower than 100.6 – 2.2 = 98.4

Standardised Scores Sort Data By...

Mean Score: 100

Standard Deviation: 15

Scores Standardised On A Nationally Representative Sample of Schools

Page 11: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Vocabulary Maths Non Verbal Skills MidYIS ScoreSt

. Sco

re

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

100.6 95.9 105.3 99.2 98.1

1.1 1.1 1.1 1.1 1.1

134 A 119 A 116 A 87 D 130 A95 C 97 C 88 D 85 D 95 C99 C 104 B 112 A 110 B 101 B93 C 94 C 120 A 91 C 93 C

116 A 99 C 118 A 84 D 109 B93 C 95 C 120 A 113 A 93 C92 C 83 D 112 A 94 C 87 D

102 B 102 B 112 A 108 B 102 B

Proof Reading PSA

St. S

core

Ban

d

St. S

core

Ban

d

93.7 102.2

1.1 1.1

101 B 83 D76 D 93 C97 C 114 A80 D 99 C

102 B 78 D119 A 107 B80 D 102 B

106 B 107 B

Page 12: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Scores over 130 – top 2% nationally

Scores over 126 – top 5% nationally

Scores over 120 – top 10% nationally

Scores over 110 – top 25% nationally

Using national baseline test scores to Identify Gifted Pupils

Page 13: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Year 7: the ‘top’ students

Vocabulary Maths Non Verbal Skills MidYIS ScoreSt

. Sco

re

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

St. S

core

Ban

d

100.6 95.9 105.3 99.2 98.1

1.1 1.1 1.1 1.1 1.1

150 A 150 A 142 A 150 A 150 A122 A 132 A 130 A 150 A 130 A134 A 119 A 116 A 87 D 130 A120 A 123 A 110 B 132 A 123 A127 A 113 A 122 A 95 C 123 A117 A 121 A 116 A 109 B 121 A117 A 120 A 120 A 128 A 120 A125 A 111 A 114 A 100 B 120 A

146 146145 146101 83124 129109 89

Proo

f rea

ding

Perc

eptu

al s

peed

an

d ac

cura

cy

Page 14: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

50 60 70 80 90 100 110 120 130 140 150 Standardised Test Score

Stanine 1

2 3 4 5 6 7 8 9

4% 4 % 7% 7% 12% 12% 17% 17% 20%

Page 15: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Individual Pupil Record 75Date Of Birth: 24/12/97 Student Number:Sex: F Form:

Band Stanine Percentile Standard Score

Vocabulary B 5 53 101

Maths B 5 52 101

Non-Verbal C 5 46 98

Skills C 5 46 99

MidYIS Score B 5 52 101

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

106 B 96 CProof Reading PSA

Page 16: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

A relatively lower vocabulary score might indicate a difficulty which:

• could contribute to under-performance in most, if not all subjects

• might lead to ‘stressful situations’

• may lead to further investigation and subsequent pupil support

Page 17: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Individual Pupil Record ZUHA OKARVIDate Of Birth: 15/10/98 Student Number:Sex: F Form: 8C

Band Stanine Percentile Standard Score

Vocabulary C 4 35 94

Maths B 6 75 110

Non-Verbal B 6 63 105

Skills A 7 84 115

MidYIS Score B 5 54 102

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Individual Pupil Record RAWAD OKBIDate Of Birth: 29/08/99 Student Number:Sex: M Form: 8E

Band Stanine Percentile Standard Score

Vocabulary D 3 20 87

Maths B 5 58 103

Non-Verbal B 6 67 107

Skills B 6 71 108

MidYIS Score C 4 34 94

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Proof Reading PSA Proof Reading PSA121 A 108 B 88 D 118 A

Page 18: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

A relatively low maths score might indicate potential weaknesses in subject areas which require:

• numerical skills

• logical thinking

• skills such as sequencing

CONVERSELY: a high maths score but a low vocab/reading score…….

Page 19: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Individual Pupil Record RACHEL STRONACHDate Of Birth: 13/1/99 Student Number:Sex: F Form: 8E

Band Stanine Percentile Standard Score

Vocabulary B 6 63 105

Maths D 3 15 84

Non-Verbal A 6 76 111

Skills B 6 67 107

MidYIS Score C 4 37 95

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Individual Pupil Record CAMERON BALLDate Of Birth: 29/10/98 Student Number:Sex: M Form: 8E

Band Stanine Percentile Standard Score

Vocabulary C 5 45 98

Maths A 9 99 135

Non-Verbal C 4 39 96

Skills B 6 74 110

MidYIS Score A 7 87 117

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Page 20: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

A relatively high non-verbal score might indicate potential strengths in subject areas which require:

• 3d, and 3d into 2d, visualisation

• Spatial awareness

• Understanding images in 2d representing 3d

• Extracting information from visual images

• Science, D and T, Art, Geography……

and vice versa

Page 21: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Individual Pupil Record SULAIMAN BAHELMIDate Of Birth: 23/2/99 Student Number:Sex: M Form:

Band Stanine Percentile Standard Score

Vocabulary A 7 81 113

Maths B 6 66 106

Non-Verbal D 3 18 86

Skills B 6 68 107

MidYIS Score A 7 77 111

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Date Of Birth: Student Number:Sex: M Form: 7E

Band Stanine Percentile Standard Score

Vocabulary C 4 32 93

Maths C 4 34 94

Non-Verbal A 8 91 120

Skills C 4 28 91

MidYIS Score C 4 31 93

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Page 22: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

A relatively low skills score might indicate potential weaknesses such as:

• Speed of processing/working

• Potential underperformance in test/examination conditions

• Poor written work (SPG etc.)

and vice versa

Page 23: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Date Of Birth: Student Number:Sex: M Form: 7Y

Band Stanine Percentile Standard Score

Vocabulary A 9 99 134

Maths A 8 90 119

Non-Verbal A 7 85 116

Skills D 3 20 87

MidYIS Score A 9 98 130

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Proof Reading PSA

Sex: M Form:

Band Stanine Percentile Standard Score

Vocabulary C 5 50 100

Maths A 8 89 119

Non-Verbal B 5 54 102

Skills B 6 61 104

MidYIS Score B 6 72 109

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Proof Reading PSA101 B 83 D 83 D 114 A

Page 24: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

SEN use of MIDYIS test results

Analysis of baseline test individual skill profiles to indicate potential areas of learning difficulties

e.g. If the two lowest scores are the vocabulary and skills section and are, or close to being, statistically significant (see IPR)

• Then the student might be dyslexic.......

• Follow-up with appropriate diagnostic tests…..

Page 25: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

Individual Pupil Record LAUREN BAKERDate Of Birth: 28/11/99 Student Number: J870396003050Sex: F Form: 7C

Band Stanine Percentile Standard Score

Vocabulary C 4 27 91

Maths B 6 68 107

Non-Verbal B 6 75 110

Skills D 2 10 81

MidYIS Score C 5 45 98

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Natio

nally

Sta

ndar

dise

d Sc

ores

Nationally Standardised Scores with 95% Confidence Band

Page 26: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

INSIGHT Pupil IPR

Band Stanine Percentile Standard Score

KS3 Equivalent

Speed Reading B 6 69 107 6c

Text Comprehension B 5 60 104 5a

Passage Comprehension C 5 45 98 5b

Overall Reading B 5 59 103 5a

Number & Algebra D 3 19 87 4a

Handling Data B 6 61 104 6a

Space, Shape & Measures D 4 23 89 5c

Overall Mathematics C 4 31 93 5b

Biology A 7 82 114 6a

Chemistry A 9 96 127 7a

Physics A 8 89 118 7c

Overall Science A 8 93 122 7b

Vocabulary B 6 65 106

Non Verbal B 6 70 108

Skills A 8 92 121

Overall Ability C 4 36 94

Page 27: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

40

60

80

100

120

140

160

Spee

d R

eadi

ng

Text

Com

preh

ensi

on

Pass

age

Com

preh

ensi

on

Ove

rall

Rea

ding

Num

ber &

Alg

ebra

Han

dlin

g D

ata

Spac

e, S

hap

e &

Mea

sure

s

Ove

rall

Mat

hem

atic

s

Bio

logy

Ch

emis

try

Phys

ics

Ove

rall

Sci

ence

Voc

abul

ary

No

n Ve

rbal

Skill

s

Ove

rall

Abi

lity

Stan

dard

ised

Sco

res

Standardised Scores With 95% Confidence Band

Page 28: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…

N2a

c3bac

4bac

5bac

6bac

7bac

8ba

Spee

d R

eadi

ng

Text

Com

preh

ensi

on

Pass

age

Com

preh

ensi

on

Ove

rall

Rea

ding

Num

ber &

Alg

ebra

Han

dlin

g D

ata

Spac

e, S

hape

& M

easu

res

Ove

rall

Mat

hem

atic

s

Biol

ogy

Che

mis

try

Phys

ics

Ove

rall

Scie

nce

KS3

Leve

lKS3 Equivalent Levels with 95% Confidence Band

IPRs in KS3 Levels

NATIONAL AVERAGE

Page 29: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…
Page 30: Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data Course: CEM Information…