nan yeld , robert prince and alan cliff 22 nd september
DESCRIPTION
"The National Benchmark Tests Project: what is it, what can it tell us, and in what ways does this information add to or challenge that provided by the National Senior Certificate? ". Nan Yeld , Robert Prince and Alan Cliff 22 nd September. Three measures. Numbers admitted in each category - PowerPoint PPT PresentationTRANSCRIPT
"The National Benchmark Tests Project: what is it, what can it tell us, and in what ways does this information add to or
challenge that provided by the National Senior Certificate?"
Nan Yeld, Robert Prince and Alan Cliff
22nd September
Three measures
• Numbers admitted in each category– Student profile in course (indication of need)
• Performance in each category– Probability of passing if in that category
• Odds – Probability of a pass over probability of a fail
MAM1010F NSC Maths vs NBT Maths Profile
MAM1010FAdmit 4 5 6 7 COM
Basic 0 0 2 8 10Intermediate Bottom 0 0 11 67 78Intermediate Top 0 0 9 155 164Proficient 0 0 0 66 66
0 0 22 296 318
NSC Mathematics Level
NBT
MAT
HS LE
VEL
MAM1010F NSC Maths vs NBT Maths Pass (at 50%) rate
MAM1010FPass rate 4 [0] 5 [0] 6 [22] 7 [296] COM
Basic [10] No Passes 0.3 20%Intermediate Bottom [78] 0.3 0.7 60%Intermediate Top [164] 0.9 0.8 83%Proficient [66] 0.9 94%
50% 80% 78%NBT
MAT
HS LE
VEL
NSC Mathematics Level
MAM1010F NSC Maths vs NBT Maths Pass/Fail (at 50%) ratio
MAM1010FPass/Fail 4 [0] 5 [0] 6 [22] 7 [296] COM
Basic [10] 0.0 0.3 0.3Intermediate Bottom [78] 0.4 1.9 1.5Intermediate Top [164] 8.0 4.7 4.9Proficient [66] 15.5 15.5
1.0 3.9 3.5NBT
MAT
HS LE
VEL
NSC Mathematics Level
MAM1010F NSC Maths vs NBT QLMAM1010F
Admit 4 5 6 7 COM
Basic 0 0 1 8 9Intermediate Bottom 0 0 1 26 27Intermediate Top 0 0 9 76 85Proficient 0 0 11 189 200
0 0 22 299 321
MAM1010FPass rate 4 [0] 5 [0] 6 [22] 7 [299] COM
Basic [9] No Passes 0.5 44%Intermediate Bottom [27] No Passes 0.7 67%Intermediate Top [85] 0.4 0.7 66%Proficient [200] 0.6 0.9 85%
50% 79% 77%
MAM1010FPass/Fail 4 [0] 5 [0] 6 [22] 7 [299] COM
Basic [9] 0.0 1.0 0.8Intermediate Bottom [27] 0.0 2.3 2.0Intermediate Top [85] 0.8 2.2 1.9Proficient [200] 1.8 6.3 5.7
1.0 3.8 3.4
NSC Mathematics Level
NBT
QL L
EVEL
NBT
QL L
EVEL
NBT
QL L
EVEL
NSC Mathematics Level
NSC Mathematics Level
MAM1010F NSC Maths vs NBT AL MAM1010F
Admit 4 5 6 7 COM
Basic 0 0 0 1 1Intermediate Bottom 0 0 0 7 7Intermediate Top 0 0 0 27 27Proficient 0 0 22 264 286
0 0 22 299 321
MAM1010FPass rate 4 [0] 5 [0] 6 [22] 7 [299] COM
Basic [1] 1.0 100%Intermediate Bottom [7] 0.9 86%Intermediate Top [27] 0.7 67%Proficient [286] 0.5 0.8 78%
50% 79% 77%
MAM1010FPass/Fail 4 [0] 5 [0] 6 [22] 7 [299] COM
Basic [1] No FailsIntermediate Bottom [7] 6.0 6.0Intermediate Top [27] 2.0 2.0Proficient [286] 1.0 4.1 3.5
1.0 3.8 3.4
NSC Mathematics Level
NBT
AL L
EVEL
N
BT A
L LEV
ELN
BT A
L LEV
EL
NSC Mathematics Level
NSC Mathematics Level
MAM1010F NSC Eng HL vs NBT Maths MAM1010F
Admit 4 5 6 7 COM
Basic 0 1 3 5 9Intermediate Bottom 0 12 30 31 73Intermediate Top 1 19 78 66 164Proficient 0 0 27 39 66
1 32 138 141 312
MAM1010FPass rate 4 [1] 5 [32] 6 [138] 7 [141] COM
Basic [9] No Passes No Passes 0.4 22%Intermediate Bottom [73] 0.8 0.6 0.5 59%Intermediate Top [164] 1.0 1.0 0.8 0.8 83%Proficient [66] 0.9 1.0 94%
100% 88% 75% 78% 78%
MAM1010FPass/Fail 4 [1] 5 [32] 6 [138] 7 [141] COM
Basic [9] 0.0 0.0 0.7 0.3Intermediate Bottom [73] 3.0 1.5 1.1 1.4Intermediate Top [164] No Fails No Fails 3.9 4.5 4.9Proficient [66] 8.0 38.0 15.5
7.0 3.1 3.5 3.5
NSC EngHomeLang Level
NBT
MAT
HS LE
VEL
NBT
MAT
HS LE
VEL
NBT
MAT
HS LE
VEL
NSC EngHomeLang Level
NSC EngHomeLang Level
MAM1010F NSC Eng HL vs NBT QLMAM1010F
Admit 4 5 6 7 COM
Basic 0 1 5 1 7Intermediate Bottom 0 7 8 8 23Intermediate Top 0 10 39 36 85Proficient 1 15 87 97 200
1 33 139 142 315
MAM1010FPass rate 4 [1] 5 [33] 6 [139] 7 [142] COM
Basic [7] 1.0 0.4 No Passes 43%Intermediate Bottom [23] 0.7 0.9 0.4 65%Intermediate Top [85] 0.9 0.6 0.7 66%Proficient [200] 1.0 0.9 0.9 0.8 85%
100% 85% 76% 77% 77%
MAM1010FPass/Fail 4 [1] 5 [33] 6 [139] 7 [142] COM
Basic [7] No Fails 0.7 0.0 0.8Intermediate Bottom [23] 2.5 7.0 0.6 1.9Intermediate Top [85] 9.0 1.3 2.3 1.9Proficient [200] No Fails 6.5 5.7 5.5 5.7
5.6 3.1 3.4 3.4
NSC EngHomeLang Level
NBT
QL L
EVEL
NBT
QL L
EVEL
NBT
QL L
EVEL
NSC EngHomeLang Level
NSC EngHomeLang Level
MAM1010F NSC Eng HL vs NBT AL MAM1010F
Admit 4 5 6 7 COM
Basic 0 0 1 0 1Intermediate Bottom 0 2 3 0 5Intermediate Top 0 5 12 8 25Proficient 1 26 123 134 284
1 33 139 142 315
MAM1010FPass rate 4 [1] 5 [33] 6 [139] 7 [142] COM
Basic [1] 1.0 100%Intermediate Bottom [5] 1.0 0.7 80%Intermediate Top [25] 1.0 0.6 0.6 68%Proficient [284] 1.0 0.8 0.8 0.8 78%
100% 85% 76% 77% 77%
MAM1010FPass/Fail 4 [1] 5 [33] 6 [139] 7 [142] COM
Basic [1] No FailsIntermediate Bottom [5] No Fails 2.0 4.0Intermediate Top [25] No Fails 1.4 1.7 2.1Proficient [284] No Fails 4.2 3.4 3.6 3.6
5.6 3.1 3.4 3.4
NSC EngHomeLang Level
NBT
AL L
EVEL
N
BT A
L LEV
ELN
BT A
L LEV
EL
NSC EngHomeLang Level
NSC EngHomeLang Level
ECO1010F NSC Maths vs NBT Maths Profile
ECO1010FAdmit 4 5 6 7 COM
Basic 0 1 4 9 14Intermediate Bottom 0 1 20 110 131Intermediate Top 0 0 16 235 251Proficient 0 0 0 135 135
0 2 40 489 531
NSC Mathematics Level
NBT
MAT
HS LE
VEL
ECO1010F NSC Maths vs NBT Maths Pass rate
ECO1010FPass rate 4 [0] 5 [2] 6 [40] 7 [489] COM
Basic [14] No Passes 1.0 0.7 71%Intermediate Bottom [131] 1.0 0.7 0.8 82%Intermediate Top [251] 0.9 0.9 94%Proficient [135] 1.0 99%
50% 80% 93% 92%NBT
MAT
HS LE
VEL
NSC Mathematics Level
ECO1010F NSC Maths vs NBT Maths Pass/Fail ratio
ECO1010FPass/Fail 4 [0] 5 [2] 6 [40] 7 [489] COM
Basic [14] 0.0 No Fails 2.0 2.5Intermediate Bottom [131] No Fails 2.3 5.5 4.7Intermediate Top [251] 7.0 15.8 14.7Proficient [135] 66.5 66.5
1.0 4.0 12.6 10.8NBT
MAT
HS LE
VEL
NSC Mathematics Level
ECO1010F NSC Maths vs NBT QLECO1010F
Admit 4 5 6 7 COM
Basic 0 0 2 14 16Intermediate Bottom 0 1 4 39 44Intermediate Top 0 1 17 118 136Proficient 0 0 17 320 337
0 2 40 491 533
ECO1010FPass rate 4 [0] 5 [2] 6 [40] 7 [491] COM
Basic [16] 1.0 1.0 100%Intermediate Bottom [44] No Passes 0.8 0.8 77%Intermediate Top [136] 1.0 0.6 0.8 82%Proficient [337] 1.0 1.0 96%
50% 80% 92% 91%
ECO1010FPass/Fail 4 [0] 5 [2] 6 [40] 7 [491] COM
Basic [16] No Fails No FailsIntermediate Bottom [44] 0.0 3.0 3.9 3.4Intermediate Top [136] No Fails 1.4 5.6 4.4Proficient [337] No Fails 23.6 24.9
1.0 4.0 11.6 10.1
NSC Mathematics Level
NBT
QL L
EVEL
NBT
QL L
EVEL
NBT
QL L
EVEL
NSC Mathematics Level
NSC Mathematics Level
ECO1010F NSC Maths vs NBT AL ECO1010F
Admit 4 5 6 7 COM
Basic 0 0 0 1 1Intermediate Bottom 0 0 1 11 12Intermediate Top 0 1 2 41 44Proficient 0 1 37 438 476
0 2 40 491 533
ECO1010FPass rate 4 [0] 5 [2] 6 [40] 7 [491] COM
Basic [1] 1.0 100%Intermediate Bottom [12] 1.0 0.9 92%Intermediate Top [44] No Passes 1.0 0.8 80%Proficient [476] 1.0 0.8 0.9 92%
50% 80% 92% 91%
ECO1010FPass/Fail 4 [0] 5 [2] 6 [40] 7 [491] COM
Basic [1] No FailsIntermediate Bottom [12] No Fails 10.0 11.0Intermediate Top [44] 0.0 No Fails 4.1 3.9Proficient [476] No Fails 3.6 13.6 11.5
1.0 4.0 11.6 10.1
NSC Mathematics Level
NBT
AL L
EVEL
N
BT A
L LEV
ELN
BT A
L LEV
EL
NSC Mathematics Level
NSC Mathematics Level
ECO1010F NSC Eng vs NBT MathsECO1010F
Admit 4 5 6 7 COM
Basic 0 2 5 4 11Intermediate Bottom 0 12 11 10 33Intermediate Top 1 16 63 53 133Proficient 1 24 129 177 331
2 54 208 244 508
ECO1010FPass rate 4 [2] 5 [54] 6 [208] 7 [244] COM
Basic [11] 1.0 1.0 1.0 100%Intermediate Bottom [33] 0.6 0.9 0.7 73%Intermediate Top [133] 1.0 0.9 0.8 0.8 81%Proficient [331] 1.0 1.0 0.9 1.0 96%
100% 85% 89% 93% 91%
ECO1010FPass/Fail 4 [2] 5 [54] 6 [208] 7 [244] COM
Basic [11] No Fails No Fails No FailsIntermediate Bottom [33] 1.4 10.0 2.3 2.7Intermediate Top [133] No Fails 7.0 3.5 4.9 4.3Proficient [331] No Fails 23.0 15.1 43.3 24.5
5.8 8.0 14.3 9.8
NSC EngHomeLang Level
NBT
QL L
EVEL
NBT
QL L
EVEL
NBT
QL L
EVEL
NSC EngHomeLang Level
NSC EngHomeLang Level
ECO1010F NSC Eng HL vs NBT QLECO1010F
Admit 4 5 6 7 COM
Basic 0 0 1 0 1Intermediate Bottom 0 2 3 2 7Intermediate Top 1 7 14 13 35Proficient 1 45 190 229 465
2 54 208 244 508
ECO1010FPass rate 4 [2] 5 [54] 6 [208] 7 [244] COM
Basic [1] 1.0 100%Intermediate Bottom [7] 1.0 1.0 0.5 86%Intermediate Top [35] 1.0 0.9 0.8 0.6 74%Proficient [465] 1.0 0.8 0.9 1.0 92%
100% 85% 89% 93% 91%
ECO1010FPass/Fail 4 [2] 5 [54] 6 [208] 7 [244] COM
Basic [1] No FailsIntermediate Bottom [7] No Fails No Fails 1.0 6.0Intermediate Top [35] No Fails 6.0 3.7 1.6 2.9Proficient [465] No Fails 5.4 8.5 21.9 11.6
5.8 8.0 14.3 9.8
NSC EngHomeLang Level
NBT
AL L
EVEL
N
BT A
L LEV
ELN
BT A
L LEV
EL
NSC EngHomeLang Level
NSC EngHomeLang Level
ECO1010F NSC Eng HL vs NBT AL ECO1010F
Admit 4 5 6 7 COM
Basic 0 2 2 8 12Intermediate Bottom 0 22 48 53 123Intermediate Top 1 26 114 100 241Proficient 1 3 42 83 129
2 53 206 244 505
ECO1010FPass rate 4 [2] 5 [53] 6 [206] 7 [244] COM
Basic [12] 0.5 1.0 0.6 67%Intermediate Bottom [123] 0.8 0.8 0.9 82%Intermediate Top [241] 1.0 1.0 0.9 1.0 93%Proficient [129] 1.0 1.0 1.0 1.0 98%
100% 87% 89% 94% 91%
ECO1010FPass/Fail 4 [2] 5 [53] 6 [206] 7 [244] COM
Basic [12] 1.0 No Fails 1.7 2.0Intermediate Bottom [123] 3.4 3.8 6.6 4.6Intermediate Top [241] No Fails 25.0 9.4 24.0 14.1Proficient [129] No Fails No Fails 20.0 No Fails 63.5
6.6 8.0 16.4 10.5
NSC EngHomeLang Level
NBT
MAT
HS LE
VEL
NBT
MAT
HS LE
VEL
NBT
MAT
HS LE
VEL
NSC EngHomeLang Level
NSC EngHomeLang Level
Prelim Observations
• Students with NSC Mathematics levels (esp. 7) have very variable performance in Quantitative (Science, Commerce, Engineering and Mathematics) courses at the first semester stage and the NBT Mathematics levels (Basic, Intermediate Bottom, Intermediate Top and Proficient) provide a nuanced gradation of this level.
Prelim Observations cnt.
• Students achieving a Proficient or Intermediate Top level on the NBT Mathematics test have very good prospects of achieving good performance (determined in various ways) in Mathematics first year courses.
Prelim Observations cnt.
• Analyses that look at NSC and NBT Maths for performance in key Science subjects (Chem, Phy, etc...) and Commerce subjects (Maths, Ecos, etc.. ) and Engineering (Maths, Mec, etc, ...) have similar patterns emerging.
Prelim Observations cnt.
• The analyses for QL and AL also provide valuable insights to nuance NSC performance.
• The analyses of the NSC and NBT results provide, in my opinion, real information for informing selection, placement and teaching and learning.
Faculty point vs NBT Math4 (<42); 5 (43 & 44); 6 (45 & 46); 7 (>47)
GPAAdmit 4 5 6 7 COM
Basic 28 6 6 9 49Intermediate Bottom 88 51 42 68 249Intermediate Top 22 35 71 176 304Proficient 1 3 12 125 141
139 95 131 378 743
GPAPass rate 4 [139] 5 [95] 6 [131] 7 [378] COM
Basic [49] 0.6 0.7 0.5 0.7 59%Intermediate Bottom [249]0.7 0.7 0.8 0.9 80%Intermediate Top [304]0.8 0.8 0.9 1.0 92%Proficient [141] No Passes 1.0 1.0 1.0 97%
71% 76% 89% 95% 87%
GPAPass/Fail 4 [139] 5 [95] 6 [131] 7 [378] COM
Basic [49] 1.3 2.0 1.0 2.0 1.5Intermediate Bottom [249]2.8 2.4 5.0 16.0 4.1Intermediate Top [304]4.5 4.8 13.2 21.0 12.2Proficient [141] 0.0 No Fails No Fails 40.7 34.3
2.5 3.1 7.7 20.0 6.7
Faculty Score
Faculty Score
NBT
MAT
HS LE
VEL
NBT
MAT
HS LE
VEL
Faculty Score
NBT
MAT
HS LE
VEL
Faculty point vs NBT QL4 (<42); 5 (43 & 44); 6 (45 & 46); 7 (>47)
GPAAdmit 4 5 6 7 COM
Basic 18 10 8 8 44Intermediate Bottom 55 20 17 26 118Intermediate Top 41 29 37 89 196Proficient 22 35 69 256 382
136 94 131 379 740
GPAPass rate 4 [136] 5 [94] 6 [131] 7 [379] COM
Basic [44] 0.7 0.6 0.9 0.8 73%Intermediate Bottom [118]0.7 0.7 0.8 0.8 72%Intermediate Top [196]0.8 0.7 0.8 0.9 83%Proficient [382] 0.6 0.9 1.0 1.0 95%
71% 74% 89% 95% 87%
GPAPass/Fail 4 [136] 5 [94] 6 [131] 7 [379] COM
Basic [44] 2.6 1.5 7.0 3.0 2.7Intermediate Bottom [118]2.1 2.3 4.7 3.3 2.6Intermediate Top [196]4.1 2.2 3.1 11.7 4.9Proficient [382] 1.4 6.0 33.5 84.3 19.1
2.4 2.9 7.7 20.1 6.6
Faculty Score
Faculty Score
NBT
QL L
EVEL
NBT
QL L
EVEL
Faculty Score
NBT
QL L
EVEL
Faculty point vs NBT QL4 (<42); 5 (43 & 44); 6 (45 & 46); 7 (>47)
GPAAdmit 4 5 6 7 COM
Basic 4 2 0 0 6Intermediate Bottom 10 4 5 10 29Intermediate Top 45 11 8 37 101Proficient 77 77 118 332 604
136 94 131 379 740
GPAPass rate 4 [136] 5 [94] 6 [131] 7 [379] COM
Basic [6] 0.5 1.0 67%Intermediate Bottom [29]0.7 0.3 1.0 1.0 79%Intermediate Top [101]0.7 0.8 0.6 0.8 74%Proficient [604] 0.7 0.8 0.9 1.0 90%
71% 74% 89% 95% 87%
GPAPass/Fail 4 [136] 5 [94] 6 [131] 7 [379] COM
Basic [6] 1.0 No Fails 2.0Intermediate Bottom [29]2.3 0.3 No Fails No Fails 3.8Intermediate Top [101]2.5 4.5 1.7 3.6 2.9Proficient [604] 2.5 3.1 8.8 32.2 8.6
2.4 2.9 7.7 20.1 6.6
Faculty Score
Faculty Score
NBT
AL L
EVEL
NBT
AL L
EVEL
Faculty Score
NBT
AL L
EVEL