Asynchronous testing- question banks

BS1010/1011 n = 257 (+) BS2060 n = 145 (+)

Need:

• Efficient use of staff time

• Rapid feedback / formative

• Maintain integrity of assessment?

alan.cann@le.ac.uk

How?

• MCQs with extended matching(Cann, A.J. (2005) Extended matching sets questions for online numeracy assessments: a case study. Assessment & Evaluation in Higher Education 30(6): 633-640)

• Question pools (3-5 per pool)

• Test randomization: 12 questions x pools of 4

= 12! * 412 = 8x1015 combinations (sort of ;-)

• Feedback with answer (graduated)

alan.cann@le.ac.uk

alan.cann@le.ac.uk

Example 1 (BS1010)

alan.cann@le.ac.uk

Example 2 (BS1011)

alan.cann@le.ac.uk

Example 3 (BS2060)

alan.cann@le.ac.uk

Downsides

• Bb randomisation

• No stats on question performance from pools

• Generating large numbers of high quality questions!

• And ?

alan.cann@le.ac.uk

Student-generated questions?

alan.cann@le.ac.uk

Feedback

• Bb quizzes generally have high student acceptability

alan.cann@le.ac.uk

What I’d like to change

• Get students to attend face to face help sessions!

alan.cann@le.ac.uk