PAVING THE WAY FOR E-ASSESSMENTS

RAVI CHANDRAN & JEFFERY TAY

NATIONAL UNIVERSITY OF SINGAPORE

DIGITAL REVOLUTION• Laptops got smaller and lighter

• Mobile computing

DIGITAL REVOLUTION• Connectivity

• 28.8K 2G 3G 4G

• Wireless B A G N C

THE ALWAYS CONNECTED STUDENT

THE ALWAYS CONNECTED STUDENT• What they do not do quite so much

• Write

• Think in black and white

• Who are they

• NEEDS their personal device and connectivity

• Wiling to try new technology

• Acclimate to technology easily

• Almost everything they do has an electronic footprint

• Typing

• Learning

• Socializing

• Planning/Scheduling

• …

ADOPTION OF CBT IN SCHOOLSFreie Universität Berlin

Num

ber o

f stu

dent

s

2006/2007

2007/2008

2008/2009

2009/2010

2010/2011

2011/2012

2012/2013

2013/2014

2014/2015

2015/2016

0

50

100

150

200

250

CA Final Series3

National University of Singapore

Num

ber o

f ass

essm

ents

ADOPTION IN NUS – TOTAL USE BY TYPE (10 YEARS)

1. Reduction in human errors1. Remove answer ambiguity2. Remove human to system issues3. Reduce logistical issues

2. Immediate release of marks

3. Track students’ progress during semester and remediate where necessary

4. Simplicity, stability and user support are critical success factors for adoption

2006/2007

2007/2008

2008/2009

2009/2010

2010/2011

2011/2012

2012/2013

2013/2014

2014/2015

2015/20160

50

100

150

200

250

CA Final Series3

As of 5 Nov 2015

ADOPTION IN NUS – TOTAL USE BY TYPE (2015) Tiered adoption implemented in NUS to ensure

adoption moves at the right pace per faculty

3 4 5 6 7 8 9 10 112015

0

10

20

30

40

50

60

70

80

90

100

QuizExam

As of 5 Nov 2015

projection

Faculty Learning Partial Adoption

Full Adoption

Arts

Business

Dentistry

Design and Environment

Engineering

Law

Medicine

Nursing

Public Health

Science

PHYSICAL ENVIRONMENT• Move from PC Cluster to BYOD Unlimited scaling

• Facility redesign• Dedicated electrical point per student

• More locations in each faculty to conduct e-assessments

PEOPLE• Clearly define the goals, be realistic!

• Start small (non high-stakes!) and slowly scale up

• WIIFT (What’s in it for them?)

• Motivation and delegate control

• Treat them as your friend, not as a test subject

CHANGE MANAGEMENT• Introduce technology

• Mobile computing – tablets and touch screen

• Training and support

• FIRST impression must be good.

VARIETY OF VENDORS

BENEFITS OF CBT

Store questions securely so that they can be

reused in future

Question Bank Secure

Ensures device is secure for high stakes exams

Item Analysis

Accurately measure validity and difficulty of

question and answer choices

Student Reporting

Help students understand their

strength & weakness

Learning Outcome Reporting

Useful for accreditation, curriculum reform, and

to decrease fall out rates.

Grading Exams

Automatically grade exams and provide

feedback to students on their performance in

real-time

Blueprint Exams

Ensures faculty are testing students on

appropriate or proper concepts

Longitudinal Data

Track learning objectives and student progression over of the course of a semester, year, or any

timeframe

Rubrics

Ease of marking and greater transparency

during marking

“Cloud”

Centralized platform for ease of access

WHERE DO YOU GO FROM HERE?• Technology doesn’t rest, whats next?

Multiple form factors

Machine learning / Predictive

Remote proctoring