WebPA: The Evolution of a Peer Assessment System

Nicola WilkinsonSteve Loddington

WebPA Project, Loughborough University

The evolution

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

1998

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

The originates from the Wolfson School of Mechanical and Manufacturing Engineering

Issues were;•Cumbersome•Time consuming

2002

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

The Peer ASsessment System (PASS) undergoes the first series of improvements

2004

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

The EEC re -develop the PASS system

2005

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

Initial usage is slow,but then increases almostexponentially in the next3 years

2006

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

The WebPA project begins after getting funding through the e-Learning Capital JISC fund

Project consortia set-up

2007

Paper based system

Open source

version of WebPA

1998 20082007

WebPA made open to all at

Loughborough University

2005

WebPA project

20062002

PASS System

Re-write of PASS became WebPA

2004

The first open source version is released, followed by two further releases in 2008.

Early adopters of the system become known

Usage

• In over 56% of departments

• Just under 6,000 students

• From one academic tutor in 2005 to over 50 in 2008

Embedding

• Departmental and PD training sessions

• New Lecturers Route• Academic Practice

Award• Word of mouth• ‘One on one’ training

Open source

• Over 250 downloads• In over four intuitions in the

UK and one world wide

"WebPA is now embedded in our first year and will be for the next five years. Typically 180-200 students will be subjected to.. [WebPA] ..every year." Dr Bob Cherry

Manchester MetropolitanUniversity

Case Study

• 100 students in the 2nd year• Groups are made of 4 students, each with a

seeded student• Set real life problems in engineering, through the

“Loughborough Teaching Contract”• Standard assessment through reports and

presentations before the self and peer assessment.

Case Study

• The criteria used are set by the academic tutor

• Research shows that students are more truthful

Criteria Score range ILO’s

Rate each persons ability in searching for information

1 Made no effort beyond a simple internet key word search

3 Made an average contribution in this respect

5 Searched a wide variety of sources tenaciously and with success

Searching information using extended library techniques related to design solution

Ability to apply sound design methodology to concept evaluation

1 Played little or no real part in this element/ relied on gut feeling

3 Made an average contribution in this respect

5 Methodical logical, unbiased and thorough when deciding the merits of an idea

Design a system, component or process using routine design techniques

Demo

User views

Dr Carol RobinsonMathematics Education Centre

Loughborough University

“Students are much more satisfied – complaints have most disappeared.”

“Overall, marking is honest and credible” Dr Keith Pond

Business SchoolLoughborough University

User views

• 90% felt it was secure system

• 82% felt enough help information in WebPA was provided

User views

“Some of the best modules during my Engineering degree were group based modules. The combination of the team working and the peer assessment was a great introduction to working in a team within industry.”

Alan Curtis Research Engineer

JCB Power Systems Ltd

Continuing to evolve

• Received a International Learning Impact Award in May 2008

• A new release is expected in August 2008

• A growing user community is developing for the UK

Questions