peer assessment in moodle - leona norris, alison sands, helen young, caroline mcnabb

23
Academic excellence for business and the professions Peer Assessment Leona Norris Senior Educational Technologist, Learning Enhancement and Development (LEaD)

Upload: ireland-uk-moodlemoot-2012

Post on 22-May-2015

316 views

Category:

Presentations & Public Speaking


0 download

DESCRIPTION

Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb Presented at Moodlemoot Edinburgh 2014 www.moodlemoot.ie/

TRANSCRIPT

Page 1: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Academic excellence for business and the professions

Peer Assessment

Leona NorrisSenior Educational Technologist,

Learning Enhancement and Development (LEaD)

Page 2: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Group work can be one of the most rewarding, but also most problematic tools for teaching and learning; it demands substantial organisational resource and is often cited by students as a point of difficulty with the risk of collaborators being slow, difficult or even entirely absent. Mechanisms such as peer assessment, where students rate each other on their contribution to group work, are therefore essential for students to truly benefit and ensure that group work and marks are fair and transparent. In this way students get real value out of group work, reflecting on their contribution and ways of working together, and staff are able to get a real sense of the groups' dynamics and their impact on work submitted.

For Cass Business School, previous peer assessment support meant using a variety of complicated and time consuming processes cobbled together, with room for error and very demanding in terms of resource. With the decommissioning of one of the key systems used, finding a new way to run this part of group work became essential, and the Peer assessment tool was therefore developed as a plugin for Moodle at the School’s request. We have started using this tool already, but feel that this newly developed functionality could provide substantial benefits to other institutions, giving students a more positive experience of group work without being prohibitively difficult in terms of administration. We therefore look forward to further review and evaluation to feed into the next round of improvements, as well as seeking to share the tool itself and any other experiences.

Page 3: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

The Peer Assessment activity is a group assignment submission combined with peer grading.

For this activity, peer grading refers to the ability for students to assess the performance/contribution of their peer group, and if enabled, themselves, in relation to a group task. The group task is the file(s) submission component of the activity. The peer grading consists of a grade out of five and written comments on each student's performance.

Final overall grades for each individual student are then calculated from the differential of their individual and group peer grade averages, multiplied by five, and then added to or subtracted from the overall group submission grade (out of 100).

Page 4: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

• Working as part of a team is an integral part of the role for many careers• Learning skills to support successful team working and build successful interpersonal

relationships important part• Peer review strategy for some modules across the Specialist Masters programme• Students are asked to grade their fellow group members’ and comment on their performance• Warned to think carefully about the grades and comments given - ensure they are truthful and

constructive - reviewed by lecturers

• In the student's interest to engage fully in all group work• If don’t contribute effectively your peers may mark you down - potential to significantly affect

your coursework grade• Complete lack of attendance or input could lead to failure in coursework component - need to

retake• To ensure student’s feel comfortable grading honestly, peer assessment grades are confidential

- unless the students wish to discuss amongst themselves

Page 5: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

1Students

2Academic

3Peer Assessment

Activity

How it works

Page 6: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student Group Group

coursework

Student APeer grades &

comments

Student BPeer grades &

comments

Student CPeer grades &

comments

Student DPeer grades &

comments

Students

DEA

DLI

NE

1. Student submission

Page 7: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student submission

1. Submit assignment(group submission)

2. For each group member, choose Peer Grade and give

Feedback

Page 8: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Students also feedback on their peers’ input into the assignment

How student’s grade their peers

0 3 5

• No attendance at meetings. • No engagement in the project. • Does not complete assigned tasks. • No input into the assignment.

NB. Any students not engaging in group assignment are to be reported to the module leader

• Attends all meetings and engages enthusiastically.

• Well organised and motivated. • Able to negotiate with and motivate

others. • Contributes effectively and shows

creativity and initiative. • Significant and valuable input into

the assignment.

Page 9: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Grading criteria

Attendance at meetings, carrying out designated tasks, dealing with problems.

Effectiveness in meetings, negotiation with the group, communication between meetings, providing feedback.

Skills in self organisation, ability to organise others, planning, setting targets, keeping to deadlines.

Motivation, creativity, initiative during the project.

Contribution to meetings, clarity of the work submitted, objective quality of the work submitted.

Anything above and beyond the expected contribution that really improved the project and was outstanding in terms of creativity, quality, and/or work load.

Co-operation

Communication

Organisation

Enthusiasm

Actual contribution

Remarkable achievement

Students not grading the academic content but input to the project as a whole

Page 10: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Submission summary

3. Check summary and save

Who hasn’t submitted

Peer grade and feedback summary

4. Summary and ability to edit submission (before the

deadline)

Page 11: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student Group Group

coursework

Student APeer grades &

comments

Student BPeer grades &

comments

Student CPeer grades &

comments

Student DPeer grades &

comments

Students

DEA

DLI

NE

Deadline passes

Page 12: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student A’sPeer Grade Avg

Peer grade average calculation

Student B’sPeer Grade

Student C’sPeer Grade

Student D’sPeer Grade

Number of Student A’s Peer Grades

GroupPeer Grade Avg

Student B’sPeer Grades

Total

Student C’sPeer Grade

Total

Student D’sPeer Grade

Total

Student A’sPeer Grades

Total

Number of Peer Grades

Page 13: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Individual and group averages

Student’s Peer Grade Average

Group Peer Grade Average

Page 14: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student Group Group

coursework

Student APeer grades &

comments

Student BPeer grades &

comments

Student CPeer grades &

comments

Student DPeer grades &

comments

Academic Grade group coursework

Students Academic

DEA

DLI

NE

2. Academic grading

Page 15: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Group coursework grade

3. Add coursework grade and feedback

2. View students’ peer grades with averages and

feedback

1. Choose group to grade

Page 16: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student Group Group

coursework

Student APeer grades &

comments

Student BPeer grades &

comments

Student CPeer grades &

comments

Student DPeer grades &

comments

Academic Grade group coursework

PA ActivityCalculates

Student A grade

PA ActivityCalculates

Student B grade

PA ActivityCalculates

Student C grade

PA ActivityCalculates

Student D grade

Students Academic PA Activity

DEA

DLI

NE

3. Calculate final peer grade

Page 17: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Student A’sPeer Grade Avg

Student A’sCoursework Grade

Reduces

GroupPeer Grade Avg

Student A’sPeer Grade Avg

Student A’sCoursework Grade

Increases

GroupPeer Grade Avg

Student A’sPeer Grade Avg

Student A’sCoursework Grade

GroupPeer Grade Avg

Final peer grade calculation

Page 18: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Final grades

Students’ peer grades, individual average peer grade and feedback

Group average peer grade

Calculated grades

Group coursework grade

Page 19: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Export group grades to CSV

Ability to export individual group’s grades

Page 20: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Other supporting processes

1. Resolve within the group

2. Can’t resolve – Module Leader or Course Director

3. Remains unresolved –Peer Assessment Review

Panel

ModerationGrades and comments are reviewed and moderated to ensure fairness.

Peer Assessment Review Panels can also be requested by lecturers if grading is out of line with the norm as part of the moderation process.

Dealing with group problems

Page 21: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Feedback from staff and students

Page 22: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Future improvements

Page 23: Peer assessment in Moodle - Leona Norris, Alison Sands, Helen Young, Caroline McNabb

Questions