ACCESS TO SK ILLS – INTER IM

REPORT

30 / 05 / 2

012

A S C T RA I N I N G & D E V E L O P M E N T 1

COLLABORATIVE E-ASSESSMENTProject Manager: Tony Stone (ASC Training &

Development)

Project Team: Tony StoneMelanie Worrall (Efficacy

Consulting)Peter Oborn (ASC Training &

Development)Meredith Dufty (Pharmacy

Guild SA)

A S C T RA I N I N G & D E V E L O P M E N T 2

OVERVIEWThis project explores the role of peer assessment in determining a candidate’s competency in the context of nationally recognised training.

Unit of study:BSBWOR402A Promote team effectiveness

A S C T RA I N I N G & D E V E L O P M E N T 3

BACKGROUNDThe use of peer evaluation in VET meets road blocks when applied to summative (final) assessment decisions… due in part to:

• ASQA requirement in relation to assessor qualifications• Potential reluctance of course participants to

make negative judgements on peers• The need for rigorous processes that ensure

integrity of the assessment decision – makes it too hard?• Evidence guide requirements

A S C T RA I N I N G & D E V E L O P M E N T 4

PROJECT METHODOLOGYA target group of 11 Pharmacists were recruited with the assistance of the Pharmacy Guild (SA) to undertake the learning program

A S C T RA I N I N G & D E V E L O P M E N T 5

PROJECT METHODOLOGYA blended learning approach combining: 1 full day F2F workshop Online activities including

Discussion Forums (with uploading of documents)

Team SurveyAssessment tasks, one involving Peer Assessment using Moodle Workshop

A S C T RA I N I N G & D E V E L O P M E N T 6

PEER ASSESSMENT ACTIVITYTeam Improvement Project• Participants complete a Team Climate Survey online (Self and work team)• Identify area for improvement and develop Action Plan•Upload Action Plan in Moodle Workshop 1• Peers in Learner Group review and post comment, based on agreed criteria

A S C T RA I N I N G & D E V E L O P M E N T 7

PEER ASSESSMENT ACTIVITYTeam Improvement Project (Continued)• Projects implemented in workplaces• Project outcomes report posted (Moodle Workshop 2)• Final peer assessment against agreed criteria• Personal learnings posted in Forum•Assessor panel validation

A S C T RA I N I N G & D E V E L O P M E N T 8

PROJECT OUTCOMES TO DATE Design and trial of an online assessment

methodology that enables peer assessment to contribute to a valid summative assessment decision

Enhanced employability of participants in leadership roles

Development of skills in participants and RTO personnel in online learning and assessment methodologies

Improved work environment/team effectiveness in host pharmacies

A S C T RA I N I N G & D E V E L O P M E N T 9

TIMELINE OF EVENTS TO DATE Pharmacy Guild advertised opportunity

to participate in pilot to members in December 2011

ASC T&D held an information session for interested persons in early February 2012

The next 9 slides are an edited version of this information session...

A S C T RA I N I N G & D E V E L O P M E N T 10

WELCOME TO A UNIQUE LEARNING OPPORTUNITY...

You have been invited by the Pharmacy Guild SA to participate in a unique project funded through the national VET E-Learning Strategy , an initiative of the Commonwealth Government.

A S C T RA I N I N G & D E V E L O P M E N T 11

Pharmacy Information Session – 7 February 2012

OUR PROJECT: COLLABORATIVE E-ASSESSMENTThe project involves 3 levels of learning:

A S C T RA I N I N G & D E V E L O P M E N T 12

1.Team

Development Skills

2. Using Online Technology

3. Peer

Assessment

Pharmacy Information Session – 7 February 2012

1. TEAM DEVELOPMENT SKILLS The project will explore ways to work effectively

with a work team in the retail pharmacy environment

The content is based on a unit of competency from the Business Services Training Package:BSBWOR402A Promote team effectiveness

This is a unit from the qualification Certificate IV in Frontline Management

Pharmacy Information Session – 7 February 2012

2. USING ONLINE TECHNOLOGYWe use an online platform called Moodle. Moodle is used by many schools and universities in Australia and globally.

A S C T RA I N I N G & D E V E L O P M E N T 14

Pharmacy Information Session – 7 February 2012

A S C T RA I N I N G & D E V E L O P M E N T 15

ONLINE TOOLSOnce logged into our Moodle site, you can participate in:

• Discussion forums• Online activities relating to building effective teams• Moodle Workshop (a module to review each others work)• Document upload (reports, reflections, evaluations)

We will guide you through all these activities

A S C T RA I N I N G & D E V E L O P M E N T 16

Pharmacy Information Session – 7 February 2012

3. PEER ASSESSMENT In formal education learning is assessed

through tests, projects, assignments, etc.

The teacher or lecturer marks the work, making the final decision

Assessment of work by fellow classmates or participants is rarely used to make the ‘final decision’.

A S C T RA I N I N G & D E V E L O P M E N T 17

Pharmacy Information Session – 7 February 2012

PEER ASSESSMENT This project will guide you through the

steps to make judgements on the work of your colleagues

Your judgements combined with a review by a panel of assessors from the Project Team and the Pharmacy Guild will form the final assessment decision

All participants assessed as competent will receive a nationally recognised Statement of Attainment

A S C T RA I N I N G & D E V E L O P M E N T 18

Pharmacy Information Session – 7 February 2012

TIMELINE OF EVENTS TO DATE (CONTINUED)

A S C T RA I N I N G & D E V E L O P M E N T 19

Enrolments closed early March; 11 participants signed up

First online contact made to provide Moodle log in so participants could explore the site

Participants directed to Team Climate Survey (Google Docs) link and asked to complete themselves and have team members complete as well

TIMELINE OF EVENTS TO DATE (CONTINUED)

A S C T RA I N I N G & D E V E L O P M E N T 21

Second online contact made to introduce learners to Discussion Forum

Hi everyone. For this first forum topic, we would like you to write down 3 aspects of leading a team that you find challenging. keep answers brief; you can just list as dot points.

20 March 2012

TIMELINE OF EVENTS TO DATE (CONTINUED)

A S C T RA I N I N G & D E V E L O P M E N T 22

TIMELINE OF EVENTS TO DATE (CONTINUED)

A S C T RA I N I N G & D E V E L O P M E N T 23

Face-Face workshop held 23 March Teleconference for 2 participants based

in Gawler and Normanville Participants encouraged to continue

responding to new discussion topics as they are posted, and to create their own discussion forums

TIMELINE OF EVENTS TO DATE (CONTINUED) Participants select Team Improvement

Project based on survey results and develop Action Plan

Action Plans uploaded to Moodle Workshop 1

Learner Groups set up for peer comment on Action Plans (3 per Learner Group)

A S C T RA I N I N G & D E V E L O P M E N T 24

TIMELINE OF EVENTS TO DATE (CONTINUED) Implementation of Team Improvement

Projects in each participant’s pharmacy

Participants write Final Report and upload in Moodle Workshop 2

Peers in Learner Group assess Reports using assessment criteria provided by ASC T&D

Peer assessment results reviewed by ASC assessors and Pharmacy Guild assessor.

A S C T RA I N I N G & D E V E L O P M E N T 28

As at 30/05

CHALLENGES TO DATE

A S C T RA I N I N G & D E V E L O P M E N T 29

Attracting participants and keeping them motivated and on task

The group has reduced from 11 to 7 owing to:2 withdrew citing work pressure2 have moved pharmacy

Wide range of computer literacy amongst learners

CHALLENGES TO DATE

A S C T RA I N I N G & D E V E L O P M E N T 30

Technology glitches – e.g. Issues with iPad

Moodle Workshop ‘switching’ from one phase to the next, e.g. From Submission to Assessment PhaseAll participants must complete previous phase

Facilitators need to keep encouraging laggers to upload work.

BENEFITS TO DATE

A S C T RA I N I N G & D E V E L O P M E N T 31

Discussion Forums a big hit with participants – evidence of sharing of documents; some participants initiated discussion forums

Learners having a sense of connection with each other despite no other F2F after March 23 workshop

Formative assessment (comments on peer’s Action Plans) helped learners understand their own Action Plan strengths/deficits

Clarification of assessment criteria by virtue of being an ‘assessor’

BENEFITS TO DATE

A S C T RA I N I N G & D E V E L O P M E N T 32

Participants report noticeable results of team projectsImproved team moraleIncreased productivitySales increaseConfidence as leadersPraise from managers