electronic management of assessment: challenges to solutions

19/11/2014 Electronic Management of Assessment: moving onElectronic management of assessment: challenges to solutions

22/01/2015

Lisa Gray, senior co-design manager, Jisc

Hello

Project team

» Lisa Gray, senior co-design manager, Jisc

» Gill Ferrell, consultant, Jisc EMA project

» Marianne Sheppard, account manager, Jisc

» Wilbert Kraan, assistant director, CETIS

» Heather Price, senior co-design manager, Jisc

» Alex Nisbett, project lead, Livework

» Marta Ferreira De Sa, service designer, Livework

3Introduction - Electronic Management of Assessment (EMA) project

Background and context

Recently completed – a 3 year programme exploring technology-enhanced assessment and feedback

4 main themes:

»Feedback and feed forward

»Enhancing student employability

»Strategies for change

»Electronic management of assessment (EMA)

Introduction - Electronic Management of Assessment (EMA) project 4

http://bit.ly/jisc-assess and http://bit.ly/jiscdsaf

http://bit.ly/jisc-assess

http://bit.ly/jiscdsaf

Background and context

»EMA - benefits and drivers are

clear

»Challenges surfacing relating to

process, practice and technology

»Working in collaboration with

the Heads of e-Learning Forum

(HeLF) and UCISA to maximise

the benefits technology can

offer in the management of

assessment


CC BY-NC-SA 2.0 ©comedynose via Flickr

Project overview


Phase 1March – July 2014

Landscape review providing initial identification of challenges and outline of the state of play with regards to EMA

Phase 2.1Oct –Aug 2015

Second phase of consultation, refining and prioritising challenges (speaking as a ‘single voice’)

Moving from challenges to solutions (Oct – Jan)

Solution development (Feb – July)

Phase 2.2Oct –Aug 2015

Ongoing development of resources for the ‘toolkit’ based on the assessment and feedback

Where are we now?

» Produced a review of the EMA

landscape across UK HE and FE.

Gathered examples of practices,

policies & process as well as

implementation approaches

»Identified and prioritised the

challenges around EMA, in terms

of pedagogy/culture, process and

technology

»In December we ran a workshop

to explore possible solutions to

these prioritised challenges


»Today – is about working these

ideas up into concrete, realistic

and detailed proposals

http://ema.jiscinvolve.org/

What’s next?

»Ideas will be shared publically for

comment and prioritisation

w/c 2 Feb

»These ideas will go forward for

discussion within Jisc and

decisions made on which to take

forward

»Advice and Guide Toolkit already

in train…


CC BY-NC-SA 2.0 ©comedynose via Flickr

Participants today - welcome

» Anglia Ruskin University

» University of Birmingham

» Birmingham City University

» Cardiff University

» Edge Hill University

» University of Gloucestershire

» University of Huddersfield

» University of Hull

» Institute of Education

» King’s College, London

» Royal Veterinary College

Title of presentation 00/00/2013 9

Universities

» University of Leicester

» University College London

» University of Manchester

» Manchester Metropolitan University

» University of Northampton

» The University of Nottingham

» Plymouth University

» Queen’s University, Belfast

» University of Salford

» Sheffield Hallam University

» University of Southampton

Participants today - welcome

» eAssignment

» Hedtek Ltd (Mark it Quickly)

» iParadigms (Turnitin)

» LiveText

» MyKnowledgeMap

» PebblePad (Atlas)

» TAG Assessment

» ULCC (Moodle and Mahara)

» CETIS, and the IMS Global Learning Consortium

Title of presentation 00/00/2013 10

Assessment system suppliers

»Not able to make today, but

continuing to engagement with:

› Blackboard

› Canvas (Joe Berry)

› Desire2Learn

› Questionark Perception

Project timeline

Challenges to solutions - Electronic Management of Assessment (EMA) project 12

Our objectives

»To share the solution areas developed in the first ‘imagine’ workshop and develop, validate and prioritise the propositions

» In collaboration with users, experts and suppliers to develop a clear picture of what these solution ideas look like at a sector level for decisions to be made in the next stage about whether or not they should proceed to development

»To better understand the implications of these developments for all stakeholders

»To identify potential supporters, owners and partners in the development of these solutions


The aim of today

Generate a detailed view on five potential solutions so that we can then prioritise.


Today’s schedule

» Project introduction

» Present solutions

» Solution validation

» Lunch 12.30 – 13.15

» Solution validation

» Playback

» Discussion / prioritise

» Summary & close 15.30

15Challenges to solutions - Electronic Management of Assessment (EMA) project

What we’re going to do

1. Present the solutions


3. Discuss and prioritise

2. Define and validate solutions

The solutions

The solutions


1. Specifying workflows

2. Feedback hub

3. Reliable submissions

4. Systems integration

5. Assessment and feedback toolkit


Team ASpecifying workflows

Simon Grundy

Jason Bell

Ian Barrett

Joel Mills

Anthony Lewis

James Trueman

Mira Vogel

Gill Ferrell

Team BFeedback hub

Richard Havinga

Joseph Berry

Calum Thompson

Duncan Greenhill

Emma Purnell

Chris Turnock

Lisa Gray

Team CReliable submissions

Stuart Blacklock

Stuart Hepplestone

Gill Kelly

Fran Morton

Peter Rayment

Justin Steele-Davis

Heather Price

Team DSystems integration

John Couperthwaite

Mark Van Harmelen

Adel Gordon

John Hill

Nigel Owen

Colin Smythe

Bill Warburton

Wilbert Kraan

Team EA+F toolkit

Steve Sidaway

Stefanie Anyadi

David Callaghan

Lynette Lall

Cheryl Reynolds

Alistair Spark

Marianne Sheppard

Introductions

Solution validation

How we’re going to validate

» In your teams, sequentially address your

solution with the questions

» Discuss, then capture on the cards

» This framework should catch everything

which is significant

» In addition, capture any new ideas or

observations on blanks


Seven questions to explore

1. Understand and critique

2. Develop and describe the solution

3. Define the key benefits

4. Define the risks

5. Who’s your development dream team?

6. Required resources

7. Implications for the service.


75 mins

Some guidelines

» Build upon your collective knowledge, together

» You’ll need a scribe, someone to capture your thoughts

» Keep responses clear, concise and understandable by anyone

» Answer all the questions!


Lunch, 45 mins

Seven questions to explore

1. Understand and critique

2. Develop and define the solution

3. Define the key benefits 5-10 min

4. Define the risks 5 min

5. Who’s your development dream team? 5 min

6. Required resources 5 min

7. Implications for the service 20 min


50 mins

Playback, vote and prioritise

Summary, next steps and close

Keeping in touch:

»Lisa Gray [email protected]

»Landscape report available from: bit.ly/jisc-ema

»Join the conversation on the blog: ema.jiscinvolve.org/

and on twitter #jiscassess

»Join the mailing list: www.jiscmail.ac.uk/tech-enhanced-assessment

»Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc-assess


mailto:[email protected]

http://bit.ly/jisc-ema

http://ema.jiscinvolve.org/

http://www.jiscmail.ac.uk/tech-enhanced-assessment

http://bit.ly/jisc-assess

Thank you

electronic management of assessment: challenges to solutions

Education

ema landscape

ema phase

technologyenhanced assessment

senior codesign manager

prioritising challenges

benefits technology

febthese ideas

ideas bucket