transforming assessment and feedback with technology - jisc digifest 2016
TRANSCRIPT
Electronic management of assessmentLaunch of new suite of resources
The story so far….» 2011-2014: worked with over 30
institutions across a three year programme on assessment and feedback
» 2012: baseline reviews of institutional practice
» 2013: case studies, videos and briefings
» 2014: Electronic management of assessment (EMA) project with HELF and UCISA
» July 2014: initial landscape study into EMA published Summer 2014
03/03/2016
Electronic management of assessment 2
Assessment and feedback challenges
» Highly devolved responsibility and inconsistent practices
» Lack of developmental focus» Traditional practices dominate» Timeliness, quality and
consistency of feedback
» Learner in passive role» Lack of relevance to world of
work
03/03/2016
Electronic management of assessment 3
Electronic management of assessment 4
Electronic management of assessment
» Nuanced responses but broad trends visible
» Localised initiatives but beginning to scale up
» System integration is a key problem area
» EMA exposes variability in business processes
Challenges exposed“The use of technology is now a fundamental part of the support for assessment and feedback practice across the sector, but there are few examples of fully integrated approaches to supporting the whole assessment and feedback lifecycle”
Jisc, 2014
03/03/2016
Electronic management of assessment
» Limited range of core technologies
» Integration loose and requiring manual intervention
» More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’
Loose system integration » Lots of local variation
» Only 12% of HEIs have ‘highly standardised’ processes
» Different interpretations of policy» Variation hidden till EMA tried
Variation in business processes
03/03/2016
Electronic management of assessment 5
Assessment and feedback life-cycle
03/03/2016
Electronic management of assessment 6
03/03/2016
Electronic management of assessment 7
Electronic management of assessment 8
Moving to solutions» Workshops in Dec 2014 and Jan
2015 explored possible solutions to these prioritised challenges
» 1st workshop - resulted in 30 solution ideas
» Ideas were synthesised down into five main areas
» 2nd workshop - worked these up into three detailed project specifications
03/03/2016
Electronic management of assessment 9
Developing solutions1. Addressing the variation of
business processes and systems not meeting all needs (1,7, 12, 14)
2. Assessment literacies, assessment design, risk aversion (4, 6, 8, 9, 11, 15)
3. EMA systems integration (3)4. Lack of a
longitudinal/holistic view of student feedback; student engagement with feedback (10, 5)
5. Addressing issues with reliable submission (2)
1. Specifying the range of possible marking and moderation processes and surfacing how systems support them
2. Online toolkit sharing effective practice
3. IMS Global Consortium Assignment Task Force
4. Researching where Jisc can add value in the ‘feedback hub’ space
5. (Suppliers addressing these issues)
03/03/2016
Suite of resources
» New online guide ‘Transforming assessment and feedback with technology’ now available jisc.ac.uk/guides/transforming-assessment-and-feedback
» New accompanying online guide on EMA processes and system specification, including supplier responses to requirements (HE focus)› http://bit.ly/Jisc_EMA_guide
Now available» A self-assessment tool linking
through to the guidance › institution/departments/faculty
Coming soon
Electronic management of assessment 11
Embedded in the resources» EMA case studies and examples
› Queen’s University, Belfast› Institute of Education
(now part of UCL)› University of Hertfordshire› Manchester Metropolitan
University› Keele University› Bedford College› Walsall College › Sheffield University
» Supplier responses to EMA requirements
» Podcasts and videos› Benefits of EMA› Managing an EMA project › Assessment and feedback
lifecycle› Processes and systems› Value of Jisc resources› Employability and assessment› e-portfolios› Peer assessment› Reconceptualising feedback
03/03/2016
Electronic management of assessment 12
Find out more» Guide:
jisc.ac.uk/guides/transforming-assessment-and-feedback
» Baseline review: http://repository.jisc.ac.uk/5983/1/JISCAFBaselineReportMay2012.pdf
» Landscape report available from: bit.ly/jisc-ema
» Join the conversation on the blog: ema.jiscinvolve.org/
» and on twitter #jiscassess» Join the mailing list:
jiscmail.ac.uk/tech-enhanced-assessment
» Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc-assess
03/03/2016
jisc.ac.uk
To find out more
Contact
Lisa GraySenior Co-design [email protected]
03/03/2016
Electronic management of assessment 13