![Page 1: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/1.jpg)
TouchStone
Dr Simon WilkinsonMedical Education UnitUniversity of Nottingham Medical School
‘a local system for local people’
![Page 2: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/2.jpg)
TouchStone
• Assessment Management System– Computer-Based Assessments– Offline assessment support– Surveys/Questionnaires
• Development started 2002
• Licensed to University of Sheffield 2003
• QABME 2009 – innovation/good practice“Touchstone as a resource for blueprinting, standard
setting, receiving external examiners’ comments on examination questions, performing post examination analysis and especially the potential to provide detailed feedback on examination performance to students.”
![Page 3: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/3.jpg)
Why?
Assessment• Are students fit for purpose (GMC)
Quality Assurance• Are assessments fit for purpose
– Peer/External Examiners– Blueprinting– Post-exam item analysis
• Enhanced Annual Review (EAR)
Purpose
![Page 4: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/4.jpg)
How?
Reduce Costs• Reducing time – supporting process in software
• Peer/External examiner review• Standards Setting• Blueprinting• Item Analysis
Purpose
Process
![Page 5: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/5.jpg)
Who?
Purpose
People• Staff – Academic• Staff – Administrative• Staff – Technical• Students
Process
People
![Page 6: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/6.jpg)
Result
Purpose
Process
People
Performance
![Page 7: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/7.jpg)
e-Assessment – Lifecycle
Pre- Exam
Mid- Exam
Post- Exam
• Question writing• Blueprinting• Internal peer review• External Examiner review• Standards Setting
• Questions presented• Answers recorded
• Analysis of performance• Fix incorrect answers• Exclude poor questions• Export marks• Personalised student
feedback
Ref
ine
Item
s
![Page 8: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/8.jpg)
External Examiner Comments
• UoN Requirement – external examiners given access to assessments
![Page 9: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/9.jpg)
Standards Setting – Ebel• GMC Requirement – all knowledge exams standard set
![Page 10: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/10.jpg)
Learning Objectives – the ‘glue’
VLE• Networked Learning
Environment
e-Assessment• TouchStone
e-Portfolio• Insight
LearningObjectives
Personal reflection Progression/Certification
e-Teaching/e-Learning
![Page 11: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/11.jpg)
Blueprinting - sampling• GMC Requirement – all knowledge exams blueprinted
![Page 12: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/12.jpg)
Individual student feedback
![Page 13: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/13.jpg)
Item Analysis – Question Exclusion• Good practice – educational literature
![Page 14: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/14.jpg)
Performance – AcademicPurpose
Process
People
Blueprinting• Sampling• Individual Feedback
Media-rich assessments• Widening learning objectives tested• Assess higher levels of cognitive engagement
Electronic-only question possibilities• Drag and drop labelling• Image Hotspots• Videos• Widening learning styles & objectives tested
![Page 15: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/15.jpg)
Performance – EconomicPurpose
Process
People
Staff - Academic• paper reviews (peer & external examiners)• standards setting – creates pass mark automatically• blueprinting – learning objective sampling• track-changes (automatic)• archiving (automatic)
Staff - Administrative• Paper printing time/costs• Marking/scanning time• Timetabling/room booking
![Page 16: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/16.jpg)
Performance – EconomicPurpose
Process
People
Students• 24/7 access to formative assessments• Personalised feedback on exams• Personal accessibility settings (where needed)
![Page 17: TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’](https://reader035.vdocuments.site/reader035/viewer/2022062516/56649d635503460f94a461f8/html5/thumbnails/17.jpg)
Performance – EconomicsPurpose
Process
People
JISC 2008:
“Assuming the student body in these areas [health and business studies] sat one e-assessed exam per year this alone would represent a cost saving of c. £7 million in staff time.”