amee2013 eportfolio workshop - ucl, brighton and sussex, bristol
DESCRIPTION
A workshop on using an electronic portfolio for undergraduate medical students: lessons learnt from three UK medical schools. A workshop led by undergraduate students and faculty.TRANSCRIPT
![Page 1: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/1.jpg)
Use of an electronic ePortfolio for undergraduate medical students: lessons learnt from three UK medical schools
![Page 2: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/2.jpg)
The UMeP Collaboration
![Page 3: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/3.jpg)
![Page 4: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/4.jpg)
ePortfolios
![Page 5: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/5.jpg)
![Page 6: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/6.jpg)
“a purposeful assembly of a collection of evidence of student learning and achievement in selected domains, with an element of intellectual engagement by the student with the portfolio content and associated learning.”
![Page 7: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/7.jpg)
Purposes of portfolios
Helen C Barrett PhD http://electronicportfolios.org/balance/
![Page 8: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/8.jpg)
OVER TO YOUTime for some group discussions
![Page 9: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/9.jpg)
![Page 10: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/10.jpg)
AMEEWorkshop on undergraduate e-portfolios Prague 2013
Pascale Avery, Reeanne Jones, Kathleen Meyer, Jennifer Schamotta
Year 5 medical students
![Page 11: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/11.jpg)
At BSMS• Introduced into first clinical year (Year 3)
– Voluntary
– Used by medical students, and Clinical Academic Tutors (CATs)
• User guides, tutorials, student advocates, junior doctor
session
• Training for Clinical Academic Tutors (30)
• Formative use– Use of self appraisal form
– Use of personal development plan
– Use of personal library
– Meetings with Clinical Academic Tutor (CAT)
– Use of the reflective/educational logs
![Page 12: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/12.jpg)
Research• Objective:• To explore its acceptability and impact of the
e-portfolio on students at BSMS, and to identify the drivers and barriers to its use
• Methodology - Mixed Methods approach :• Paper based questionnaire• Focus groups with advocates• Thematic analysis of qualitative data
![Page 13: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/13.jpg)
BSMS data: Year 3 (2011-13)
• Participants n: 209 • (76% response rate)
• Students using the e-portfolio (%)
60
40YesNo
![Page 14: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/14.jpg)
• Sections used by students
BSMS data: Year 3 (2012/13)
CAT PDP Reflective logs Personal library0
102030405060708090
100
Sections of the e-portfolio
Stu
dent
use
(%
)
![Page 15: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/15.jpg)
Thematic analysis of data
• Acceptability of use• Practical issues - “I can't remember my username or
password• Time pressures - “we already have a huge workload”• “It is difficult to find time to use it” • “It’s overshadowed by the multitude of marked
assessment we have in Year 3”• Confidentiality “I don’t know who can access this
portfolio”• Non – Compulsory “maybe a compulsory element
would encourage and get the most out of the portfolio”
![Page 16: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/16.jpg)
Thematic analysis of data
• Role modeling important• “having junior doctors describing what they put in their
eportfolio and why it has been helpful”• “make CATs encourage us to use it”
• Understanding the purpose of a portfolio• “provide more examples of what goes on the
eportfolio” • “could be checked by CAT”• Tell us what it is exactly we need to be writing about”• “I don’t know what I should be using it for” • “people have become doctors for years without it, why
the big fuss now?”
![Page 17: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/17.jpg)
Reflective practice
• Unsure, not confident or motivated to ‘reflect’ • examples requested• concerns of privacy or negative consequences• “I am not particularly certain… what we are supposed to
reflect on”
• The format: not at ease with written reflection• “reflection should take any form, not necessarily written”
• Students may feel reflective practice is not relevant to them
![Page 18: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/18.jpg)
Personal Opinions
• “Perhaps a true limitation is that at our stage, we may not understand the benefit of using the eportfolio early in our careers. I believe this will become more apparent when we are Foundation doctors.”
• “Using the eportfolio may be perceived as another thing to do – this makes many students reluctant to do in their free time. To overcome this, the portfolio should be made compulsory as many believe it is useful but lack the direction/understanding to complete it on their own”
![Page 19: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/19.jpg)
Personal Opinions
• “I can relate to the comments given about the portfolio being at the bottom of the one’s ‘to do list’, especially in 3rd year. I think the portfolio would become a higher priority for us if it was used to record completion of skills and other assessments, as well as providing us with a lasting and visual record.”
![Page 20: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/20.jpg)
Personal Opinions
• “Medicine seems to have a confusing conflict: teaching us values of being professional, competent, accountable and self directive, However, this manifests in a culture where we feel unable to express any weakness. Yet ability to do this is vital for effective reflection and personal development (a task required of us). For portfolios to be a success and at their most useful I feel an entire cultural change would be required.”
![Page 21: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/21.jpg)
Personal Opinions
• “In order to use the undergraduate e-portfolio as a helpful transition mechanism into foundation years, compulsory use for clinical skills assessments and meetings would be highly beneficial”
• “The ability to demonstrate written reflective practice is of growing importance to professional development. However concerns over internet privacy may prevent me recording personal thoughts – I prefer to naturally reflect on events and talk to others (without putting ‘pen to paper’)”
![Page 22: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/22.jpg)
UMeP as the Foundation for Academic Mentoring
Megan Lloyd (Year 4)Anna Taylor (Intercalating)University of Bristol Medical School
![Page 23: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/23.jpg)
What is an Academic Mentor?
• Practicing clinician • Concerned with the student’s academic life, not
their personal life• Available to meet twice a year, preferably on a one
to one basis
![Page 24: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/24.jpg)
During the meetings …
• Academic progress– Exam success– Possibility of intercalation – Other queries
• E-portfolio progress – Discuss any updates – Ensure it meets the targets
• Photo• Exam upload• CAPS logbook upload
• Career thinking• Professionalism
![Page 25: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/25.jpg)
How do we feel about our Academic Mentor as students?
• Personal• Contact links • Knowledge for the future • Confidence booster
![Page 26: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/26.jpg)
Our experiences
![Page 27: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/27.jpg)
Thank you
![Page 28: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/28.jpg)
CAPS LogbookDuncan Brown (Year 4)
Tom Lloyd (Year 5)
University of Bristol Medical School
![Page 29: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/29.jpg)
What is CAPS?
• Consultation And Procedural Skills• Introduced to Bristol in 2012• Written record & proof of competence in procedural
skills; GMC requirement by the time of graduation• 32 procedural skills grouped in the following
categories:1. Diagnostic
2. Therapeutic
3. General Procedures
![Page 30: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/30.jpg)
![Page 31: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/31.jpg)
![Page 32: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/32.jpg)
![Page 33: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/33.jpg)
![Page 34: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/34.jpg)
Why use CAPS Logbook?
• An aid to learning – provides learning objectives• Help with procedures• Guide & encouragement for practical examination
skills• Compulsory progression through medical school• Skills learning are a GMC requirement
![Page 35: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/35.jpg)
CAPS Feedback
• Survey of the student body regarding the introduction of CAPS Logbook
• Recurring themes identified-aids practical skill learning
-re-enforces importance of practical skill learning
-inter-professional interactions & learning from MDT
-personal record of progress
-documentation and reference for practical skills
• Overall, scheme welcomed
![Page 36: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/36.jpg)
Thank you
Any questions?
![Page 37: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/37.jpg)
The UCL experience
Focus groups with students from pilot year (2011-12)
![Page 38: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/38.jpg)
Students’ perception of intended purpose
Feedback
Minimum standards
Monitoring progress
Logbook/record
![Page 39: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/39.jpg)
Students’ perception of intended purpose
I think the idea is that it helps you get feedback on your progress ... I
really don’t think it does.Feedback
Minimum standards
Monitoring progress
Logbook/record
![Page 40: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/40.jpg)
Students’ perception of intended purpose
I think most of the time most people are doing fine, so they don’t really help ... but they
might flag up if you weren’t doing fine.
Feedback
Minimum standards
Monitoring progress
Logbook/record
![Page 41: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/41.jpg)
Students’ perception of intended purpose
Feedback
Minimum standards
Monitoring progress
Logbook/record We go round so many
departments, it’s hard to have a
central [overview]... It’s a
good way of keeping track of
what we’re doing.
![Page 42: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/42.jpg)
Students’ perception of intended purpose
Feedback
Minimum standards
Monitoring progress
Logbook/record
To sort of correlate everything
together in one place for easy
access later on... records of
practicals that you do.
![Page 43: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/43.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
![Page 44: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/44.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
Because this one is I guess more clinics-focused
and you have to get it done by
clinicians, I do feel it keeps you on your toes a bit
more...
![Page 45: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/45.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
Because this one is I guess more clinics focussed and you have to
get it done by clinicians, I do feel
it keeps you on your toes a bit
more...
And if they’ve had two supervised
examinations and two history presentations .. it’s good, because in the process they’ve
done that and had the practice.
![Page 46: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/46.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
I think at first a lot of students just thought this
is something that the med school is doing .. once you actually start
speaking to junior doctors and you hear that this is what they’re doing, [it]… it does make you feel ...
it’s not kind of a lost cause.
![Page 47: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/47.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
I think the good thing to be said about us having the ePortfolio, talking to other people from other
med schools ... you have it when you’re a junior doctor and probably
forever, so at least we get used to it now... when we actually qualify it’s not this other new thing we have to get our heads
around.
![Page 48: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/48.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
Although some might argue that it’s just... a
paper pushing exercise... to show that
you have been attending things.
![Page 49: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/49.jpg)
Students’ perception of actual purpose
Tick-boxSelf-
monitoring
Way of lifePractice clinical skills
...they can’t be bothered typing you know more than a few words really in their
evaluation there. So I think the idea that it helps you get
feedback on your progress... I don’t really
think it does.
![Page 50: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/50.jpg)
Actions
Students
• Information for students
Staff
•Training for assessors
Process
•Number of assessments
Ethos
•Hearts and minds mission
![Page 51: AMEE2013 ePortfolio workshop - UCL, Brighton and Sussex, Bristol](https://reader035.vdocuments.site/reader035/viewer/2022062615/54827cebb4af9f30608b4625/html5/thumbnails/51.jpg)
Thank you