best evidence medical education
TRANSCRIPT
![Page 1: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/1.jpg)
Best Evidence Medical Education
Hani AlmoallimMBBS, ABIM, FRCPC, FRCPC (Rheum), DipMedEdAssistant Professor, UQUConsultant IM & RheumatologyDiploma in Med Ed – Dundee, Scotland Fellowship in Med Ed – UBC, CanadaHead of Medical Ed Committee - UQU
![Page 2: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/2.jpg)
Objectives
Two major objectives:
To judge the actions that we do as teachers and learners.
To apply the evidence where it is available and relevant.
![Page 3: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/3.jpg)
Teachers should use research to enhance their teaching practice.
![Page 4: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/4.jpg)
Outline
What is BEME? The QUESTS model.
Applications: Teaching EBM. How can we conduct journal clubs? Medical grand rounds.
![Page 5: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/5.jpg)
Tell me and I Tell me and I FORGETFORGET
Teach me and I Teach me and I REMEMBERREMEMBER
Involve me then I Involve me then I LEARNLEARN..
![Page 6: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/6.jpg)
Exercise
![Page 7: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/7.jpg)
Exercise
True or False: Most health care professions are not aware that
there is literature on education.
We do the things we do because that is the way we have been raised ourselves.
Any change or challenge to one’s convictions is an actual challenge to one’s professional integrity.
![Page 8: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/8.jpg)
What is BEME?
It is the implementation, by teachers in their practice, of methods and approaches to education based on the best evidence available. (Harden et al, Medical Teacher 1999, 21(6))
![Page 9: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/9.jpg)
Opinion-based
teaching
Evidence-based
teachingOR
![Page 10: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/10.jpg)
Opinion-based
teaching
Evidence-based
teaching
![Page 11: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/11.jpg)
Do we need it?
“ The evidence base is as important in educating new doctors as it is in assessing a new chemotherapy ” (Harden 1998, Hart 1999, Peterson 1999
in Medical Teacher & BMJ)
![Page 12: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/12.jpg)
Education Trained Doctor
Improved performance
Improved health care
Problems with educational research
![Page 13: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/13.jpg)
A family wants to purchase a tree
Literature
Books
BEME: the simple truth, Harden et al, Medical Teacher, 2000 (22)
What went wrong?
![Page 14: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/14.jpg)
How to grade the evidence? The QUESTS model:
1. Quality How good is the evidence. Is it based on professional judgment,
educational principles, case studies, cohort studies, RCT.
The method itself does not guarantee the quality.
![Page 15: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/15.jpg)
How to grade the evidence? The QUESTS model:
2. Utility: To what extent can the method be
transferred and adopted without modification.
Lectures/ PBL as examples.
![Page 16: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/16.jpg)
How to grade the evidence? The QUESTS model:
3. Extent What is the extent of the evidence? Is the evidence based on a single study or
on metanalysis?
![Page 17: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/17.jpg)
How to grade the evidence? The QUESTS model:
4. Strength How strong is the evidence?
Examples: Simulated patients in medical education
research. Co-operative learning.
![Page 18: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/18.jpg)
How to grade the evidence? The QUESTS model:
5. Target What is the target? What is being measured? The extent to which the outcomes measured
by researcher and outcomes expected by the teacher are similar.
How valid is the evidence?
![Page 19: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/19.jpg)
How to grade the evidence? The QUESTS model:
6. Setting How close does the context or setting
approximate? How relevant is the evidence?
![Page 20: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/20.jpg)
How to use this model?
Quality
Utility
Extent
Strength
Target
Setting
A B C
A B C
A B C
A B C
A B C
A B C
![Page 21: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/21.jpg)
How to use this model?
Quality
Utility
Extent
Strength
Target
Setting
X
X
X
X
X
X
A B C
![Page 22: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/22.jpg)
Truth is rarely pure and never simple.
(Oscar Wilde)
![Page 23: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/23.jpg)
What is the aim then of BEME?
![Page 24: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/24.jpg)
Actions
Medical teachers
Evidence
Improvement
Judge
Think
Judge
Think
![Page 25: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/25.jpg)
Role of Clinical Teachers (Ullian et al 1994)
1. Physician role:
• Knowledgeable and competent.
• Empathy with patients.
• Demonstrate professional attitudes, values and behavior.
![Page 26: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/26.jpg)
Applications
![Page 27: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/27.jpg)
Teaching EBM
![Page 28: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/28.jpg)
Teaching EBM
Should it be part of training programs? Can teaching EBM change practice? Can evidence be applied during clinical
rounds?
![Page 29: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/29.jpg)
Should it be part of training programs?
The Accreditation Council of Graduate Medical Education requires the inclusion of decision making skills by identifying, appraising and applying evidence from clinical research in internal medicine program curricula. (1998)
![Page 30: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/30.jpg)
417 Internal Medicine Program Directors
269 (65%) responded
99 (37%) offered a freestanding EBM curricula
Objectives
• Performing critical appraisal (78%)
• Searching for evidence (53%)
• Posing focused question (44%).
• Applying the evidence in decision making (35%)
97% provided MEDLINE
Green ML, J Gen Intern Med 2000, 15.
![Page 31: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/31.jpg)
Can teaching EBM change practice?
![Page 32: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/32.jpg)
35 attending physician and 12 medical residents
EBM course, syllabus and textbook35 attending physician and 12 medical residents
Month before Month after
Therapies for 483 patients
Significantly more proven therapies based on RCT
62% vs 49% (P=.023)Straus SA et al, J Gen Int
Med,2005;20:340-343
![Page 33: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/33.jpg)
Evidence Cart:CAT, Redbook, RCE,Medline, Cochrane, PE textbook, Radiology textbook,Simuloscop
Clinical rounds:Medical students, house staff, fellows, consultants
Use of evidence in 1 month
•Evidence Cart was used 98 times.
•79(81%) sought evidence that could affect diagnostic and/or treatment decision.
• 71 (90%) were successful.
•37/71 (51%) confirmed their diagnosis and/or treatment
•10.2-25.4 sec to review some resources
•18/71(25%) let to a new skill and management decision.
•16/71 (23%) corrected a previous skill or a management decision
• 5 searches only performed when evidence was needed in 41 patients. (12%)
Sacket DL et al, JAMA 1998, 280
![Page 34: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/34.jpg)
Exercise
![Page 35: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/35.jpg)
Exercise
If extensive EBM course was conducted in your institution do you think that it will change practice?
Discuss with your neighbor!
![Page 36: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/36.jpg)
To …… hospital administration:
“To practice EBM efficiently, residents need access to a range of information resources, like MEDLINE and on-site electronic medical information” Green ML, J Evaluation Clinical Practice 2000, 6(2)
![Page 37: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/37.jpg)
Role of Clinical Teachers (Ullian et al 1994)
2. Teacher role
• Interested in teaching.
• Spends time with learners.
• Explains and answer questions.
• Available to teach.
![Page 38: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/38.jpg)
Journal Clubs
![Page 39: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/39.jpg)
Journal Clubs
Should it be part of training programs? In what format? Are they effective?
![Page 40: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/40.jpg)
Journal Clubs
They are maintained in 95% of internal medicine programs. (Sidorov 1995)
79% of family practice programs. (Heiligman et al 1987)
100% of physical medicine and rehabilitation programs. (Moberg et al 1995).
![Page 41: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/41.jpg)
What is the format?
The most common format: Meeting once a month during working hours. 2-3 articles related to one subject. Only original research were discussed. A distinguished leader. A biostatician may be present.
(Alguire PC, 1998, J Gen Intern Med (13))
![Page 42: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/42.jpg)
What is the ideal format?
An ideal J club format does not exist!
![Page 43: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/43.jpg)
Are journal clubs suitable to teach evidence-based decision making?
Green, M, J Eval Clin Pract, 2000, 6(2)
![Page 44: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/44.jpg)
Exercise:
What do you think the characteristics of J.Club with high attendance and longevity?
1. Mandatory attendance.2. Availability of food.3. Perceived importance by the program director.4. Others: smaller training programs, independent
from faculty journal club, formal teaching in epidemiology…
(Alguire PC, 1998, J Gen Intern Med (13))
![Page 45: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/45.jpg)
Effectiveness?
A systematic review (Cochrance methodology) of all studies on J.Club to evaluate its effectiveness.
Only 7/306 studies met the inclusion criteria. (Ebbert JO et al, Medical Teacher 2001, 23(5))
Results: There was a statistically significant improvement in
epidemiology and biostatistics knowledge, change in reading habits, and increase the use of medical literature in practice.
There was a trend to improve the critical appraisal skills.
![Page 46: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/46.jpg)
Criteria P<0.05 P>0.05
epidemiology and biostatistics knowledge.
Reading habits.
Use of medical literature in practice.
Critical appraisal skills.
![Page 47: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/47.jpg)
Role of Clinical Teachers (Ullian et al 1994)
3. Supervisor
• Provide directions and feedback.
• Delegates responsibilities.
• Involve learners in management.
![Page 48: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/48.jpg)
What do you think about MEDICAL GRAND ROUNDS in your institution?
![Page 49: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/49.jpg)
Re-examining the value of medical grand rounds
A questionnaire was sent 389 US departments of medicine chairs, 300 responded (77%).
Less than 10% were clinical case presentations and 1% were interactive workshops.
High absentee rate.
![Page 50: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/50.jpg)
![Page 51: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/51.jpg)
Do Conferences, Workshops, Rounds, and Other traditional CME activities
Change Physician Behavior or Health Care Outcome?
Davis, D et al, JAMA, 1999, 282,No 9
![Page 52: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/52.jpg)
Conclusion
Didactic sessions do not appear to be effective in changing physician performance.
Interactive CME sessions can effect change in professional practice and, on occasion, health care outcome.
![Page 53: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/53.jpg)
Role of Clinical Teachers (Ullian et al 1994)
4. Supporter
• Friendly, helpful, caring.
• Values learners as individuals.
• Positive attitudes to patients and to own career.
![Page 54: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/54.jpg)
Are you convinced about the need to distribute the concept of BEME?
![Page 55: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/55.jpg)
Exercise
![Page 56: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/56.jpg)
Exercise
How can you distribute the culture of the need to BEME in your institution?
Discuss with your neighbor.
![Page 57: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/57.jpg)
Distributing the culture of BEME
Train the teachers. (who is the effective teacher?)
Train the learners. (how good is the teaching? Do they learn something from us? Do they feel enthusiastic about learning at the end of our teaching?)
Improve a two way approach of assessment. Open discussions to our problems.
![Page 58: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/58.jpg)
Distributing the culture of BEME
Acknowledging and rewarding teachers, Considering excellency in teaching a
prerequisite for promotion and appointments for staff,
A committee for educational development,
![Page 59: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/59.jpg)
Distributing the culture of BEME
Free access to medical education journals, Good library with advanced web-based services, Grand round in medical education, Medical education in journal club sessions, Training courses.
![Page 60: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/60.jpg)
Teachers should use research to enhance their teaching practice.
![Page 61: Best Evidence Medical Education](https://reader036.vdocuments.site/reader036/viewer/2022062418/5568c1aed8b42a7c7d8b4f66/html5/thumbnails/61.jpg)
Thank you