next steps for competency-based medical education › docs › meetings › 2012spring...milestones...
TRANSCRIPT
![Page 1: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/1.jpg)
Milestones and
Entrustment: Next steps for competency-based
medical education
Edwin L. Zalneraitis, M.D.
APPD Forum for
Directors of Small Programs
![Page 2: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/2.jpg)
Acknowledgements:
Dr. Carol Carraccio
Dr. Robert Englander
Dr. Joseph Gilhooley
Dr. Olle Ten Cate
…and the many others from whose ideas
and work I have borrowed shamelessly.
![Page 3: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/3.jpg)
Medical Education
“Medical education seems to be in a
perpetual state of unrest.”
Cooke et al. American Medical Education: 100
Years After the Flexner Report. NEJM 2006;
355:1339-1344.
Good news: Progress has been made.
More news: We are not there yet
![Page 4: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/4.jpg)
Goal
Successfully incorporate milestones and
entrustment into assessment
Meet new regulatory expectations
Improve Competency-based Medical
Education (CBME)
![Page 5: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/5.jpg)
Objectives
Perspective: history
Orientation: current state
Challenges to implementation of the next steps:
Curricular development
Program and faculty development
Building across the continuum
Scholarly examination of solutions
Resources
![Page 6: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/6.jpg)
THE QUICK FIX…
![Page 7: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/7.jpg)
THE REAL FIX…
![Page 8: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/8.jpg)
BACKGROUND: FLEXNER
To the public:
Mediocre quality
Profit motives
Inadequate curricula
Nonscientific approach
To medicine:
Formal analytic reasoning
Balance of research and patient care
![Page 9: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/9.jpg)
BACKGROUND: FLEXNER
Set in motion basis for standards
Requirements for accreditation
Requirements for certification
GME to replace apprenticeship
Still linked only to service
Still assessed by “sniff test”
![Page 10: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/10.jpg)
Competence in the 1980s
Goals and objectives
Global assessment of performance
Confirming competence by:
Program documentation
Global assessments
Ill-defined requirements for observation
Attestation for the ABP
Certification by Exam
![Page 11: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/11.jpg)
Limitations
Almost exclusively Global assessment
Lack of specific criteria for success
Limited authenticity/direct observation
Lack of Faculty development/change
Still a “sniff test”
![Page 12: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/12.jpg)
Outcomes Project
David Leach:
Called for true competency-based GME
Authentic and specific determinants in
assessment
“Things that we wish to assess and improve
upon, we must measure”
![Page 13: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/13.jpg)
Outcomes Project
ACGME and ABMS
Identified 6 areas of general competence
Relevant areas of “subcompetence”
Taught and assessed for accreditation
and certification
Direct observation
![Page 14: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/14.jpg)
Educational Transformation
Outcomes vs. Process
Learner centered vs. program centered
Competency-based
Observed directly
Reliable and valid assessment tools
![Page 15: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/15.jpg)
Proposed Strategies
Revise curriculum:
Outcomes in terms of competence
Activities to achieve outcomes
Competency-based assessment of activities
Conduct educational research:
Rigorous investigation
Evidence that competence is linked to
outcomes desired
![Page 16: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/16.jpg)
Requirements for Evaluation
Direct observation
Structured skills and knowledge assessments
Specific criteria for competence
Reliably by different evaluators
Relevant, fair and setting specific
![Page 17: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/17.jpg)
Requirements for Evaluation
Documentation:
Linked to observed or reviewed performance
Interpretable
Timely and available for review
![Page 18: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/18.jpg)
Assessment Process
Match outcomes/competence with goals
Match goals with activities
Match activities with assessment markers
Match markers with assessment tools
![Page 19: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/19.jpg)
Descriptive Assessment Tools
Developing and reinforcing clear
performance guidelines
Adding behavior-based, level-specific
performance descriptors
Faculty development of evaluation skills
![Page 20: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/20.jpg)
Curriculum defined in competency terms
Set the framework for measurement
More and better observed performance
What Has Been Achieved?
![Page 21: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/21.jpg)
![Page 22: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/22.jpg)
What is Still Needed?
Reliable and valid assessments
Evidence to relate assessment to competence
Relevant, specific and identifiable milestones
for areas of subcompetence
Performance/competence defined entrustment
that relates to need for supervision and safety
![Page 23: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/23.jpg)
Next Steps
Develop relevant curricula
Include reliable and valid assessments
Faculty development
Educational research
![Page 24: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/24.jpg)
Requirements for Transformation
Flexibility: creative redesign of program
Mentoring residents and faculty in their
roles and responsibilities
Align health outcomes with medical
education outcomes
![Page 25: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/25.jpg)
Challenges
Multiple competing new demands:
Shift to competency-based education
Shift to team implemented, patient centered care
Focus on quality and safety
Restriction in duty hours
Need for work-life balance
In context of:
Scientific information explosion
Changing and business driven medical system
Shrinking resources for increasing demands
![Page 26: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/26.jpg)
New Strategies
Faculty development and support
Identify existing resources
Regularly scheduled faculty development
Time to teach in directly observed, competency-
based way
Develop partnerships among stakeholders
Address escalating needs
Manage and share scarce resources
![Page 27: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/27.jpg)
Particularly Needed
Educational research:
Rigorous investigation
Demonstrate performance relates to
outcomes
Link educational outcomes to patient
outcomes
![Page 28: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/28.jpg)
Lessons Learned in CBME:
Assessment is still the biggest challenge: Reliability and validity
Faculty development and time
Competence is best Described in a developmental way
Assessed in a clinical context
Linked to entrustment, supervision and safety
![Page 29: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/29.jpg)
The Pediatric Milestones Project
Joint initiative of the ACGME and ABP
January 2012
First attempt
Welcoming feedback
Asking for scholarly investigation of use
![Page 30: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/30.jpg)
Dynamic Understanding
Competence as the point at which one is ready to
practice independently is a static view
Competence is dynamic and content and context
specific
Context fits well with Milestones and “entrustable
professional activities” (EPAs)
.
![Page 31: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/31.jpg)
“Entrustable Professional Activities”
(EPAs)
Professional life activities that define a specialty
Place competencies in the everyday work of the physician
Activities lead to some observable output or outcome
Complexity of the activities requires an integration of knowledge, skills and attitudes across competence domains
Specific number for each specialty
![Page 32: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/32.jpg)
Sample EPA
Caring for a well newborn
Know maternal conditions that affect the infant
Perform a comprehensive exam to discover congenital
anomalies
Apply evidence-based guidelines for newborn care
Speak to the mother using language that she
understands
Demonstrate respect for the mother’s cultural
background and child rearing practices
Connect with the community pediatrician in transfer of
care
![Page 33: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/33.jpg)
Sample: Curricular Milestones
Hand-over
Aware of importance and committed
With template, guidance and supervision-
effective and efficient
Structure is internalized, less supervision
Mastery: troubleshoot others
![Page 34: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/34.jpg)
Sample: Curricular EPA
Hand-over: Identify, organize and present
hand-over information
Knows what is important to transfer
Arrives on time prepared for the hand-over
Orderly, efficient and effective/safe manner
Without omissions or unnecessary information
Ensure seamless care from provider to provider
Troubleshoot information provided to achieve the
desired information transfer
![Page 35: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/35.jpg)
Back to the Future?
Similarities with Apprenticeship Model
Relationships are critical
Assessment is embedded in a clinical setting
taking care of real patients
Direct observation is key
Differences from Apprenticeship Model
Defined by specific elements of competence
Moved from random to deliberate
curriculum
![Page 36: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/36.jpg)
Presumptions Moving Forward
Competence is meaningful
In a developmental context
In the context of clinical care
Milestones of competence and EPAs provide
this context for both teaching and assessing
learners
Entrustment is recognized by assessing the
development of competence in context of care
![Page 37: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/37.jpg)
New Process
Performance linked to defined clinical activities
Clinical activities linked to reliable and valid
assessment
Assessment linked to development of
competence
Development of competence linked to EPAs
EPAs linked to supervision, safety and clinical
care outcomes
![Page 38: Next steps for competency-based medical education › docs › meetings › 2012Spring...Milestones and Entrustment: Next steps for competency-based medical education Edwin L. Zalneraitis,](https://reader035.vdocuments.site/reader035/viewer/2022081407/5f28af094de7d345e957d4f6/html5/thumbnails/38.jpg)
Relates to the NAS
ACGME data collection
Core set of milestones
Every six months
Clinical Competence Committee
Evaluations in milestones that link to core sets
Gather data from evaluations
Determine progress and advancement
Committee reviews link to defined set of EPAs for each specialty
Clusters of milestone achievements linked to entrustment
Specialty-defined EPAs linked to competence in practice