core competency assessment in emergency medicine from design to implementation
DESCRIPTION
Core Competency Assessment in Emergency Medicine from Design to Implementation. National Hispanic Medical Conference Christian Arbelaez, MD, MPH Associate Director, Office for Multicultural Faculty Careers Center for Faculty Development and Diversity - PowerPoint PPT PresentationTRANSCRIPT
Core Competency Assessment in Emergency Medicine
from Design to Implementation
National Hispanic Medical Conference
Christian Arbelaez, MD, MPHAssociate Director, Office for Multicultural Faculty Careers
Center for Faculty Development and DiversityAssistant Residency Director, Emergency Medicine
Brigham and Women’s Hospital
Washington, DC 2011
Core Competencies
Educational purpose
• To describe a comprehensive core competencies assessment program designed and implemented in our residency program.
• The goals of the program are to provide the residents and residency program a robust feedback loop on the achievement of core competence education in Emergency Medicine.
Core Competencies
Outline
• Design
• Implementation
• 1 year Review
Core Competencies
Design
• Residency needs assessment
• Review of the guidelines
• Stakeholder meetings
• Resource prioritization
Core Competencies
Design
• Design a comprehensive yet practical assessment curriculum
• Program centered on multiple assessments balanced between simple and complex observational tools, and repeated at different times to assess a resident’s developmental progression over their training, need for resident remediation, and programmatic change.
Core Competencies
Design
• A semi-annual assessment form and online faculty evaluations were developed to document expected PGY-based core competencies and graduated responsibilities.
• In-training examinations scores• 360-degree evaluation by resident peers and the clinical nursing
leadership group.• Procedural competency
– Endotracheal intubation– Central venous line placement– OSCE was used for the ultrasound assessment.
• A resuscitation competency log was kept throughout each year. • A resident portfolio was generated to keep each of these
documents • Self-reflection and Self-Assessment
Core Competencies
Implementation
• We developed an implementation and roll-out plan with reasonable set deadlines to meet the intern start date at the beginning of the academic year.
• One of the key components was a clear and transparent communication plan for the residents, faculty, and all staff involved in assessment of the residents.
Core Competencies
Implementation
• During the resident meetings we presented the program objectives and expectations, outlined any changes in the electronic data management system, distributed semi-annual assessment forms, handed out the procedure cards, and provided examples of portfolio entries.
• The residents also receive notification via the data management system to complete 360-degree peer evaluations.
• The faculty meeting focused on the global faculty ratings and the need for direct observation and constructive feedback after the selected procedures.
• The residents also met with the program manager to review their portfolios prior to their semi-annual review.
Core Competencies
One-Year Review
• After a year of implementation, we critically reviewed the assessment program and drafted a report outlining the individual components supported with resident data.
• We then developed an action plan for phase 2 of our implementation plan and produced a residency promotion criterion.
Core Competencies
One-Year Review
• In order for promotion, at the PGY 3 end of year evaluation, the following are the basic requirements needed in the resident’s portfolio: – a completed resident learning contract– a completed Professionalism checklist– completed semi-annual evaluations– one Chief Complaint CC assessment per year (including one oral boards)– a completed Procedural/Resuscitation Competency achieving the ACGME
targets by the end of PGY 3– yearly 360 degree evaluations by the Clinical Nursing Group and Resident Peer-
Peer, and– one self-assessment per year. – The end of the PGY 3 evaluation will be performed by one of the program
directors and each of these items will be reviewed for completion with the resident. Accordingly, the resident will be promoted to the PGY 4 year or will be promoted with a remediation clause and a signed contract of expectations prior to granting of graduation the following year.
Core Competencies
• Residency programs are expected to be fully compliant and integrated with the ACGME core competency assessment guidelines by 2011.
• Residency programs should be proactive in designing and implementing an evaluation and assessment program that best fits their needs based on institutional strengths and available resources.
• We offer a comprehensive assessment program designed and successfully implemented at our institution that is sensitive to the residents, faculty, and residency program needs for accountability, growth, remediation, and improvement.
Conclusions
