Direct Observation and FeedbackVictoria Cannon

Rationale

• LSI’s competency-based design is best supported by an assessments system that allows for multiple assessments from multiple evaluators gathered over time.

• Many of these assessments are being done on paper

• A more usable digital solution would enable more frequent and accurate assessments of students in clinical settings

2

LeadServeInspire Curriculum

3

Clinical Foundations

• Didactics

• Longitudinal Practice

• Small Groups

Clinical Applications

• Clinical Rotations

• Small Groups

• Didactics

Advanced Clinical

Management

• Advanced Competencies

• Clinical Tracks

• Virtual Small Groups

Process

My Progress Task Force

Cross-functional membership

Program coordinators

Faculty

IT Staff

Weekly meetings

Rolling Pilots (March – July)

Longitudinal Practice

Clerkships: Internal Medicine, Pediatrics, Neurology

Genetic Counseling Program

Ultrasound Advanced Competency

Rolling Production (June – September)

4

Pilot Results

Roles

Tutor role too broad for our faculty

Enhancement requests submitted to MKM

Form design and reports

Needed granular data build individual questions rather than bundle

Multiple choice questions preferred over scale for usability

Assessment types

Student deployed worked best

Limited faculty deployed assessments

5

My Progress in Production

Currently centrally managed though plan to decentralize

Statistics

Implemented 4 programs and 10 courses

156 assessment forms

700+ users in 34 cohorts

8,451 assessments completed to-date

6

Next Steps

Expand to more programs

Residency

LSI Part 3

Student Portfolios

Replace PxDx tool (legacy logging application)

Work with MKM on Enhancements to My Progress

Reporting improvements

Administrative management functions

Usability tweaks

7

8

Questions?