utilizing multiple grader rubrics for practical assessment of student performance
TRANSCRIPT
Utilizing Multiple Grader Rubrics for Practical
Assessment of Student Performance
Sherry Jimenez, Ed.D.Assistant Dean for Educational Development
Sarah Zahl, Ph.D.Director of Educational Assessment
Agenda• Audience Response• MUCOM Brief Overview • Multiple Grader Rubrics
o Assessment Types and Exampleso Tracking outcomes in rubrics
• Recommendations• Q&A
Poll Question 1
• Indicate the discipline in which you are or will be utilizing ExamSoft– Dental– PA– Pharmacy– Nursing– Medicine– Podiatry– Other
Poll Question 2
MU-COM Overview• Competency Based Curricular Design• Systems based/integrated curriculum
o Course Director, multiple internal faculty and external clinicians
o e.g. Cardiovascular course + OSCE• iPad exclusive• Building a culture of evidence among
faculty/students/administrators
Tracking Student Performance
• Competencies• COMLEX blueprint• System• Discipline• Learning Domains• Course specific outcomes
National Board of Osteopathic Medical Examiners
Fundamental Osteopathic Medical Competencies
COMLEX Blueprint
Use of Rubrics• Lab Practicals: Osteopathic Manipulative Medicine
(OMM) Lab • Simulations• Objective Structured Clinical Examinations (OSCE)• Small Group Evaluations: Clinical Medicine
Small Group Evaluations
Small Group Evaluations – Grading
Process
Small Group Evaluations – Grading
Process
• Complete the administrative planning process externally before using ExamSoft
• Pre-assign faculty graders and students• Pre-assign assessment area (region)• Prepare extra materials and guides• Communication
OSCE• Humanistic rubric, SOAP note, SP evaluation, self-
assessment
Lab Practicals• Paper Very complex online process
streamlined process in ExamSoft
Old process: multiple stations, partner flip, multiple regions, multiple graders and students at each station
New process: one station, partner flip only, one region (pre-determined but surprise to student)
Outcomes• Culture shift –modifying structure • Positive feedback – ease of evaluation• Immediate faculty feedback – inter-rater • Timeliness of student feedback• Pairing rubric data with written exam data to
develop longitudinal reports • Continuous refinement
Parting Thoughts• How are you currently assessing student
performance in practical settings?
• How could you incorporate multiple grader rubrics in your curriculum?
Q&A• Questions?
• Discussion
Click to edit Master title style
Click to edit Master subtitle styleFor More Information:
Call: 1.866.429.8889
Email: [email protected]
Visit: learn.examsoft.com