sara kim, phd, director, associate professor instructional design and technology unit, ucla david...

33
Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior Computer Programmer Instructional Design and Technology Unit, UCLA David Geffen School of Medicine March 6, 2012 International Association of Medical Science Educators Strategies for Selecting a Learning Management System: An Experience at the UCLA David Geffen School of Medicine

Upload: grace-mitchell

Post on 25-Dec-2015

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Sara Kim, PhD, Director, Associate ProfessorInstructional Design and Technology Unit, UCLA David Geffen School of Medicine

Katherine Wigan, BS, MBA, Senior Computer ProgrammerInstructional Design and Technology Unit, UCLA David Geffen School of Medicine

March 6, 2012International Association of Medical Science Educators

Strategies for Selecting a Learning Management System: An Experience at the UCLA David Geffen School of Medicine

Page 2: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Introduction to Webinar Session

Learning Management Systems (LMS) serve as a backbone in medical schools for curriculum delivery, exam administration, and accreditation requirements.

LMS market offers 4 solutions: Commercial, Open-Source, Open-Source/Commercial, and Homegrown Products.

Today’s webinar presents the ongoing experiences at the UCLA David Geffen School of Medicine in our LMS review processes.

Page 3: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Guiding Principles of LMS Selection

Page 4: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

1

2

3

4

Outline of Webinar Session

5

Page 5: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

UCLA David Geffen School of Medicine Curriculum Map

Page 6: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

UCLA David Geffen School of Medicine Curriculum Map

ANGEL Learning Management System

Ilios CMSHomegrownPatient Log

CourseEval

Page 7: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Technology Resourcesat David Geffen School of Medicine

Technology-Based

Curriculum Support

OnlineEducational

ToolDevelopment

Research and Grant Writing

Page 8: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Timeline of LMS Adoption at David Geffen School of Medicine

Adoption of ANGEL LMS

Purchased ANGEL in 2003 Local Hosting Option 2,000 Active Licenses = $20,000 per year

Page 9: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Timeline of LMS Adoption at David Geffen School of Medicine

March 2011 July 2012

December 2011 July 2014 April 2015

October 2014

Formed LMS Advisory Committee

Committee meeting withleadership

Last ANGEL update to version 8.0

Deadline for fullylaunching the new LMS

ANGEL support discontinuedVia Blackboard

ANGEL no longer availableVia Blackboard

Timeline of LMS Replacement Process

Adoption of ANGEL LMS

Purchased ANGEL in 2003 Local Hosting Option 2,000 Active Licenses = $20,000 per year

Page 10: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Guiding Principles of LMS Selection

Page 11: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Institutional Needs Assessment

Leadership Buy In

Identifying Stakeholders

LMS Review ProcessAct 1: People

Page 12: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Institutional Needs Assessment

Focus Groups:Curriculum

Coordinators

Survey:

Medical Students

a. Assessment of ANGEL Features

b. Recommendations for Features in Future LMS

Determining Factors for Identifying Core LMS Features

Page 13: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Institutional Needs Assessment

Page 14: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Institutional Needs Assessment

Page 15: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Leadership Buy In via Strategic Plan

Crafted StrategicPlan Document

Sign Off byLeadership

Page 16: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Leadership Buy In via Strategic Plan

Page 17: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Leadership Buy In via Strategic Plan

Page 18: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Identifying Stakeholders

Page 19: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Guiding Principles of LMS Selection

Page 20: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 2: Technology

Identifying Core LMS Features

Identifying LMS Options

Page 21: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior
Page 22: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Sakai(Open-Source/Commercial)

Black-Board

(Commercial)

Canvas(Open-Source/Commercial)

Entrada (Homegrown/ Open-Source)

Desire2 Learn

(Commercial)

LCMS+ (Homegrown)

TUSK(Homegrown)

Moodle (Open-Source/Commercial)

Page 23: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Pros Cons

Commercial •Dedicated 3rd party support

•Requires less in-house programming resources and technical expertise

•Possibility of getting bought out

•Per user license fee model, with no control over fee increases

•Extra charges for system customizations/integrations

Open Source •Unlimited free licenses

•Freedom of customization and implementation

•Availability of user community

•No dedicated 3rd party support

•Requires in-house programming resources and technical expertise

Page 24: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Guiding Principles of LMS Selection

Page 25: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

Page 26: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

1. Between April and September, 2011, Committee Participated in a One Hour Demo and One Hour Discussion per LMS

2. Each Demo Session Podcast for Review

3. Based on Committee’s Requests, Sought Follow Up Information from Vendors

Page 27: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

1. Requested Vendors to Complete a Detailed Template of Information

2. Conducted a SWOT (Strength, Weakness, Opportunity, Threat) Analysis per System

3. Performed a 5-year Cost Analysis per System

Page 28: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

Page 29: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

1. In November, 2011, Committee Members voted on Top 3 LMS for Future Review

2. Three Solutions Include: Desire2Learn, Sakai/Longsight, Canvas/Instructure

3. In December, 2011, Committee Met with Medical School Leaders for Debrief

Page 30: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

LMS Review ProcessAct 3: Process

1. Completed a pilot of one LMS in a Second Year Course

2. Plan to Conduct Formal Usability Testing this Spring

3. Final Recommendation to Medical School Leadership

Page 31: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

Wrap Up: Lessons Learned

Page 32: Sara Kim, PhD, Director, Associate Professor Instructional Design and Technology Unit, UCLA David Geffen School of Medicine Katherine Wigan, BS, MBA, Senior

The Future of LMS?