5 steps to data-driven learning
TRANSCRIPT
STEWART ROGERSDirector Product Management, Lambda Solutions
5 Steps for Data-Driven Online Learning & Training
Housekeeping
2
1. Sound & Audio2. Poll Questions3. Q&A at the end4. Presentation Recording & Slides5. Post-webinar Survey
Lambda Solutions
3
LMS experts – complete solutions provider, including
technology, training, & services
Beyond technology – our solutions
help you see when (and how)
eLearning is achieving goals.
12+ years, 600+ LMS
implementations, 1M active user accounts across most industry
sectors
Our Clients
4
What Is Data-driven Training?
“A data-driven approach used to optimize how your organization manages and deploys learning and development to support the execution of your business strategy.” - Chief Learning Officer, 2015
5
What Is Data-driven Training?
“A data-driven approach used to optimize how your organization manages and deploys learning and development to support the execution of your business strategy.” - Chief Learning Officer, 2015
6
Poll Question #1
Are you currently using a data-driven approach?
7
Poll Question #1
Are you currently using a data-driven approach?1. Yes, we’re getting there!2. A bit, but not fully.3. No, not at all.
8
15%
60%
25%
Step 1: Embrace A Data-driven Mindset• Make analytics part of the fabric of daily operations• Must view data as central to identifying opportunities and
solving problems• Identify 2-4 key requirements that data can address• Take inventory of your "data assets." Explore the data
available both within learning solutions and across your ecosystem
• Assess your capabilities against what is required to support your goals
9
Step 2: Establish Shared Goals• Democratizing data access and shared accountability for
meeting those goals• Set department and individual goals - transparently• Debate is encouraged, along with "healthy tension"• Everybody in the department, from the CLO down to the
instructional designer, should share a common goal for alignment.
10
Step 3: Offer Continuous Training & Coaching• Find those who are interested• Use Aryng’s Analytical Aptitude Assessment to assess fit for
a data driven role or an analytics career• Identify the skills gap• Choose the most appropriate training option
11
“50% of L&D organizations lack the analytics skills necessary to use the data available”
Unleashing the Power of Analytics:Driving Performance at the Intersection of Learning and Business
Raytheon Whitepaper (November 2015)
Step 3 (Continued): Training And CoachingSKILLS• Ability to pull data from multiple sources and collate (experience
in writing SQL queries)• Hands-on experience with basic statistical techniques: Profiling,
Correlation analysis, Trend analysis, Segmentation• Ability to work effectively with stakeholders by building
alignment, effective communication and influencing• Hands-on comfort with advance techniques: Time Series,
Predictive Analytics – Regression and Decision Tree, Segmentation and Text Analytics
12
Step 4: Provide Access To The Right Tools
…. AND THE RIGHT DATA• Equip your learning solutions with robust reporting
and analytics capabilities– Probably not Excel– Probably not the reporting options in your LMS
• Complement with one or more statistical tools like SAS, R, SPSS, Knime or others
13
Poll Question #2
Does your Learning Management System (LMS) have a robust reporting tool to a data-driven approach?
14
Poll Question #2
Does your Learning Management System (LMS) have a robust reporting tool to a data-driven approach?Yes, and we use it!Yes, but it doesn’t provide all the information we need.No, it does not.We do not use an LMS
15
25%
45%
20%
10%
Measuring Training EffectivenessUsing a methodical approach…Donald Kirkpatrick first published his Four-Level Training Evaluation Model in 1959, in the US Training and Development Journal. The model was then updated in 1975, and again in 1994.
Four Levels of Evaluation:1. Reaction2. Learning3. Behavior4. Results
16
The Kirkpatrick Ladder
17
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
The Kirkpatrick Ladder
18
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
Doing nothing.
The Kirkpatrick Ladder
19
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
Measures how the people being trained, reacted to the training.
The Kirkpatrick Ladder
20
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
Measure what your trainees have learned.
The Kirkpatrick Ladder
21
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
Evaluate how far your trainees have changed their behavior.
The Kirkpatrick Ladder
22
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
Analyze the outcomes that you or your organization have determined to be good for business or the employees.
The Kirkpatrick Ladder
23
REACTIONLevel 1
LEARNINGLevel 2
BEHAVIOURLevel 3
RESULTSLevel 4
Level 0
Impa
ct
Time
UTOPIA
Poll Question 3What evaluation level have you achieved?
1. None yet.2. Level 13. Level 24. Level 35. Level 4
24
Poll Question 3What evaluation level have you achieved?
1. None yet.2. Level 13. Level 24. Level 35. Level 4
25
10%20%30%20%10%
Typical Barriers To Climbing The Ladder1. Your LMS has limited access to data2. Your LMS has limited in capabilities to analyze data3. Your LMS has limited options to present and share data4. You have limited time
26
The Real Barrier
“50% of L&D organizations lack the analytics skills necessary to use the data available”
Unleashing the Power of Analytics:Driving Performance at the Intersection of Learning and Business
Raytheon Whitepaper (November 2015)
27
Poll Question 4
What prevents you from reaching higher levels?
1. Not enough time, we’re so busy delivering training2. We do not have access to the data3. We do not have software to analyze the data4. We do not have skills to analyze the data5. We can’t clearly connect learning the business results
28
ZoolaTM Analytics
Zoola Analytics is a cloud-based reporting solution that empowers you to better understand your learners and continuously improve learning programs and related resources. • Canned reports + ad hoc reports + custom reports• Charts, Tables, Crosstabs• Interactive dashboards • On-demand exports• Scheduled report delivery• Localized for 8 languages
29
30
Questions?
31
Book a Free 1-on-1 Consultation
32
• Free 30 minute session with our reporting expert• Explore your organizations reporting potential, and
brainstorm reporting ideas • Interested? Contact [email protected]
Follow-up
33
• Recording & slides to follow• Post-webinar satisfaction survey• Further questions - Don’t hesitate to contact us
