can data in a learning management system support student · suggestions about new or different…...

Can data in a Learning Management System support student success?

29 June 2016

2

31.6%

30.5%

35.9%

35.9%

24.7%

30.1%

34.8%

32.5%

36.7%

33.8%

37.8%

42.8%

33.1%

23.0%

34.9%

40.6%

38.8%

36.1%

0% 20% 40% 60% 80% 100%

Guidance about courses you might consider…

Alerts if it appears your progress in a course…

Suggestions for how to improve performance

Suggestions about new or different…

Automated tracking of your course…

Feedback about performance compared to…

Personalized support and information on…

Personalized quizzes or practice questions

Personalized visualizations and dashboards

Interested if provided with…

Don’t know Not at all interested Not very interested

Moderately interested Very interested Extremely interested

Role of LMS to achieve academic success?

2%0% 2%

9%

24%

63%

8%

2%

7%

18%

27%

38%

7%

2%5%

17%

29%

41%

0%

10%

20%

30%

40%

50%

60%

70%

Did not use in thepast year

Not at allimportant

Not veryimportant

Moderatelyimportant

Very important Extremelyimportant

University of Pretoria All non-US institutions All institutions

Percentage of UG modules use of LMS

30

3839

32

64 63

68

75 75

8284

20

30

40

50

60

70

80

90

2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Use of LMS

Rationale for integrating technology to support student engagement

Rationale for integration of LMS

Past:• International and National

trends

Present:• Growth of student numbers• Quality of education• Academic support • Student success

Technical Integration

Integration

PS

Bb

SOA

EnrolmentsLimited biographical dataGrades

Grade & Outcome Results

Course Attributes

Student Attributes

Final Grades

Student

Information

System

Performance Analyses

Best Practices Analyses

Trend Analyses

Instructor Attributes

User Activity

Data Course Item Data

Integration

Categories of LMS Data For Analysis

Grades

Student Course Summary

Grade Center

Course Design

Course Summary

Course Items

User Activity

Session Activity

Course Activity

Course

Item Activity

Submissions

Forum Submissions

Case studies

Are our studentsengaging actively online?

Do my course design impactstudent engagement?

Are students at risk in this module also at risk in others?

How can we further engage the students in the “middle”?

How can we further engage the at-risk students?

Faculty questions

Who are the students at risk based on LMS data?

Are we disadvantage any group of students?

Course design impact on engagement

Course design impact on engagement

Course design impact on engagement

Course design impact on engagement

Are our students engaging actively online?

Who are the students at risk?

Who are the students at risk?

Who are the students at risk?

Students at risk in this module also at risk in others?

Students at risk in this module also at risk in others?

Students at risk in this module also at risk in others?

Students at risk in this module also at risk in others?

Course reports: Submission report

Student report

Can data in a Learning Management System support student success?

Average final grade compared to course access per access quartile

Can data in a Learning Management System support student success?

Average final grade compared to student risk profile

Conclusion

• LMS data in isolation

• Impact of professional development / support

• Integration with other data sets

•Skills set needed

•Policies

•Context: Correlation does not equal causation

•Provide insights that might not be obvious

• LMS data can inform lecturers, students & advisors

•Guide actions such as learning design

Dolf Jordaandolf@up.ac.za

Educational Technology and ICT trends

Online with EI

ObjectiveAssessments

Use of QM Live forQuestUP

Pedagogical use ofclickUP & Turnitin

E-learning for academics

Web and mobile use

Help desk

Mediadevelopment

Basic use ofclickUP for adminstaff

Instructional Design support per Faculty

Student success projects support

Tutor & Just in TimeDepartmental training

EI

clickUP

Support

QuestUP

Training

Digital Lecture

LMS data

Analytics

Learning analytics is the measurement, collection, analysis and reporting of data about learners and their

contexts, for purposes of understanding and optimizing learning and the environments in which it

occurs

36

LMS Analytics

Reports & Dashboards

Data Warehouse

Analytics for Learn

Students

Lecturers

Advisors

Deans & HoDs

Instructional Technology

Staff

Institutional Leaders

Self Help (Peer Comparison)

• At-Risk Student Identification & Intervention

• Improve use of Learn (Best Practices)

• At-Risk Student Identification & Intervention

• Driving Best Practice Adoption• Measuring Results

• Data Analysis• Defining Best

Practices • Driving Learn

Adoption• Measuring Results

• Defining Goals & Policy

• Measuring Results