does change equal progress? using cross-institutional survey data to examine lms conversions and the...

32
Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion ELI Annual Meeting 2014 / New Orleans, Louisiana

Upload: educause

Post on 13-Apr-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 1/32

Does Change Equal Progress?

Using Cross-Institutional Survey Data toExamine LMS Conversions and the Smart

Device Explosion

ELI Annual Meeting 2014 / New Orleans, Louisiana

Page 2: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 2/32

The Game Plan

• Two perspectives on how change can work atour institutions.

 – How change works when driven at the

institutional level – How change works when driven by students,

faculty and staff

• We have stories, you have questions and yourown stories to share: please do!

• First, some context on the research

Page 3: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 3/32

About the Research

• Measuring Information Service Outcomes(MISO Survey)

• 100 participating institutions since 2005

 – Over 105,000 respondents (24,000 faculty, 48,000undergraduates, 32,000 staff + other populations)

• Average National Response Rates 2011-2013

 –

Faculty 57.9% – Undergraduates 50.1%

 – Staff 53.6%

Page 4: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 4/32

Institutions Undergoing LMS Change

Yes

No

55 institutions in data set

Page 5: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 5/32

Use in Transition

Pre- (or no)

transition

Mid-transition 1 Yr post transition 2 yrs post

transition

3+ Yrs post

transition

LMS Use, Students LMS Use, Faculty

More than

3x/week

1-3x/month

1-3x/week

Page 6: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 6/32

Importance in Transition

Pre- (or no)

transition

Mid-transition 1 Yr post transition 2 yrs post

transition

3+ Yrs post

transition

LMS Importance, Students LMS Importance, Faculty

Very

important

Important

Page 7: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 7/32

Satisfaction in Transition

Pre- (or no)

transition

Mid-transition 1 Yr post transition 2 yrs post

transition

3+ Yrs post

transition

LMS Satisfaction, Students LMS Satisfaction, Faculty

Satisfied

Somewhat

satisfied

Page 8: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 8/32

The Bigger Picture

Pre- (or no)

transition

Mid-transition 1 Yr post transition 2 yrs post

transition

3+ Yrs post

transition

Satisfaction, Overall Computing Services, Faculty

Satisfaction, Overall Computing Services, Students

Satisfied

Somewhat

satisfied

Page 9: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 9/32

Smart Device Ownership 

Using Cross-Institutional Survey Data toExamine How Device Owners Think

Differently about Library and IT Services

ELI Annual Meeting 2014 / New Orleans, Louisiana

Page 10: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 10/32

Smart Device Ownership

misosurvey.org

39%61%

Faculty 2012

24%76%

Faculty 2013

No smart device

Smart phone and tablet

34%

66%

Student 2012

22%

78%

Student 2013

Page 11: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 11/32

Smart Device Ownership

misosurvey.org

39%

9%21%

31%

Faculty 2012

24%

11%

38%

27%

Faculty 2013

No smart device

Tablet only

Smart phone and tablet

Smart phone only

34%

2%

11%

53%

Student 2012

22%

3%

18%58%

Student 2013

Page 12: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 12/32

Smart Devices Owners

misosurvey.org

0.0% 25.0% 50.0% 75.0% 100.0%

Female

Male

Student Smart Device Ownership by Gender

0.0% 25.0% 50.0% 75.0% 100.0%

Freshman

Sophomore

Junior

Senior Student Smart Device Ownership by Class Year

Page 13: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 13/32

Smart Devices Owners

misosurvey.org

Female

Male

0.0% 25.0% 50.0% 75.0% 100.0%

Faculty Smart Device Ownership by Gender

Arts and Humanities

STEM

Social Sciences

Other

0.0% 25.0% 50.0% 75.0% 100.0%

Faculty Smart Device Ownership by Discipline

39 and younger

40 to 49

50 to 59

60 and older

0.0% 25.0% 50.0% 75.0% 100.0%

Faculty Smart Device Ownership by Age

Page 14: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 14/32

Service Importance

misosurvey.org

1.00 2.00 3.00 4.00

Course management system

Course management system support

Student - Academic Technologies Services

NotImportant SomewhatImportant Important VeryImportant

Page 15: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 15/32

Service Importance

misosurvey.org

1.00 2.00 3.00 4.00

Technology support for your scholarly research

Support for technology in meeting spaces/classrooms

Time to resolve classroom technology problems

Course management system support

Technology in meeting spaces/classrooms

Instructional technology support

Course management system

Support for digital audio/video creation

Online audio/video for academic purposes

Video conferencing

Support for innovative ideas

Web conferencing (e.g. Skype, Adobe Connect)

Faculty - Academic Technology Services

Somewhat

Important

Important Very

Important

Not

Important

Page 16: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 16/32

Service Importance

misosurvey.org

1.00 2.00 3.00 4.00

Physical library collections

Interlibrary loan

Library circulation services

Online library catalog

Physical course reserves

Library databases (e.g. JSTOR, example)

Library discovery layer

Borrowing laptops

Library reference services

Library support for your scholarly research

Overall library service

Physical comfort in the library (e.g.…

Group study spaces in the library

Student - Library Services

Not

Important

Somewhat

Important

Important Very

Important

Page 17: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 17/32

Service Importance

misosurvey.org

1.00 2.00 3.00 4.00

Physical library collections

Library circulation services

Public computers in the library

Physical course reserves

Overall library service

Interlibrary loan

Your input into library decisions that affect you

Library research instruction for academic courses

Library e-book collections

Faculty - Library Services

Not

Important

Somewhat

Important

Important Very

Important

Page 18: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 18/32

Service Satisfaction

misosurvey.org

27

10

0

0 5 10 15 20 25 30 35

Less Satisfied

No Difference

More Satisfied

Faculty Smart Device Owners

33

19

0

Less Satisfied

No Difference

More Satisfied

0 5 10 15 20 25 30 35

Student Smart Device Owners

Page 19: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 19/32

Slide Header

misosurvey.org

Page 20: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 20/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00

Virus protection

The wired network

VPN

Performance of wireless access on campus

Availability of wireless access on campus

Faculty Service Importance - Systems

Not

Important

Somewhat

Important

Important Very

Important

Page 21: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 21/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00

Overall computing service

Access to online resources from off-campus

Status information on computing problems

Web portal

Computing Web site

Your input into computing decisions that affect you

Faculty Service Importance - General Technology Services

Not

Important

Somewhat

ImportantImportant Very

Important

Page 22: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 22/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00 5.00

Online library catalog

Spatial analysis/GIS software (e.g. ArcGIS, Remote Sensing)

Word processing software (e.g. Microsoft Word)

Solving computer problems

Web authoring software (e.g. Dreamweaver, Contribute)

Avoiding computer problems

Database software (e.g. Access, Filemaker)

Math or statistics software (e.g. Mathematica, SPSS)

Your primary Operating System (e.g. Mac OS, Windows)

Email

Technology in meeting spaces/classrooms

Graphics software (e.g. Photoshop, Elements)

Backing up data

Voicemail

Search engines (e.g. Google, Yahoo)

Course management system

Spreadsheet software (e.g. Excel)

Audio/video editing software (e.g. iMovie, Premiere)

Presentation software (e.g. PowerPoint)

Social software (e.g. Wiki, blog, podcasting, RSS)

Instant Messaging

Faculty Skills

Never

Used

Novice Basic Advanced Expert

Page 23: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 23/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00

Performance of wireless access on campus

Availability of wireless access on campus

Wired network

Current library schedule

Physical comfort in the library (e.g. seating, lighting)

Study carrels in the library

Library circulation services

Overall library service

Web conferencing (e.g. Skype, Adobe Connect)

Overall computing service

Course management system support

Departmental/specialized computing labs

Ease of finding physical materials in the library

Email services

Library reference services

Public computers in the library

Computing Web site

Group study spaces in the library

Physical course reserves

Email SPAM filtering

Access to online resources from off-campus

Borrowing technology equipment

Library Web site (e.g. library hours, policies)

Interlibrary loan

Technology support for your scholarly research

Campus computing labs

Campus printers

Input into library decisions that affect you

Library support for your scholarly research

Input into computing decisions that affect you

Library databasesLibrary research instruction for academic courses

Online library catalog

Students Service Satisfaction

Dissatisfied Somewhat

Dissatisfied

Somewhat

Satisfied

Satisfied

Page 24: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 24/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00

Campus printers

Public computers in the library

Departmental/specialized computing labs

Campus computing labs

Student Service Importance - Campus Computing Labs

Not

Important

Somewhat

Important

Important Very

Important

Page 25: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 25/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00 5.00

Online library catalog

Finding and evaluating information for your scholarship

Library databases (e.g. LexisNexis, JSTOR)

Search engines (e.g. Google, Yahoo)

Spatial analysis/GIS software (e.g. ArcGIS, Remote Sensing)

Presentation software (e.g. PowerPoint)

Course management system

Backing up data

Email

Your primary Operating System (e.g. Mac OS, Windows)

Social software (e.g. Wiki, blog, podcasting, RSS)

Technology in meeting spaces/classrooms

Web authoring software (e.g. Dreamweaver, Contribute)

Audio/video editing software (e.g. iMovie, Premiere)

Solving computer problems

Instant Messaging

Graphics software (e.g. Photoshop, Elements)

Database software (e.g. Access, Filemaker)

Students Skills

Never

Used

Novice Basic Advanced Expert

Page 26: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 26/32

ELI Slides  –  Smart Devices

misosurvey.org

34%

2%

11%

53%

Student Smart Device Ownership - 2012

No smart deviceTablet only

Smart phone and tablet

Smart phone only

Page 27: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 27/32

ELI Slides  –  Smart Devices

misosurvey.org

22%

3%

18%

58%

Student Smart Device Ownership - 2013

No smart device

Tablet only

Smart phone and tablet

Smart phone only

Page 28: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 28/32

ELI Slides  –  Smart Devices

misosurvey.org

39%

9%

21%

31%

Faculty Smart Device Ownership - 2012

No smart device

Tablet only

Smart phone and tablet

Smart phone only

Page 29: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 29/32

ELI Slides  –  Smart Devices

misosurvey.org

24%

11%

38%

27%

Faculty Smart Device Ownership - 2013

No smart device

Tablet only

Smart phone and tablet

Smart phone only

Page 30: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 30/32

ELI Slides  –  Smart Devices

misosurvey.org

1.00 2.00 3.00 4.00

Performance of wireless access on campus

Availability of wireless access on campus

Desktop/laptop computer replacement

Course management system support

Course management system

Timeto resolve desktop/laptop problemsStatus information on computing problems

Time to resolve classroom technology problems

Technology in meeting spaces/classrooms

Access to online resources from off-campus

Computing help desk schedule

Overall computing service

Email services

Support for technology in meeting spaces/classrooms

Wired network

ERP self serviceInput into computing decisions that affect you

Library e-book collections

Library support for scholarly research

Online library catalog

Interlibrary loan

Email SPAM filtering

Computing help desk

Virus protection

Library circulation services

Library databasesOverall library service

Faculty Service Satisfaction - Smart Device Owners

Dissatisfied Somewhat

Dissatisfied

Somewhat

Satisfied

Satisfied

Page 31: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 31/32

ELI Slides  –  Smart Devices

misosurvey.org

33

19

0

Less Satisfied

No Difference

More Satisfied

0 5 10 15 20 25 30 35

Student Smart Device Owners - Service Satisfaction

Page 32: Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)

http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 32/32

Presenters

• David Consiglio – Bryn Mawr College

• Kevin Creamer – University of Richmond

• Gentry Lankewicz Holbert – Spring Hill College

• Joshua Wilson –

Brandeis University• With thanks to Katherine Furlong

 – Lafayette College