does change equal progress? using cross-institutional survey data to examine lms conversions and the...
TRANSCRIPT
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 1/32
Does Change Equal Progress?
Using Cross-Institutional Survey Data toExamine LMS Conversions and the Smart
Device Explosion
ELI Annual Meeting 2014 / New Orleans, Louisiana
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 2/32
The Game Plan
• Two perspectives on how change can work atour institutions.
– How change works when driven at the
institutional level – How change works when driven by students,
faculty and staff
• We have stories, you have questions and yourown stories to share: please do!
• First, some context on the research
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 3/32
About the Research
• Measuring Information Service Outcomes(MISO Survey)
• 100 participating institutions since 2005
– Over 105,000 respondents (24,000 faculty, 48,000undergraduates, 32,000 staff + other populations)
• Average National Response Rates 2011-2013
–
Faculty 57.9% – Undergraduates 50.1%
– Staff 53.6%
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 4/32
Institutions Undergoing LMS Change
Yes
No
55 institutions in data set
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 5/32
Use in Transition
Pre- (or no)
transition
Mid-transition 1 Yr post transition 2 yrs post
transition
3+ Yrs post
transition
LMS Use, Students LMS Use, Faculty
More than
3x/week
1-3x/month
1-3x/week
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 6/32
Importance in Transition
Pre- (or no)
transition
Mid-transition 1 Yr post transition 2 yrs post
transition
3+ Yrs post
transition
LMS Importance, Students LMS Importance, Faculty
Very
important
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 7/32
Satisfaction in Transition
Pre- (or no)
transition
Mid-transition 1 Yr post transition 2 yrs post
transition
3+ Yrs post
transition
LMS Satisfaction, Students LMS Satisfaction, Faculty
Satisfied
Somewhat
satisfied
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 8/32
The Bigger Picture
Pre- (or no)
transition
Mid-transition 1 Yr post transition 2 yrs post
transition
3+ Yrs post
transition
Satisfaction, Overall Computing Services, Faculty
Satisfaction, Overall Computing Services, Students
Satisfied
Somewhat
satisfied
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 9/32
Smart Device Ownership
Using Cross-Institutional Survey Data toExamine How Device Owners Think
Differently about Library and IT Services
ELI Annual Meeting 2014 / New Orleans, Louisiana
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 10/32
Smart Device Ownership
misosurvey.org
39%61%
Faculty 2012
24%76%
Faculty 2013
No smart device
Smart phone and tablet
34%
66%
Student 2012
22%
78%
Student 2013
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 11/32
Smart Device Ownership
misosurvey.org
39%
9%21%
31%
Faculty 2012
24%
11%
38%
27%
Faculty 2013
No smart device
Tablet only
Smart phone and tablet
Smart phone only
34%
2%
11%
53%
Student 2012
22%
3%
18%58%
Student 2013
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 12/32
Smart Devices Owners
misosurvey.org
0.0% 25.0% 50.0% 75.0% 100.0%
Female
Male
Student Smart Device Ownership by Gender
0.0% 25.0% 50.0% 75.0% 100.0%
Freshman
Sophomore
Junior
Senior Student Smart Device Ownership by Class Year
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 13/32
Smart Devices Owners
misosurvey.org
Female
Male
0.0% 25.0% 50.0% 75.0% 100.0%
Faculty Smart Device Ownership by Gender
Arts and Humanities
STEM
Social Sciences
Other
0.0% 25.0% 50.0% 75.0% 100.0%
Faculty Smart Device Ownership by Discipline
39 and younger
40 to 49
50 to 59
60 and older
0.0% 25.0% 50.0% 75.0% 100.0%
Faculty Smart Device Ownership by Age
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 14/32
Service Importance
misosurvey.org
1.00 2.00 3.00 4.00
Course management system
Course management system support
Student - Academic Technologies Services
NotImportant SomewhatImportant Important VeryImportant
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 15/32
Service Importance
misosurvey.org
1.00 2.00 3.00 4.00
Technology support for your scholarly research
Support for technology in meeting spaces/classrooms
Time to resolve classroom technology problems
Course management system support
Technology in meeting spaces/classrooms
Instructional technology support
Course management system
Support for digital audio/video creation
Online audio/video for academic purposes
Video conferencing
Support for innovative ideas
Web conferencing (e.g. Skype, Adobe Connect)
Faculty - Academic Technology Services
Somewhat
Important
Important Very
Important
Not
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 16/32
Service Importance
misosurvey.org
1.00 2.00 3.00 4.00
Physical library collections
Interlibrary loan
Library circulation services
Online library catalog
Physical course reserves
Library databases (e.g. JSTOR, example)
Library discovery layer
Borrowing laptops
Library reference services
Library support for your scholarly research
Overall library service
Physical comfort in the library (e.g.…
Group study spaces in the library
Student - Library Services
Not
Important
Somewhat
Important
Important Very
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 17/32
Service Importance
misosurvey.org
1.00 2.00 3.00 4.00
Physical library collections
Library circulation services
Public computers in the library
Physical course reserves
Overall library service
Interlibrary loan
Your input into library decisions that affect you
Library research instruction for academic courses
Library e-book collections
Faculty - Library Services
Not
Important
Somewhat
Important
Important Very
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 18/32
Service Satisfaction
misosurvey.org
27
10
0
0 5 10 15 20 25 30 35
Less Satisfied
No Difference
More Satisfied
Faculty Smart Device Owners
33
19
0
Less Satisfied
No Difference
More Satisfied
0 5 10 15 20 25 30 35
Student Smart Device Owners
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 19/32
Slide Header
misosurvey.org
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 20/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00
Virus protection
The wired network
VPN
Performance of wireless access on campus
Availability of wireless access on campus
Faculty Service Importance - Systems
Not
Important
Somewhat
Important
Important Very
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 21/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00
Overall computing service
Access to online resources from off-campus
Status information on computing problems
Web portal
Computing Web site
Your input into computing decisions that affect you
Faculty Service Importance - General Technology Services
Not
Important
Somewhat
ImportantImportant Very
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 22/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00 5.00
Online library catalog
Spatial analysis/GIS software (e.g. ArcGIS, Remote Sensing)
Word processing software (e.g. Microsoft Word)
Solving computer problems
Web authoring software (e.g. Dreamweaver, Contribute)
Avoiding computer problems
Database software (e.g. Access, Filemaker)
Math or statistics software (e.g. Mathematica, SPSS)
Your primary Operating System (e.g. Mac OS, Windows)
Technology in meeting spaces/classrooms
Graphics software (e.g. Photoshop, Elements)
Backing up data
Voicemail
Search engines (e.g. Google, Yahoo)
Course management system
Spreadsheet software (e.g. Excel)
Audio/video editing software (e.g. iMovie, Premiere)
Presentation software (e.g. PowerPoint)
Social software (e.g. Wiki, blog, podcasting, RSS)
Instant Messaging
Faculty Skills
Never
Used
Novice Basic Advanced Expert
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 23/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00
Performance of wireless access on campus
Availability of wireless access on campus
Wired network
Current library schedule
Physical comfort in the library (e.g. seating, lighting)
Study carrels in the library
Library circulation services
Overall library service
Web conferencing (e.g. Skype, Adobe Connect)
Overall computing service
Course management system support
Departmental/specialized computing labs
Ease of finding physical materials in the library
Email services
Library reference services
Public computers in the library
Computing Web site
Group study spaces in the library
Physical course reserves
Email SPAM filtering
Access to online resources from off-campus
Borrowing technology equipment
Library Web site (e.g. library hours, policies)
Interlibrary loan
Technology support for your scholarly research
Campus computing labs
Campus printers
Input into library decisions that affect you
Library support for your scholarly research
Input into computing decisions that affect you
Library databasesLibrary research instruction for academic courses
Online library catalog
Students Service Satisfaction
Dissatisfied Somewhat
Dissatisfied
Somewhat
Satisfied
Satisfied
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 24/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00
Campus printers
Public computers in the library
Departmental/specialized computing labs
Campus computing labs
Student Service Importance - Campus Computing Labs
Not
Important
Somewhat
Important
Important Very
Important
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 25/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00 5.00
Online library catalog
Finding and evaluating information for your scholarship
Library databases (e.g. LexisNexis, JSTOR)
Search engines (e.g. Google, Yahoo)
Spatial analysis/GIS software (e.g. ArcGIS, Remote Sensing)
Presentation software (e.g. PowerPoint)
Course management system
Backing up data
Your primary Operating System (e.g. Mac OS, Windows)
Social software (e.g. Wiki, blog, podcasting, RSS)
Technology in meeting spaces/classrooms
Web authoring software (e.g. Dreamweaver, Contribute)
Audio/video editing software (e.g. iMovie, Premiere)
Solving computer problems
Instant Messaging
Graphics software (e.g. Photoshop, Elements)
Database software (e.g. Access, Filemaker)
Students Skills
Never
Used
Novice Basic Advanced Expert
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 26/32
ELI Slides – Smart Devices
misosurvey.org
34%
2%
11%
53%
Student Smart Device Ownership - 2012
No smart deviceTablet only
Smart phone and tablet
Smart phone only
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 27/32
ELI Slides – Smart Devices
misosurvey.org
22%
3%
18%
58%
Student Smart Device Ownership - 2013
No smart device
Tablet only
Smart phone and tablet
Smart phone only
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 28/32
ELI Slides – Smart Devices
misosurvey.org
39%
9%
21%
31%
Faculty Smart Device Ownership - 2012
No smart device
Tablet only
Smart phone and tablet
Smart phone only
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 29/32
ELI Slides – Smart Devices
misosurvey.org
24%
11%
38%
27%
Faculty Smart Device Ownership - 2013
No smart device
Tablet only
Smart phone and tablet
Smart phone only
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 30/32
ELI Slides – Smart Devices
misosurvey.org
1.00 2.00 3.00 4.00
Performance of wireless access on campus
Availability of wireless access on campus
Desktop/laptop computer replacement
Course management system support
Course management system
Timeto resolve desktop/laptop problemsStatus information on computing problems
Time to resolve classroom technology problems
Technology in meeting spaces/classrooms
Access to online resources from off-campus
Computing help desk schedule
Overall computing service
Email services
Support for technology in meeting spaces/classrooms
Wired network
ERP self serviceInput into computing decisions that affect you
Library e-book collections
Library support for scholarly research
Online library catalog
Interlibrary loan
Email SPAM filtering
Computing help desk
Virus protection
Library circulation services
Library databasesOverall library service
Faculty Service Satisfaction - Smart Device Owners
Dissatisfied Somewhat
Dissatisfied
Somewhat
Satisfied
Satisfied
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 31/32
ELI Slides – Smart Devices
misosurvey.org
33
19
0
Less Satisfied
No Difference
More Satisfied
0 5 10 15 20 25 30 35
Student Smart Device Owners - Service Satisfaction
7/27/2019 Does Change Equal Progress? Using Cross-Institutional Survey Data to Examine LMS Conversions and the Smart Device Explosion (215715218)
http://slidepdf.com/reader/full/does-change-equal-progress-using-cross-institutional-survey-data-to-examine 32/32
Presenters
• David Consiglio – Bryn Mawr College
• Kevin Creamer – University of Richmond
• Gentry Lankewicz Holbert – Spring Hill College
• Joshua Wilson –
Brandeis University• With thanks to Katherine Furlong
– Lafayette College