library assessment
TRANSCRIPT
![Page 1: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/1.jpg)
SCC/MLA 2007 Albuquerque, New Mexico
Library
Assessment:
From
Accountability
to
Improvement
![Page 2: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/2.jpg)
Introduction
•Instructors
•Agenda
•Objectives
•Attendees
Tell us:
Name
What you do
Where you work
Complete this sentence:
One year from today I will ………….
![Page 3: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/3.jpg)
Pre-Test
![Page 4: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/4.jpg)
Section 1: Overview
![Page 5: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/5.jpg)
Why are we here today?
• Background
• Evaluation
• Assessmentoutputs
about
outcomes
CHANGE.
Impacts
Library Assessment
inputs
It’s
![Page 6: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/6.jpg)
Is it evaluation or is it assessment?
![Page 7: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/7.jpg)
Program Evaluation
• Efficiency
• Effectiveness
• Accountability
• Inputs
• Outputs
• Outcomes
• ImpactIs this Library Assessment?
How do you measure your library’s success? Is it circulation numbers? Is it the number of patrons? The number of searches of your electronic databases? – Stranton Lloyd
![Page 8: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/8.jpg)
Outcomes Evaluation and Outcomes Assessment
Question has changed
• From What have we done to
accomplish our goals
• To What has changed as a result of
our work
![Page 9: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/9.jpg)
Library Assessment
“Old” Measures
• Program
Evaluation
• Efficiency
• Accountability
• Statistics,
numbers, data
“New” Measures
• Quality (e.g.,
service)
• Learner
Performance
• Improvements in
Student Learning“Regardless of the specific strategy selected by the institution, assessment strategies and methods should be adapted to the unique context of the institution to produce multiple indices of quality and effectiveness….” – Hernon and Dugan, 2004
![Page 10: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/10.jpg)
“Library assessment” is….
• Definitions
• Perspectives
• Experts
![Page 11: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/11.jpg)
Why should we care about assessment?
• Mouse cages
• Ejournals
![Page 12: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/12.jpg)
A Check
:-/
confused
>:/
bring it on
![Page 13: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/13.jpg)
Break
![Page 14: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/14.jpg)
Section II: Library Assessment in Higher Education• Primary performance indicator
• Differences among inputs, outputs,
and outcomes
![Page 15: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/15.jpg)
Activity 1
![Page 16: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/16.jpg)
Student Learning Outcomes and Technology
![Page 17: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/17.jpg)
Outcomes Assessment and Service Quality
• Assessing Organizations
• Assessment Tools
• LibQUAL+
![Page 18: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/18.jpg)
LibQUAL+™
• The LibQUAL+™ Premise
• What is service quality?
• Definition: difference between what
customers expect and their perceptions
of the service performance.
![Page 19: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/19.jpg)
Bar Charts
![Page 20: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/20.jpg)
2007 Core Questions Dimensions Summary
Affect of Service
Dimension
Information Control
Library as Place
4
5
6
7
8
9M
ean
Overall
![Page 21: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/21.jpg)
Quantitative and Qualitative Elements
• LibQUAL+™ Comments
Content Analysis and Atlas.ti
• Data file,Descriptive
Statistics,Reliability, and SPSS
![Page 22: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/22.jpg)
![Page 23: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/23.jpg)
A Tool
“LibQUAL+™ is ‘another tool in the
box’…it complements other
information you have about service
performance and quality” (Hiller)
Note: After the Radar Chart, Steve Hiller,
2002.
![Page 24: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/24.jpg)
Collecting statistics begins the road trip.
![Page 25: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/25.jpg)
Defusing Statistics
![Page 26: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/26.jpg)
Developing an Assessment Plan
Assessment Plan
Columbia University Libraries
2007 through 2009
![Page 27: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/27.jpg)
The Assessment Cycle
Interpret Evidence
Implement ChangeIdentify Outcomes
Gather Evidence
Mission/Purposes and
Objectives
Repeat the assessment cycle after changes have been implemented.
Source: Hernon and Dugan, 2004
![Page 28: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/28.jpg)
Obstacles to Assessment• No single model
• How do AHSL’s show impact? Improved
healthcare, reduced costs, increased access to
health information?
• Lack of adequate data-gathering systems
• Hard to compare results from disparate data
sources
• Lack of staff skills
• No support from library leadership
![Page 29: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/29.jpg)
The Value of Information
• How do you quantify the value of
information?
• What is the return on investment
(ROI)?
• Worth Their Weight
![Page 30: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/30.jpg)
Successful Assessment• Staff training
• Technical support and systems
• Focus on processes/services, not individuals
• Select the appropriate measures
• Realistic scope and schedules
• Senior leadership support
• Results are used in decision-making
![Page 31: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/31.jpg)
A Culture of Assessment
• Decision based on facts, research,
and analysis
• Staff are informed about results
• Change occurs based on results
![Page 32: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/32.jpg)
Pulling it Together
• The 21st Century Library is very different!
• User-centered libraries
• Outcomes assessment is complex
• Evaluation and assessment focus on
user/customer outcomes
• Assessment Toolbox
![Page 33: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/33.jpg)
![Page 34: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/34.jpg)
Do you have a culture of assessment?
![Page 35: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/35.jpg)
![Page 37: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/37.jpg)
By the end of this session you will be able to:• Define “culture of assessment”• Provide an example of an input, output,
impact, and outcome• Explain how assessment differs from
evaluation• List two examples of student learning
objectives• List two tools useful in library assessment• Describe two obstacles to assessment• List two elements to include in an
assessment plan• Be able to access the 2007 SCC/MLA CE
Course Ning
![Page 38: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/38.jpg)
![Page 39: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/39.jpg)
“The information acquired through library assessment is used in an iterative manner to improve library programs and services and make libraries responsive to the needs of their communities.” – Steve Hiller
“…accountability has shifted from ‘are we spending our money efficiently and wisely’ to ‘what difference does the library make?’” – Steve Hiller
Photo source: Charlotte Self
![Page 40: Library Assessment](https://reader033.vdocuments.site/reader033/viewer/2022060110/555ccbc0d8b42a64718b5993/html5/thumbnails/40.jpg)
Thank you.
• Other resources
• URL for Ning:
http://libassess.ning.com/
• Class Evaluation
• Survey