quality frameworks in academic librariesold.libraryassessment.org/bm~doc/murphy_sarah_2012.pdf ·...
TRANSCRIPT
![Page 1: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/1.jpg)
Quality Frameworks
in Academic Libraries Sarah Anne Murphy, MLS, MBA
Coordinator of Assessment
The Ohio State University Libraries
![Page 2: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/2.jpg)
Statistics
![Page 3: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/3.jpg)
Assessment
Statistics
![Page 4: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/4.jpg)
Assessment
Statistics
Measurement
![Page 5: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/5.jpg)
Assessment
Statistics
Measurement
Metrics
![Page 6: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/6.jpg)
Assessment
Quality
Improvement
Statistics
Measurement
Metrics
![Page 7: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/7.jpg)
Assessment
Quality
Improvement
Evaluation
Statistics
Measurement
Metrics
![Page 8: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/8.jpg)
Assessment
Quality
Improvement
Evaluation
Outcomes
Statistics
Measurement
Metrics
![Page 9: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/9.jpg)
Assessment
Quality
Improvement
Impact
Evaluation
Outcomes
Statistics
Measurement
Metrics
![Page 10: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/10.jpg)
Assessment
Quality
Improvement
Impact
Evaluation
Evidence-Based
Outcomes
Statistics
Measurement
Metrics
![Page 11: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/11.jpg)
Balanced
Scorecard
![Page 12: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/12.jpg)
Balanced
Scorecard
Lean
![Page 13: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/13.jpg)
Balanced
Scorecard
Lean
Six Sigma
6σ Measure
Define
Analyze
Improve
Control
![Page 14: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/14.jpg)
Balanced
Scorecard
Lean
Six Sigma
Baldrige
6σ Measure
Define
Analyze
Improve
Control
![Page 15: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/15.jpg)
Balanced
Scorecard
Lean
Six Sigma
Baldrige
ISO9001
6σ Measure
Define
Analyze
Improve
Control
![Page 16: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/16.jpg)
Balanced
Scorecard
Lean
TQM
Six Sigma
Baldrige
ISO9001
6σ Measure
Define
Analyze
Improve
Control
![Page 17: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/17.jpg)
Quality Frameworks • Do academic libraries
utilize established
quality improvement
frameworks?
• Have academic
libraries adopted
elements of such
programs?
• Are academic
librarians interested in
learning more?
![Page 18: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/18.jpg)
An Established
Framework has: • A system for identifying, prioritizing, and
organizing assessment
projects/activities
• Support from library leaders for
gathering and utilizing data
• Budget/Financial support
• Dedicated staff
![Page 19: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/19.jpg)
The System has a
Methodology to: • Define project scope
• Select appropriate research
methodologies to identify situations
where customer requirements are not
being met
• Select appropriate research
methodologies to determine process
capability
![Page 20: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/20.jpg)
The System has a
Methodology to:
• Analyze results and identify potential
root causes for identified issues
• Develop, pilot, evaluate, and implement
potential solutions to solve issues
• Sustain the improvement
![Page 21: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/21.jpg)
The Survey
•Distributed to 536 academic libraries
•158 returned (29.5% response rate)
![Page 22: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/22.jpg)
Only 8 libraries indicated
they utilized an
established quality
improvement
framework!!!!!
![Page 23: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/23.jpg)
An Established
Framework has: • A system for identifying, prioritizing, and
organizing assessment
projects/activities (36, 24.0%)
• Support from library leaders for
gathering and utilizing data
• Budget/Financial support
• Dedicated staff
![Page 24: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/24.jpg)
The System has a
Methodology to: • Define project scope (23, 63.9%)
• Select appropriate research
methodologies to identify situations
where customer requirements are not
being met (31, 86.1%)
• Select appropriate research
methodologies to determine process
capability (20, 55.5%)
![Page 25: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/25.jpg)
The System has a
Methodology to: • Analyze results and identify potential
root causes for identified issues (30,
83.3%)
• Develop, pilot, evaluate, and implement
potential solutions to solve issues (28,
78.8%)
• Sustain the improvement (27, 63.9%)
![Page 26: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/26.jpg)
An Established
Framework has: • A system for identifying, prioritizing, and
organizing assessment
projects/activities (36, 24.0%)
• Support from library leaders for
gathering and utilizing data (151,
95.6%)
• Budget/Financial support (70, 44.3%)
• Dedicated staff (83, 52.5%)
![Page 27: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/27.jpg)
Positions
Responsible Assessment
Coordinator
-Assessment Director
-Assessment Librarian
-Coordinator of
Assessment
-Director of Library
Assessment
-Library Assessment
Coordinator
(n=17)
Administration
-Assistant Director for
Assessment
-Associate Dean for
Library Services
-Associate Director
-Dean of University
Libraries
-Director of Libraries
(n=21)
![Page 28: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/28.jpg)
Positions
Responsible Assessment
Coordinator
-Assessment Director
-Assessment Librarian
-Coordinator of
Assessment
-Director of Library
Assessment
-Library Assessment
Coordinator
(n=17)
Administration
-Assistant Director for
Assessment
-Associate Dean for
Library Services
-Associate Director
-Dean of University
Libraries
-Director of Libraries
(n=21)
![Page 29: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/29.jpg)
Positions
Responsible Assessment
Coordinator
-Assessment Director
-Assessment Librarian
-Coordinator of
Assessment
-Director of Library
Assessment
-Library Assessment
Coordinator
(n=17)
Administration
-Assistant Director for
Assessment
-Associate Dean for
Library Services
-Associate Director
-Dean of University
Libraries
-Director of Libraries
(n=21)
![Page 30: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/30.jpg)
Positions
Responsible Assessment
Coordinator
-Assessment Director
-Assessment Librarian
-Coordinator of
Assessment
-Director of Library
Assessment
-Library Assessment
Coordinator
(n=17)
Administration
-Assistant Director for
Assessment
-Associate Dean for
Library Services
-Associate Director
-Dean of University
Libraries
-Director of Libraries
(n=21)
![Page 31: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/31.jpg)
Positions
Responsible Committee
-Chair, Library
Assessment Committee
-Chair, User
Assessment Group
-Planning and
Assessment Team
(n=17)
Dual Role
-Coordinator of Reference
Services and Library
Assessment
-Head of Public Services
-Instruction and
Assessment Coordinator
-Serials & Assessment
Librarian
-Web Librarian
(n=23)
![Page 32: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/32.jpg)
Positions
Responsible Committee
-Chair, Library
Assessment Committee
-Chair, User
Assessment Group
-Planning and
Assessment Team
(n=17)
Dual Role
-Coordinator of Reference
Services and Library
Assessment
-Head of Public Services
-Instruction and
Assessment Coordinator
-Serials & Assessment
Librarian
-Web Librarian
(n=23)
![Page 33: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/33.jpg)
Positions
Responsible Other
-Data Analyst
-Data Specialist
-Planning and Assessment Officer
-Process Improvement Specialist
-Service Quality Librarian
-User Experience Librarian
(n=23)
![Page 34: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/34.jpg)
Concluding Thoughts
•The array of terminology utilized to
describe efforts to study the
effectiveness of services and programs =
a conversational challenge
•A conceptual framework for defining
library assessment for higher education
is needed
![Page 35: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/35.jpg)
Angela van Barnevald, Kimberly E. Arnold, and John P. Campbell, Analytics in Higher Education: Establishing a Common
Language, ELI Paper 1 (Louisville, CO: 2012), http://net.educause.edu/ir/library/pdf/ELI3026.pdf
![Page 36: Quality Frameworks in Academic Librariesold.libraryassessment.org/bm~doc/Murphy_Sarah_2012.pdf · Quality Frameworks in Academic Libraries Sarah Anne Murphy, MLS, MBA Coordinator](https://reader033.vdocuments.site/reader033/viewer/2022051901/5ff0088df06a5e295200f6d6/html5/thumbnails/36.jpg)
Concluding Thoughts
• Libraries are starting to formally or
informally utilize quality frameworks to
structure or organize their assessment
programs.
• Human, financial, and capital
investment imperative to establish a
program which realizes sustained
change.