assessment for the rest of us: informal techniques you can use
Upload: library-leadership-amp-management-association-llama-american-library-association-ala
Post on 29-Nov-2014
2.292 views
DESCRIPTION
Program conducted by LLAMA - MAES at ALA Annual 2010.Informal assessment techniques can be used to quickly evaluate and improve services throughout the library. This fast-paced program features presenters from 8-10 libraries who will share various types of informal assessment, the time commitment required, and how assessment led to service improvements throughout the library. Attendees will gain an understanding of how informal assessment can be incorporated into decision-making at all levels and lead to a culture of assessment.TRANSCRIPT
![Page 1: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/1.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessment for the Rest of Us: Informal Techniques You Can Use
Program Co-chairs: • Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas• Jan Lewis, Associate Director, East Carolina University
Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library Managers Committee
![Page 2: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/2.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Our Student Scholars Said What???
Oklahoma State UniversityKaren Neurohr, Associate Professor, Assessment LibrarianJennifer Paustenbaugh, Ph.D., Associate Dean for Planning and Assessment
A 12-Question survey followed by an informal focus group luncheon were fairly easy techniques for discerning what a group of undergraduate student scholars know and think about the library.
![Page 3: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/3.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Student Scholars and the LibraryOklahoma State University- Land-grant;
ARL Library, serving 22,845 studentsAssessment activity: Survey and Informal
Focus GroupPopulation: Undergraduate research
scholarsTime Commitment: 4 hoursFindings: Several interesting discrepancies
between survey results and comments
![Page 4: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/4.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Let them try it before you buy it
Louise L. Lowe, Assistant ProfessorPublic Services Librarian
Judith D. Brook, Associate ProfessorAssociate Dean of University Libraries and Director
Mercer University, Atlanta
Conducting demonstrations and trials can help libraries get the biggest bang for their buck. Students test, evaluate, and recommend products and libraries make informed purchases.
![Page 5: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/5.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Let them try it before you buy itWho we are… Mercer University, Atlanta Campus Approximately 2,500 graduate and professional students Approximately 4,000 library visitors per week
What we did… Conducted trials or demonstrations; allowed 1 - 2 weeks for feedback Tested equipment like netbooks, adjustable monitors and keyboards,
etc. Taste test for new coffee vending
What we learned… ‘Good value’ is important to student Students are willing to make compromises Students want to be involved
![Page 6: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/6.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Unobtrusive User Observation as Assessment Technique: What are Students Doing in the Library After Hours
Kornelia Tancheva, Director of John M. Olin Library and Uris Library, Cornell University
Study of User Behavior in Uris Library, open 24/7
![Page 7: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/7.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Student Behavior in the Library After Hours
Cornell U Library; Uris: former “undergraduate library”
Unobtrusive observationSurvey population: undergraduate
studentsModerate Time CommitmentFindings: use of spaces, use of
technology; service requirements
![Page 8: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/8.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Why Isn’t Our Chat Reference Service Used More Often?
Sharon Naylor and Bruce StoffelEducation Librarian and Reference CoordinatorIllinois State University
Exploring patron attitudes and behavior through focus groups
![Page 9: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/9.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Why Isn’t Our Chat Reference Service Used More Often?
Who we are... 21,184 students (87% undergraduates) 1.6 million volumes, 43,000 annual patron transactionsWhat we did... Conducted 7 focus groups, August-December 2005 Involved 45 sophomores, juniors, seniors Each group discussion lasted about 90 minutes What we learned...• Desire for reference services that are personalized• Support for a variety of reference venues not just IM/chat• Preference for familiar, reliable technology
![Page 10: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/10.jpg)
The CalArts’ Student Behaviors and Habits (CASBAH) Project
Jeff Gatten, Dean of Library and Information Resources at California Institute of the Arts
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Poster surveys were used to generate a wealth of instant and practical feedback with minimal effort.
![Page 11: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/11.jpg)
The CalArts’ Student Behaviors and Habits (CASBAH) Project
Arts college (BFA, MFA, DMA)1,399 Students ◦ 60% undergrad. & 40% grad.◦ 51% female & 49% male
Poster surveys in the Library3-4 hours to compile & organize dataFindings: Most desired = easy changes to
environmentLLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
![Page 12: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/12.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Challenging Assumptions: Chatting with Patrons
Rachel Besara, Assessment LibrarianKirsten Kinsley, Assessment LibrarianFlorida State University Libraries
The information gathered challenged many of the assumptions held about undergraduate students.
![Page 13: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/13.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Challenging Assumptions: Chatting with PatronsFlorida State University (Carnegie
Foundation Rated Doctoral/Research Extensive University)
Short Survey/Interviews167 Undergraduate Students on & off
campusOne MonthDiscovered nuanced student study habits
![Page 14: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/14.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessing Community Usersin an Academic Library
Wanda V. Dole, Dean Ottenheimer Library, University of Arkansas at Little Rock
J. B. Hill, Director of Public ServicesOttenheimer Library, University of Arkansas at Little Rock
The Ottenheimer Library recently conducted a quantitative/qualitative assessment of its unaffiliated library users.
![Page 15: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/15.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessing Community Users University of Arkansas at Little Rock
◦ Metropolitan university with 13,000 students◦ Carnegie Research Extensive University
Quantitative Data ◦ Analysis of Millennium and Uniprint patron records
Qualitative Data ◦ Survey of unaffiliated library users registered for circulation of
Internet privileges Limited Time Commitment - ~80 hours Findings
◦ Two distinct user populations – behaviors & needs◦ Casual affiliations with university◦ Privileges created good will toward university◦ Result in review of unaffiliated user policies/services
![Page 16: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/16.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
“Flip” the Library
Ameet DoshiUser Engagement Librarian and Assessment CoordinatorGeorgia Institute of Technology Library
Video Assessment at Georgia Tech Library
![Page 17: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/17.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Flip Camera Assessment: Fast, Cheap, Easy
Georgia Tech Student Culture: Hands-on, interactiveLibQUAL 2010: 88% of Undergrads use facility
regularlyVideo Assessment of Library FacilityStudent Library Advisory Board1 hour (prep/shooting/recap) and 2-4 hours editingUseful to… ◦ View experience from user perspective◦ Assess completed or discuss proposed renovations◦ Discover emerging problems◦Web usability
![Page 18: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/18.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
![Page 19: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/19.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
MIT Libraries’ Book(cart)mobile: Assessing its Value
Lisa R. Horowitz, Assessment Librarian, Massachusetts Institute of Technology
The MIT Libraries’ Humanities and Music Libraries surveyed users and staff to determine if the benefits of undertaking a monthly bookmobile outweighed its staffing costs.
![Page 20: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/20.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
MIT Libraries’ Book(cart)mobileMIT: 10,000 students; 10,000 faculty and
staffFive main libraries – Bookmobile is
specific to Humanities and its branch, Music
Two survey instruments: user survey and staff interviews
Data gathered over two and half months, March to May 2009
![Page 21: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/21.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Observation and Mapping
Kathy RayUniversity LibrarianAmerican University of Sharjah
Observing student behavior helped us achieve a better balance between high
and low use study spaces
![Page 22: Assessment for the Rest of Us: Informal Techniques You Can Use](https://reader035.vdocuments.site/reader035/viewer/2022070302/547dafe6b37959652b8b52ed/html5/thumbnails/22.jpg)
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Observation and MappingAUS – 5,000 students primarily undergradCoed environment new for majorityIncredibly active/high traffic zone in the
middle of preferred high use study spaceObservations over 5 week period30 minutes 3 times per weekReconfigured mix of carrels, tables,
browsing collections & displays for better balance of quiet and active zones