Unraveling the (search) stringAssessing library discovery layers
using patron queries
Robert Heaton Collection Management Librarian
Liz W oolcott Head of Cataloging & Metadata Services
Library Assessment Conference 20 20 โ20 21
@LizW oolcott#LAC20
Institutional context
Location: Logan, UtahFTE: 22,0 72 (fall 20 20 )Budget: $12 million, $6 million materialsILS+discovery tool: Sierra+Encore Duet
Introduction
Research questions
W hat are usersโ general strategies? (W hat are they doing?)How effective are usersโ searches? (Is it working?)
Introduction
Methods
Data scraped: from Encore Duet, 3,60 4 URLs visited and the corresponding 68,0 22 search results
Dates collected: 3 days in Fall 20 19Tools used: Google Analytics, Airtable, OctoparseCoding objectives: URL content, search queries, known items
Introduction
General observations: Type of searchFindings
Macroeconomics: Private and Public
Choice by Gwartney, Stroup, Sobel, and Macpherson 15th
edition
John Steiner
Shanghai International Settlement
mozart piano sonata no 18 in
d major milgram
kenneth heineman
campus wars
leaf NDVI transmission
traffic analysis logan utah
nouns
https:/ / ...
Findings General observations: Search timing
User strategies: Overview
Search term adjustments ๐๐Selection of facets ๐๐Use of advanced search ๐๐
Findings
User strategies: OverviewFindings
User strategies: Search term adjustmentsFindings
1
2
3โฆ
๐๐
User strategies: Search term adjustmentsFindings ๐๐
User strategies: Search term adjustments (continued)
Findings ๐๐
User strategies: FacetsFindings ๐๐
User strategies: FacetsFindings ๐๐
User strategies: Facets (continued)Findings ๐๐
User strategies: Facets (continued)Findings ๐๐
User strategies: Facets (continued)Findings ๐๐
User strategies: Facets (continued)Findings ๐๐
User strategies: Advanced searchFindings ๐๐
User strategies: Advanced searchFindings ๐๐
User strategies: Advanced search (continued)
Findings ๐๐
User strategies: Advanced search vs. facets
Findings๐๐
๐๐
Search effectiveness: Search- term adjustments
Findings ๐๐
Search effectiveness: Advanced searchFindings
43.7%incorrect usage
of Advanced Search
๐๐
Search effectiveness: Number of results
W ith No Article Results Availableโฆ
Average no. of resultsper page decreasedby
35%
Findings
53%of searches returned
0 results
Search effectiveness:Comparison of search strategy use
Findings ๐๐
๐๐
Search effectiveness: DiscoverabilityFindings
Search effectiveness: Discoverability & deliverability
Discoverability vs. Deliverabilityof Known Items
Findings
Available
Yes No
Appeared in Results
Yes 40 6 57
No 61 84
Search effectiveness: DeliverabilityFindings
Search effectiveness: DeliverabilityFindings
User strategies
Known item only searches
Topical only searches Both
Average # pages visited 2 pages 4 pages 7 pages
Average search session time 3 minutes 7 minutes 14 minutes
Uses facets 10 .6% 31.3% 25%
Uses advanced search 5.31% 10 .8% 15%
Uses search term changes 22.0 8% 40 .66% 82.5%
Discussion
User Engagement and Strategies by Search Type
Search effectivenessDiscussion
Common search strategies are successful
Strong relevancy ranking of known items
User searches are suited to web- scale discovery Users want full text
Electronic access is relatively seamless; some physical circulation
Unanswered questions
How much do tool defaults influence search strategy?W hat user behaviors would likely be consistent no matter the tool?How can we reduce specific types of failed searches?Did users find the best resources, especially in topic searches?How effective is our collection of materials (apart from discoverability)?
Discussion
Taking actionConclusion
Current implementation
Instruction and support
Exploring alternatives
User needs
User strategies
Success metrics
Relevant Domains
Insights from Our Research