discovery in 2020: trends and user behaviors
TRANSCRIPT
Discovery in 2020: Trends and User Behaviors
William H. Mischo Michael A. Norman Mary C. Schlembach Jason Heldreth Grainger Engineering Library Information Center University of Illinois at Urbana-Champaign [email protected] [email protected] CNI 2020 May 21, 2020
LibraryDiscoveryRemainsataCrossroadsAcademiclibrariesshouldstepbacktoreconfirm(orreconsider)theirvisionfordiscovery,toensurethattheirvisionsconnectwithinforma<on-seekingprac<cesandpreferences,andtodeterminewhethertheyhaveaviablestrategyinplace.
-RogerSchonfeld,IthakaS+R,2014
Nowisthe<meforarevolu<onindiscovery.-CatherineColeman,StanfordLibrary,2018Thesystemswebuy…willrequireafundamentalre-orienta<ontotheneedsoftheacademicuser,andsimilarlyafundamentalre-architectureandre-configuring….
OhioLINKwhitepaperonDiscoverysystems,2020
OhioLINKWhitePaper• Earlierpresenta<onatCNI2020• “It’sNotWhatLibrariesHold;It’sWhoTheyServe”:Roger
SchonfeldandXuemaoYang• Vision:
– EveryILSsystemiscenteredaroundthecollectionofalibrary;systemsmustbecompletelyre-architectedtocenterontheuser
– Systemsmustprovideacoordinatedmixoflocal,external,andcollaborativeservices(facilitatedcollection)
– Librarysystemsmustintegrateeffectively--onaserviceanddatelayer--withotherresearch,teaching,andlearningsystems
– Librarysystemsmustprovidemodernbusinessintelligencecapabilitiesforindividualandconsortiallibraries
FullLibraryDiscovery
• CoinedbyLorcanDempsey2013
• Accessinrela<ontoDiscoveryandDiscoverability• Discoveryshouldcontainfeaturesthatmovebeyondthe
retrievalofcollec<onmaterials:includeslocalinforma<onservicesandcontent
• Includeslibrarywebsites,localLibGuideinforma<on,subjectspecialistlinks,coursemanagementsystemcontent,etc.
• Goalistobundleandinterconnectrelatedinforma<onservices
HistoryofModernDiscoveryOverthelast30years:
– SupercatalogswithA&Iservicesloaded
– Federatedsearch:broadcastsearch
– Web-ScaleDiscoverySystems(WSDS)withmetadataandfull-textcontentaggregatedintoasingleconsolidatedindex
– Hybridbentostylesystemswithinformationresultdisplayspresentedinazonedorpartitionedscreendisplaywithcontentgroupedbytype/material
Web-ScaleDiscoverySystems
• RichliteratureonWSDS;BibliographybyFrancoisRenaville(Liege)
• WSDSIssues:– Confusionwithblendedresultsdisplays– relevancyrankingsburyingknown-items– inadequateaccesstolocallibraryservices– Needtobetteraddressknown-itemsearching– Needtoexpediteaccesstofull-text
BentoAdvantages• Par<<onsresultsbymaterialtype/format• AddressesWSDSissues:blendedresults,relevancyranking
problems,known-itemaccess• Fulllibrarydiscoveryfeatures;insideout&localinforma<on
servicesandcontent– Librarywebsites,pathfinderinformation,localservices,subjectspecialistlinks,CMScontent
• Oneclicklinkstofull-textortopublisherpresenta<onpages(bypasslinkresolver)
Searchformaterialsdiscoveryandmachinelearning
Searchfortensilepropertyandmachinelearning
Illinois Bento Box Discovery Model Search:
Ar<cles(EBSCOEDSAPI)10Results
Seeallmatches46EBSCOEDSTargets
EBSCOPDFlinks,DOI,Publisher,Catalog.Scopuslinks
AltmetricA7en9onBadges–Scholixdatasetlinks–UnPaywallopenlinks-BrowzinePDF
andIssueTOC
Keywords6 {searchterms} GO
Sugges9ons:
Directlinkto{searchterm}LookattheJournalsordatabasesthatmatchthissearch.DOIdirectlinkLimitthissearchto9tlewordsLibguidesLinkResearchStarters(EBSCO)LinkAskaLibrarianonlinechatlink
ClassicEasySearchLink
Addi<onalAr<cles:ScopusisdefaultbutalsoselectedEBSCOtargetsorEngineering
Village,IEEE
5ResultsSeeallmatches
DOIlinksAltmetricA7en9onBadges–Scholixdatasetlinks–UnPaywallopenlinks-
BrowzinePDFandIssueTOC
LibraryCatalog(VuFind)
10ResultsSeeallmatches
Directlinkstofull-text
SubjectSugges<onsTwoSubjectDisciplinaryDatabasematches&linkstocompletedsearch
RelevantDepartmentalLibraryLibrariancontactGeneralSearches
BingWebSearchResults
5matchesFilteredResults:TechnicalReports,
LibraryWebPagesURL’sproxiedwhenpossible
Adver<seLibraryServiceClickimage
SecondCenterDisplayAreaforResources
5-10ResultsSeeallmatches
Directlinkstofull-text
IllinoisBentofeatures• Context-specificandadap<vesearchassistance
– Spellingsuggestions,Libguidelinks,directlinksforfrequentsearches,limitsuggestions,DOIidentification,onlinechatlink,journaltitlelinks
• DirectlinktoPDFwhenavailable• DOI,publisher,OpenURL,customvalue-addedlinks• RelevantsubjectdisciplinaryA&Ilinksthatopenatpointof
completedsearch• Librariananddepartmentallibrarysubjectcontacts
IllinoisValueAddedFeaturesoverArticleAPIs
• Augmen<ngEBSCOandScopusAPIresultsasynchronously(viathear<cleDOIsfromtheAPIs):-ClickableAltmetricBadgesgivingaken<onscores-Scholixderiveddatasetandar<cledatalinks-UnPaywallopenaccesslinksshowingOAar<cles-BrowzinePDFlinksandissueTOClinks
Alsosearchassistancelinks,DOIdetec<onlinks,BingAPIlinks,SubjectA&Icompletedsearchresults,librariancontactlinks
BentoLibraries• NCSU,Illinois-UIUC,Michigan,Duke,Stanford,Columbia,Princeton,JohnsHopkins,Virginia,Villanova,Toronto,Cornell,NorthCarolina,Penn,Brown,Oklahoma,MIT,Texas,OhioState,PennState,MichiganState,GeorgiaTech,Yale,SouthernCalifornia,BostonCollege,Alabama,SimonFraser,SmithCollege,Illinois-Chicago,Temple,WakeForest,Clemson,SanDiegoState,NorthTexasState,NorthCarolina-Wilmington,EastTennessee,UCRiverside,LibertyUniversity,WayneState,MountHolyokeCollege,AcadiaUniversity,PrinceEdwardIsland,Na<onalLibraryofAustralia
BentoFeatures• Monitoring42academiclibrarieswithbentoinstances
– 10librarieshavedroppedbento,7arePrimoinstallations– AllhaveBooksandArticlesareas– WSDSforarticles:21Summon,10Primo,10EBSCOEDS
• Websitesearch=34• Library/researchguides=24• Journaltitles=20• Databases=23• Digitalcollections=12• Manuscripts/Archives=9• Dissertations/Theses=3• InstitutionalRepository=3• CourseReserves=3• FAQ=6• Contacts=18
BentoObservations• Featuresetsvary;manybentoversionsdonotdospellcheckinganddonotprovidetop-leveldirectlinkstofull-text
• Onlythreeemploytheone-clicktofull-textw/ogoingthroughlocallinkresolver
• OPACmaybeseparateapplica<on:VuFind,Blacklight• Havelocalcontrolandcustomiza<on• But,requiresprogramming/serverstaffandmaintenance…APIprocessing
• Needforcatalogitemavailabilityanddirectlinkstoebooks
EasySearchCustomTransactionLogs Instrumentedtorecorduserac<ons,systemsugges<ons,searchreformula<ons,andclickthroughs• Iden<fysearchsessions• Collected11yearsoflogs:16.5millionsearchesand15.8millionclickthroughs
• Lateststudy:May2017–April2018:2.75millionac<ons,1.51millionsearches,incl1.1millioninbentosystem
• Sampleof5,400searchesanalyzedfortypeofsearch(known-itemvs.Exploratory),successrate,userbehaviors
TransactionLogStudy2018 • Averagewordsperquery=6.1-upfrom5.6,5.1,4.1,3.8inpreviousanalyses)• 9.1%areoneword,44.9%are3orless,28.7%are7ormore,20.5%are9wordsormore
• Copyandpastesearching
• 2.07searchespersession.60%ofsessionsareonesearch• In21.8%ofsearches,asearchsugges<onwasoffered;thesugges<onwasclicked28.1%ofthe<me.Mostpopular:“didyoumean”spellingsugges<onsandtheDirectSugges<onlinks
TransactionLogStudy2018
• DOIsearches(76searchesperday)andgrowing• Inthesampleof5,400searches:
• Known-itemsearches=64.7%,upfrom56%in2014-2015study.Includes<tleword,author/<tle,fullcita<on
• 1.5%ofthesearcheswereknowncita<onsearches.Thatextrapolatesto45perday
User Clickthroughs by Category Percentages
Article links 57.1%
OPACs (VuFind and I-Share) 34.4%
Suggestions 5.85%
Added Links 2.3%
Subject DB Links 0.33%
Library links or contacts 0.114%
Clickthrough Actions • April2020:141,784searches,3770clicksperday• FullTextclicks:1600perday,41.7%ofallclicks• Browzine-PDF:224perday,TOC:5perday• Bing-102clicksperday• “DidYouMean”spellingsugges<on-54.7perday• Unpaywall-20perday–increasingsinceremoteteaching• DirectLinkSugges<ons–20perday• AtoZJournallist-19.3perday• Dataset(Scholix)-6.2perday• AskaLibrarian-4.3perday• EmailaSubjectLibrarian–1.9perday• ClickinganAd-1.8perday
2019EasySearchUserSurvey
• November2019,IRBapproved:username,e-mailaddress,majorordepartment,status(undergrad,grad,faculty,staff),typesofmaterialstheywerelookingfor,theirfrequencyofuseofEasySearch,andopen-endedcomments
• 483responseswith230usersprovidingcomments• 24%oftherespondentsweredailyusersofEasySearchand81%
weredailyorweeklyusers• Highlevelofsa<sfac<on• Deliveryoffull-textisparamount;concernswereaboutjournal
holdings,full-textlinks,knownitemsearchresults
ChallengesinDiscovery
Ques<ons:– Shouldlibrariesbethestartingpointforusersseekingscholarly
content?ITHAKAS+Rsurveyquestion:HowimportantistheGatewayfunction?
– Havelibrarysystemsalwaysplayedasupplementaryroleintopicalsearch/exploration?
– Shouldthelibraryfocusbeonaidingknown-itemdiscoveryandeffectivecontentdelivery?
NextSteps• Augmentdisplayedrecords(asynchronouslyviaAPIs):
– Addi<onalOArecordsfromGS,OpenAccessBukon,etc.– AddImpactFactor,Eigenvalue,CiteScoreevalua<vedata– Addci<nginforma<on
• Mega-IndexandSpecialtyDiscoveryUsage• MachineLearning,AItechniques• Integra<onofcomplementarydigitalservices
– LinkedOpenData– Datamanagementservices– Publica<onmetrics&visualiza<ons– Coursemanagementcontent– Facultyprofilesystemanaly<cs
UniversityofIllinoisLibraryImplementingPrimoVEasonlinecatalog
! InJune2020,theUniversityofIllinoisLibrarywillbemigratingtoExLibris’sAlmaandPrimoVEsystems.! NewdeploymentmodelthatcombinesthebackendprocessesofbothAlmaandPrimoVEintooneintegratedplatform.! TheLibrary’stransitiontothenewsystemisinconcertwithall91I-SharelibrariesintheConsortiumofAcademicResearchLibrariesinIllinois(CARLI)
WhatkindofasystemsareAlmaandPrimoVE ! Almaisaunifiedresourcemanagementsystem
thatallowslibrariestheabilitytomanagetheirprintandelectronicresourcesandservicesinasingleenvironment
! Foranelectronictitle,Almacreateselectronicinventory(portfolios)thatpermeatesAlmaandassociatestheelectronicaccessinPrimoforallinstancesitcanmatch.
! AlmahasaNetworkZonethattakesoverthefunctionoftheunioncatalog.
NetworkZoneinAlmaandPrimoVE ! TheNetworkZoneinAlmaisbuiltusingafirst-inpremise.That
is,thefirstcopyofarecordthatgetsaddedbecomesthe"master”recordfortheconsortium.
! ThismasterrecordisasharedbibliographicrecordthatwillbelinkedtoyourlocalrecordsinyourInstitutionZone.
! MuchofourlocaldatawasnotmigratedoverfromVoyagertothemasterrecordintheNetworkZone.
! Wearecurrentlydoinglotsofcustomizationtore-introduced! ourlocalinformation! LocalizedURLstoelectronicresourcespopulatethisshared
MasterRecord.ThisisproblematicforUniversityofIllinoisuserswantingtonavigatetofull-textcontent.Also,majorissueforlinkinginEasySearch.
EasySearchBentotoremainastheLibrary’sPrimaryDiscoverysource
! EasySearchBentowillremaintheLibrary’sprimaryanddefaultdiscoveryserviceavailableasthesinglesearchboxontheLibrary’sWebPage.! PrimowillreplaceVuFindasthecatalogsearch.! WearetestingutilizingcertainfeaturesofthePrimoCentralIndexincludingcreatingaseparateNewspaperPrimoSearch.! ContinuedbenefitsofseparateBentozonesforthevariousareasofsearchresultsforarticles,books,subject-basedresults,andBingacademicwebresults
EasySearchtheDefaultLibrary’sDiscoveryLayer
https://www.library.illinois.edu/
EasySearchBentowithPrimoCatalogResults
Possibilities-EasySearchBentoforPrimoNewspaperArticles
APIIssues
! WearecurrentlyusingthePrimoSearchAPItopullinresultsfromthePrimoLibraryCatalogintoEasySearchBento.! WeareverypleasedwithhowquicklyresultscomeinfromVuFind.Itaverages1-2secondsresponsetime.! WiththePrimoSearchAPI,weareencounteringsomeslownessinperformance.Itisaveragingabout10-11secondspersearch.Manycommentsfromtestersaboutslowness.! APIperformancewithPrimoCatalogneedstobeoptimizedandimprovedtogainfullbenefitsofdiscoveryinEasySearchBento