university metadata and retrieval: the death of the library catalog?

School of Information Studies, Faculty of Arts and Education

University Metadata and Retrieval:The Death of the Library Catalog?

Ying-Hsang LiuDC-2016, Copenhagen, Denmark

14 October 2016


Outline

• Background• Research Question• Relevant Studies• Summary of Eye-Tracking Study• Implications for Search Interface Design


Dr Liu’s research research interest lies in the area of user-centred design and evaluation of information retrieval systems.

Current research projects

• Natural Search User Interfaces for Complex Biomedical Search• Computational Intelligence for Complex Structured Data• Understanding the Role of Social Media in Disaster Management

Ying-Hsang Liu


Background: Vickery (1970)• Can we yet say that the benefit received is

commensurate with the effort of construction? … Even if controlled retrieval language and thesauri are useful, is their uncontrolled proliferation equally useful? (Vickery, 1970, pp. 136-137)

• Vickery, B. C. (1970). Document description and representation. Annual Review of Information Science and Technology, 6, 113-140.


Background (cont’d)

• Information retrieval researchers’ views: Salton, Sparck Jones

• Relative to automatic subject indexing, manual indexing is not cost-effective (Calhoun, 2006)

• Calhoun, K. (2006). The changing nature of the catalog and its integration with other discovery tools. Retrieved from https://www.loc.gov/catdir/calhoun-report-final.pdf


Research Question• Usefulness of controlled vocabularies• Svenonius (1986)

• Factors affecting the usefulness of controlled vocabularies, including the nature of the vocabulary, subject discipline, IR system, the skill of indexers and searchers and user requirements

• Svenonius, E. (1986). Unanswered questions in the design of controlled vocabularies. Journal of the American Society for Information Science, 37(5), 331-340


Relevant Studies• Hider et al. (2016)• Search effectiveness significantly

improved after reindexing

• Hider, P., Dalgarno, B., Bennett, S., Liu, Y.-H., Gerts, C., Daws, C., . . . Macaulay, R. (2016). Reindexing a research repository from the ground up: Adding and evaluating quality metadata. Australian Academic & Research Libraries, 47(2), 61-75.


Figure 1. System performance of initial and final queries by precision.

Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; PruMitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.DOI: 10.1080/00048623.2016.1204589Copyright © 2016 Australian Library & Information Association


Figure 2. System performance of initial and final queries by recall.

Published in: Philip Hider; Barney Dalgarno; Sue Bennett; Ying-Hsang Liu; Carole Gerts; Carla Daws; Barbara Spiller; PruMitchell; Robert Parkes; Raylee Macaulay; Australian Academic & Research Libraries 2016, 47, 61-75.DOI: 10.1080/00048623.2016.1204589Copyright © 2016 Australian Library & Information Association


Relevant Studies: Liu (2010a)• Liu (2010a)• Search experience overall has an overall

positive effect on the recall measure

• Liu, Y.-H. (2010a). A meta-analysis of the effects of search experience on search performance in terms of the recall measure in controlled IR user experiments. In F. Scholer, A. Trotman, & A. Turpin (Eds.), Proceedings of the Fifteenth Australasian Document Computing Symposium (pp. 105-110). Melbourne, Australia: School of Computer Science and IT, RMIT University.


Relevant Studies: Liu (2010a)


Relevant Studies: Liu (2010b)• Liu (2010b)• Assess the potential search effectiveness

of MeSH terms

• Liu, Y.-H. (2010b). On the potential search effectiveness of MeSH (Medical Subject Headings) terms. In Proceedings of the Third Symposium on Information Interaction in Context (IIiX '10) (pp. 225-234). New York: ACM.


Relevant Studies: Liu et al. (2016)


Visual Search Behaviour


GazeSpot on Search Interface


Search Interfaces and Gaze


BeeSwarm Visualisation of Cognitive Styles

The video is available at:

https://vimeo.com/182044662#t=203s


Implications for Interface Design• Search interfaces have significant effect on

eye gaze behavior for complex search tasks• Experienced searchers attracted to suggested

keywords, displayed alongside each document

• Domain experts and analytic users attracted to suggested keywords, displayed under a search box


Questions or comments?

Thank You!

Email: [email protected]: http://csusap.csu.edu.au/~yingliu

university metadata and retrieval: the death of the library catalog?

Data & Analytics