NC State University Libraries Search Usability TestingJanuary 2010ALA Midwinter ConferenceJosh Boyer & Susan Teague Rector

1

Who We Are

Susan Teague Rector Web Design Project Librarian Twitter: seteague

2

Josh Boyer Associate Head, Distance Learning

and Research and Information Services

Today’s Agenda Background

Usability Test Methodology

Testing Results

Implementation of Search

Search Usage

Next Steps3

Background Website Redesign January – August 2010 whose

main goal of site design was to emphasize and streamline search across the site

Team of 9 librarians appointed to look at the website’s search environment

Building materials: Endeca-based catalog interface Summon Journal Titles list site search “QuickSearch”

4

5

www.lib.ncsu.edu/search/?q=xml

6

www.lib.ncsu.edu/search/?q=gis

7

How about Tabs?

Research Questions How would users interact with a tabbed search

interface?

Would users choose to scope their searches by preselecting a tab before beginning a search or would they conduct all searches in the default “all” tab?

How successful would users be in selecting the correct tab for the task?

8

Search Prototype

9

2 Search Prototypes

10

Model 1Tabbed Search Results

Model 2Non-Tabbed Search Results

Our Methodology “Guerrilla” usability testing in the field

Participants recruited in the lobby of DH Hill Library

Testing took place over a 3 hour period

28 undergraduates, graduates and library staff, participated in a round of guerrilla usability testing for 2 proposed search models

Each participant was asked to complete 2 tasks using one of the search models; many participants volunteered to answer more than 2 questions 11

Who Were the Participants? 22 Undergraduates 3 Graduates 2 Library Staff Members 1 Non-Traditional Student

Represented:• Humanities:

• English/Creative Writing• History• Psychology

• Business:• Business• Business Administration

• Science/Engineering:• Aerospace Engineering• Animal Science/Biology• Biology• Biomedical Engineering• Chemistry• Civil Engineering• Computer Science• Electrical Engineering• Food Science• Human Biology/Nutritional Science• Integrated Management & Systems• Meteorology• Textiles Engineering

12 14 participants performed 46 tasks using Model

1 14 participants performed 38 tasks using Model

2

Observations

In both search models, in well over half the tasks, participants pre-selected a search tab before beginning their search.

13

Observations Across both search models, in 45 of 60 tasks in

which users selected a tab, they selected the appropriate tab for that task.

14

Observations In both models, users rarely switched silos in

the search results once in a silo. Users tended to stay in the same silo and refine searches within those silos.

15

What WorkedTask No. Task 1st Tab Searched

(Across Models)1 n=9

Please tell me if the library has a copy of the book titled ‘The Tipping Point’ by Malcolm Gladwell

All (4)Books (5)

3n=9

Please locate information about how much it costs to make photocopies in the library

All (3)Web site (5)Books (1)

4n=9

You are studying the effects of ADD in the classroom for your psychology class. Can you locate 2 books about helping students with ADD succeed in school?

All (4)Books (5)

8n=8

You are in DH Hill Library and you would like to locate an illustrated encyclopedia about trees; where would you find such a book at Hill?

All (3)Books (4)Web site (1)

9n=7

Please locate information on how to borrow a laptop from the library; how long is the loan period?

All (1)Web site (5)Books (1)

10n=7

Please locate the most recent issue of the Journal of the American Medical Association.

Journals (6)All (1)

16

Problem AreasTask No. Task 1st Tab Searched

(Across Models)2n=9

Find 2 journal articles on how tropical forest fires impact the environment

Journals (4)Articles (4)All (1)

6n=9

You are doing a lab on the reproductive habits of fish in your Bio class. Your professor has recommended that you use the Web of Science database to find relevant articles. How would you do that on this site?

Articles (3)Journals (1)Website (1)All (4)

7n=8

You are writing a paper for a course in Computer Science. Find the 2001 article titled ‘Internet Under Siege’ by Lawrence Lessig in the journal called Foreign Policy.

Journals (3)Articles (4)All (1)

17

Other Issues Even if users executed a successful search, they

often did not scroll down far enough in the search results to find the answer

Almost all participants only scanned the first page of search results for a quick answer to the task

Spelling was problematic

18

19

www.lib.ncsu.edu

Search Usage

20

21

Use of “All” tab (QuickSearch)

2.4%43.8% 36.4%

8.3%

22

17.3 % increase

Articles – Full Text Downloads

Next Steps

Conduct more usability testing with students.

Interview faculty about their research and how they view our new site.

23

Questions? Thank you!

Contact us: susan_teague_rector@ncsu.edu josh_boyer@ncsu.edu

24