understanding the searchers - emory universityeugene/cs190/lectures/feb21-web... · 2013. 2....
TRANSCRIPT
![Page 1: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/1.jpg)
Understanding the Searchers
12/21/2013 CS190: Web Science and Technology, 2010
![Page 2: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/2.jpg)
Today's Plan
Project 1 presentations
Understanding web searchers
Models, methods
Advertising
Next project: Google advertizing campaign
22/21/2013 CS190: Web Science and Technology, 2010
![Page 3: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/3.jpg)
Student Projects
• Are available on the web here:http://www.mathcs.emory.edu/~eugene/cs190/project1solutions.html
• By end-of-week, will be findable by search engines
• Make sure your projects' homepage has:
– Title of project
– Names of team members
– Very brief (one sentence) subtitle/description
2/21/2013 CS190: Web Science and Technology, 2010 3
![Page 4: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/4.jpg)
Models of Search Behavior
• Understanding user behavior at micro-, meso-, and macro- levels
• Theoretical models of information seeking
• Web search behavior:– Levels of detail
– Search Intent
– Variations in web searcher behavior
– Click models
4
![Page 5: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/5.jpg)
Levels of Understanding User Behavior
• Micro (eye tracking): lowest level of detail, milliseconds
• Meso (field studies): mid-level, minutes to days
• Macro (session analysis):millions of observations, days to months
5
[Daniel M. Russell,
2007]
![Page 6: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/6.jpg)
Models of Information Seeking
• “Information-seeking … includes recognizing … the information problem, establishing a plan of search, conducting the search, evaluating the results, and … iterating through the process.”-Marchionini, 1989
– Query formulation
– Action (query)
– Review results
– Refine query
6
Adapted from: M. Hearst, SUI,
2009
![Page 7: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/7.jpg)
Cognitive Model of Information Seeking
• Static Info Need
– Goal
– Execution
– Evaluation
7
![Page 8: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/8.jpg)
Dynamic “Berry Picking” Model
• Information needs change during interactions
8
[Bates, 1989] M.J. Bates. The design of browsing and berrypicking techniques for
the on-line search interface. Online Review, 13(5):407–431, 1989.
Eugene AgichteinEmory University
![Page 9: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/9.jpg)
Goal: maximize rate of
information gain.Patches of information websites
Basic Problem: should I
continue in the current
patch or look for another
patch?
Expected gain from continuing
in current patch, how long to
continue searching in that patch
Information Foraging Theory
9
![Page 10: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/10.jpg)
Hotel Search
10
Goal: Find
cheapest 4-star
hotel in Paris.
Step 1: pick hotel
search site
Step 3: goto 1
Step 2: scan list
![Page 11: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/11.jpg)
Example: Hotel Search (cont’d)
Eugene AgichteinEmory University
11
![Page 12: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/12.jpg)
Diminishing Returns Curve; 80% of users don’t scan past the 3rd
page of search results
R* = steepest slope from origin = tangent from origin
If tb is low, then people tend to switch more easily. (web snacking)
-Charnov’s Marginal Value Theorem
12
![Page 13: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/13.jpg)
Browsing vs. Search
• Recognition over recall (I know it when I see it)
• Browsing hierarchies/facets more effective than querying
13
![Page 14: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/14.jpg)
Orienteering
• Searcher issues a quick, imprecise to get to approximately the right information space region
• Searchers follow known paths that require small steps that move them closer to their goal
• Expert searchers starting to issue longer queries
14
![Page 15: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/15.jpg)
Information Scent for Navigation
• Examine clues where to find useful information
15
Search results listings must
provide the user with clues
about which results to click
![Page 16: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/16.jpg)
Web Searcher Behavior
• Meso-level: query, intent, and session characteristics
• Micro-level: how searchers interact with result pages
• Macro-level: patterns, trends, and interests
16
![Page 17: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/17.jpg)
Web Search Architecture
Example centralized parallel architecture
Crawlers
Web
[from Baeza-Yates and Jones, WWW 2008
tutorial]
![Page 18: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/18.jpg)
Information Retrieval Process (User view)
Eugene Agichtein, Emory University, IR Lab 18
Source
Selection
Search
Query
Selection
Ranked List
Examination
Documents
Delivery
Documents
Query
Formulation
Resource
query reformulation,
vocabulary learning,
relevance feedback
source reselection
![Page 19: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/19.jpg)
Intent Classes (top level only)
User intent taxonomy (Broder 2002)
– Informational – want to learn about something (~40% / 65%)
– Navigational – want to go to that page (~25% / 15%)
– Transactional – want to do something (web-mediated) (~35% / 20%)
• Access a serviceDownloads
• Shop
– Gray areas
• Find a good hub
• Exploratory search “see what’s there”
Eugene Agichtein, Emory University, IR Lab
History nonya food
Singapore Airlines
Jakarta weather
Kalimantan satellite images
Nikon Finepix
Car rental Kuala Lumpur
[from SIGIR 2008 Tutorial, Baeza-Yates and Jones]
19
![Page 20: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/20.jpg)
Web Search Queries
• Cultural and educational diversity
• Short queries and impatient interaction
– Few queries posed and few answers seen (first page)
– Reformulation common
• Smaller and different vocabulary
– Not “expert” searchers!
– “Which box do I type in?”
Eugene AgichteinEmory University 20
![Page 21: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/21.jpg)
Classified Queries
Eugene AgichteinEmory University 21
[from SIGIR 2008 Tutorial, Baeza-Yates and Jones]
![Page 22: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/22.jpg)
People Look at Only a Few Results
(Source: iprospect.com WhitePaper_2006_SearchEngineUserBehavior.pdf)
Eugene AgichteinEmory University 22
![Page 23: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/23.jpg)
Snippet Views Depend on Rank
Mean: 3.07 Median: 2.00
Eugene AgichteinEmory University 23
![Page 24: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/24.jpg)
Problem: Users click based on result “Snippets”
• Effect of Caption Features on Clickthrough Inversions, C. Clarke, E. Agichtien, S. Dumais, R. White, SIGIR 2007
[Clarke et al., 2007]
24
![Page 25: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/25.jpg)
Clickthrough Inversions [Clarke et al., 2007]
25
![Page 26: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/26.jpg)
Important Words in Snippet[Clarke et al., 2007]
26
![Page 27: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/27.jpg)
Click Models Summary
Models proposed to simulate searcher click process
– Increasingly sophisticated and theories
– Assume searcher is rational and consistent
But, searchers are not rational or careful:
– Attracted/repelled by simple features of summaries
Can incorporate summary and browsing info to extract relevance information from clicks
27
![Page 28: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/28.jpg)
“Eyes are a Window to the Soul”
• Eye tracking gives information about search interests:
– Eye position
– Pupil diameter
– Seekads and fixations
28
Reading
Visual
Search
Camera
![Page 29: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/29.jpg)
Micro-level: Examining Results
• Users rapidly scan the search result page
• What they see in lower summaries may influence judgment of higher result
• Spend most time scrutinizing top results 1 and 2
– Trust the ranking
29
[Daniel M. Russell,
2007]
![Page 30: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/30.jpg)
Result Examination (cont’d)
• Searchers might use the mouse to focus reading attention, bookmark promising results, or not at all.
• Behavior varies with task difficulty and user expertise
30
[K. Rodden, X. Fu, A. Aula, and I. Spiro, Eye-
mouse coordination patterns on web search
results pages, Extended Abstracts of ACM CHI
2008]
![Page 31: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/31.jpg)
News: We can predict where the searcher is looking!
2/21/2013 CS190: Web Science and Technology, 2010 31
Guo & Agichtein,
CHI 2010
A
D
C
E
F
![Page 32: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/32.jpg)
Macro-Level (Session) Analysis
• Can examine theoretical user models in light of empirical data:– Orienteering?– Foraging?– Multi-tasking?
• Search is often a multi-step process: – Find or navigate to a good site (“orienteering”)– Browse for the answer there: [actor most oscars] vs. [oscars]
• Teleporting – “I wouldn’t use Google for this, I would just go to…”
• Triangulation– Draw information from multiple sources and interpolate – Example: “how long can you last without food?”
32
![Page 33: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/33.jpg)
Users (sometimes) Multi-task
33
[Daniel M. Russell, 2007]
Eugene AgichteinEmory University
![Page 34: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/34.jpg)
Kinds of Search+Browsing Behavior
34
[Daniel M. Russell,
2007]
![Page 35: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/35.jpg)
References and Further Reading
• Marti Hearst, Search User Interfaces, 2009, Chapter 3 “Models of the Information Seeking Process”: http://searchuserinterfaces.com/
35
![Page 36: Understanding the Searchers - Emory Universityeugene/cs190/lectures/feb21-web... · 2013. 2. 21. · Browsing vs. Search •Recognition over recall (I know it when I see it) •Browsing](https://reader036.vdocuments.site/reader036/viewer/2022071009/5fc71bff0bf6bb2502504df7/html5/thumbnails/36.jpg)
Next Project
• Google advertising Challenge:
http://www.google.com/onlinechallenge/
1. Pick a team (not the same as last project)
2. Pick a non-profit organization/website to promote
3. Read about the challenge over the weekend
4. Will be due right after Spring break
2/21/2013 CS190: Web Science and Technology, 2010 36