visual snippets summarizing web pages for search and revisitation jaime teevan, ed cutrell, danyel...
TRANSCRIPT
![Page 1: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/1.jpg)
Visual SnippetsSummarizing Web Pages for Search and Revisitation
Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André1, Chang Hu2
Microsoft Corporation1University of Southampton 2University of Maryland
![Page 2: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/2.jpg)
Lots of Ways to Represent a Page
![Page 3: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/3.jpg)
What is the Best Representation?
• For recognition?– Thumbnails
[Hightower et al. ’98]
– Right size[Kaasten et al. ’02]
– Interaction history[Cockburn & McKenzie ’01]
• For search?– Context sensitive call out
[Woodruff et al. ’01]
• For other tasks?[Baudisch et al. ’04]
![Page 4: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/4.jpg)
What is the Best Representation?Recognition
Search
![Page 5: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/5.jpg)
Designer Representations
• Designer created representations
• Consistent pattern– Salient image– Text– Branding
![Page 6: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/6.jpg)
Canon EOS 30D: Digital Photography Review
![Page 7: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/7.jpg)
Auto-Generated Visual Snippets
• Extract– Salient image– Text: Title– Branding: Logo
• Compile
![Page 8: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/8.jpg)
Studying Representations
• Three representations
• Two ways representations can be used– Search– Recognition
![Page 9: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/9.jpg)
Study Design
• Phase I: Search– 12 search tasks (medical, shopping, homepage)– Within-subject: 4 tasks with each representation– 276 participants
• Phase II: Recognition– Same 12 tasks: Re-find yesterday’s answer– Between-subject: All with same representation– 197 participants (from Phase I)
![Page 10: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/10.jpg)
Phase I: Search
• No difference in speed for representations
• Clicks different– Text < Visual < Thumbs– Different strategies
• Qualitative difference– Text = Visual > Thumbs– Ease of use, like
Visual Snippets
Thumbnails Text0
40
80
120
160
Seco
nds
Visual Snippets
Thumbnails Text0
1
2
3
4
5
Clic
ks
![Page 11: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/11.jpg)
Phase II: Recognition
• Visual representations faster than text– Visual snippets < Text
• Congruency important– Thumbnails significant– Need to be seen before
to support re-finding
Visual Snippets Thumbnails TextSnippet0
10
20
30
40
Seco
nds
Visual Snippets Thumbnails TextSnippet0
10
20
30
40
50
Congruent Incongruent
Seco
nds
![Page 12: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/12.jpg)
Discussion of Results
• Search– Text snippets > visual snippets > thumbnails• Trend in time, significant in preference
– Representations used different ways• Recognition– Visual representations > text representations– Congruency important• Significant difference for thumbnails
• Visual snippets work across tasks
![Page 13: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/13.jpg)
Improving Visual Snippets
• Problems– Distinct from page– Does not scale– Extraction errors
• Solution– Shrink elements at
different rates
![Page 14: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/14.jpg)
Consistency v. Task Support
reviewEOS
• For recognition– Thumbnails
[Hightower et al. ’98]
– Right size[Kaasten et al. ’02]
– Interaction history[Cockburn & McKenzie ’01]
• For search– Context sensitive call out
[Woodruff et al. ’01]
• For other tasks?[Baudisch et al. ’04]
![Page 15: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/15.jpg)
QUESTIONS?Thank you
![Page 16: Visual Snippets Summarizing Web Pages for Search and Revisitation Jaime Teevan, Ed Cutrell, Danyel Fisher, Steven Drucker, Gonzalo Ramos, Paul André 1,](https://reader036.vdocuments.site/reader036/viewer/2022081519/56649db45503460f94aa4e7f/html5/thumbnails/16.jpg)
Designer Thumbnails