freshness in web search - bcs irsg · hot news news celebs politics sport events technology...
TRANSCRIPT
![Page 2: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/2.jpg)
Many queries require fresh results!
![Page 3: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/3.jpg)
Some queries explicitly mention that they need recent results
![Page 4: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/4.jpg)
Query: [this week's paris concerts]
![Page 5: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/5.jpg)
Query: latest news chilean miners
![Page 6: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/6.jpg)
Some queries are looking for recent news
![Page 7: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/7.jpg)
Query: [Chile Miners]
[Toxic Sludge in Danube], [Italy earthquake],[101 highway accident]
![Page 8: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/8.jpg)
Search Volume over time: [Chile Miners]
graphs are extracted from trends.google.com
![Page 9: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/9.jpg)
Some queries have a recurrent nature
![Page 10: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/10.jpg)
Query: [American Idol Winner]
![Page 11: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/11.jpg)
Search traffic over time: [American Idol Winner]
![Page 12: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/12.jpg)
Query: [Aston Villa Chelsea result]
![Page 13: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/13.jpg)
Search Volume over time: [Aston Villa Chelsea]
![Page 14: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/14.jpg)
Not every recurrent query requires Freshness:
Query: [turkey recipe]
![Page 15: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/15.jpg)
Some general queries sometimes need fresh results
![Page 16: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/16.jpg)
Query [Danube] issued on October 7, 2010
New Relevant Results
Similar Examples: [Earthquake], [apple], [sludge],
![Page 17: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/17.jpg)
Query: [Danube] issued on October 17, 2010
![Page 18: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/18.jpg)
traffic over time: [Danube]
![Page 19: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/19.jpg)
For some queries, old results may give the wrong information to users.
Examples: [Linux Webcam driver], [Bus 912 timetable], [necessary documents for a China visa]
![Page 20: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/20.jpg)
Freshness Ranking is hard!
![Page 21: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/21.jpg)
Challenge 1
Queries have different freshness granularity needs.
![Page 22: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/22.jpg)
What is Fresh/Stale?"Freshness granularity"
[101 road cond]minutes
hours
days
weeksmonths
years
[french hostage]
[obama la visit][paris hilton tattoo][liverpool chelsea][best lcd][sigir registration][tax form 941]
traffichot news
newscelebspolitics
sport eventstechnology
recurring events
type of queries granularity sample queries
![Page 23: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/23.jpg)
Challenge 2
Age of a page?
![Page 24: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/24.jpg)
It is hard to determine age of a document.
First Crawl Date?Last Crawl Date?
Last modified Date?significant update?
What if the content of page is old and copied from older pages?
What is the main content of the page?
![Page 25: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/25.jpg)
Age of a page
![Page 26: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/26.jpg)
Challenge 3
Lots of Fresh results? Which ones are good?
![Page 27: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/27.jpg)
Challenge 4
Fight with Ranking?General Ranking favours old results
over new results.
![Page 28: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/28.jpg)
Page A: BBC Page from October 2009
![Page 29: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/29.jpg)
Page B: BBC Page from October 2010
![Page 30: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/30.jpg)
1. Both Page A and Page B are from the BBC website. 2. [Arsenal Birmingham] has very similar hits on both pages. 3. Page A (2009) has many more supports (eg. Links).
Without considering recency, Page A will be ranked better.
![Page 31: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/31.jpg)
Challenge 5Reacting Fast!
![Page 32: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/32.jpg)
React faster = Helping more users
![Page 33: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/33.jpg)
Challenge 6
Different results for the same query in different times.
Example query: [Chamakh]
![Page 34: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/34.jpg)
Query: [Chamakh] before last week's game
![Page 35: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/35.jpg)
Query: [Chamakh] during the game, 1 minute after Chamakh scored a goal.
![Page 36: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/36.jpg)
Query: [Chamakh] 1 day after the game
![Page 37: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/37.jpg)
Freshness is critical.Freshness is Challenging.
What does Google do?
![Page 38: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/38.jpg)
Google & Timeliness
More Fresh Web Results when necessary
Date in snippet Date restrict tools
News Universal
Latest results modeReal-time search
![Page 39: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/39.jpg)
Date in search snippets
![Page 40: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/40.jpg)
Restricting results to a given date range
![Page 41: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/41.jpg)
Query: [Chile Miners]
[Toxic Sludge in Danube], [Italy earthquake],[101 highway accident]
![Page 42: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/42.jpg)
Latest results / Real time search
![Page 45: Freshness in Web Search - BCS IRSG · hot news news celebs politics sport events technology recurring events type of queries granularity sample queries. Challenge 2 Age of a page?](https://reader033.vdocuments.site/reader033/viewer/2022052015/602d60d3aa40b32813793996/html5/thumbnails/45.jpg)
How?Language Model Topicality Query volume FluctuationQuery HotnessQuery intentAuthor QualityTweet Quality Probability of RelevanceSemanticsMain Content DetectionFast IndexingSpam DetectionAge of PageCopy detectionLots of Algorithms...