enhancing navigation on wikipedia with social tags

33
Enhancing Navigation on Wikipedia with Social Tags Wikimania 2009 Arkaitz Zubiaga NLP & IR Group @ UNED August 28th, 2009

Upload: azubiaga

Post on 06-Jul-2015

410 views

Category:

Technology


1 download

DESCRIPTION

My presentation at Wikimania 2009 on August 28th, 2009

TRANSCRIPT

Page 1: Enhancing Navigation on Wikipedia with Social Tags

Enhancing Navigation on Wikipedia with Social TagsWikimania 2009

Arkaitz Zubiaga

NLP & IR Group @ UNED

August 28th, 2009

Page 2: Enhancing Navigation on Wikipedia with Social Tags

Introduction

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 2 / 33

Page 3: Enhancing Navigation on Wikipedia with Social Tags

Introduction

A Tagging System

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 3 / 33

Page 4: Enhancing Navigation on Wikipedia with Social Tags

Introduction

Simple Tagging

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 4 / 33

Page 5: Enhancing Navigation on Wikipedia with Social Tags

Introduction

Collaborative Tagging

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 5 / 33

Page 6: Enhancing Navigation on Wikipedia with Social Tags

Introduction

Tag Cloud

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 6 / 33

Page 7: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 7 / 33

Page 8: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Navigating on Wikipedia

Categories

Links in articles

Search engine

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 8 / 33

Page 9: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Navigating on Wikipedia: Categories

Pro: Great for organizing content

Con: Limited to the taxonomy and categorization.

An article is or is not in a category.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 9 / 33

Page 10: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Navigating on Wikipedia: Links in articles

Pro: Access to related articles

Con: Subject to link availability

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 10 / 33

Page 11: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Navigating on Wikipedia: Search engine

Pro: Article search by keyword

Con: Subject to term availability in content/categories

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 11 / 33

Page 12: Enhancing Navigation on Wikipedia with Social Tags

Navigating on Wikipedia

Motivation

Can article retrieval be improved by means oftagging?

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 12 / 33

Page 13: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 13 / 33

Page 14: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Benefits of Tagging

Tags...

...are simple

...rely on an open vocabulary

...can be aggregated

...allow users to differ on the definition

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 14 / 33

Page 15: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

How Can We Navigate Through Tags?

Three ways to navigate through tags1:

Pivot-browsing

Popularity

Filtering

1Tagging: People-Powered Metadata for the Social Web, by Gene SmithArkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 15 / 33

Page 16: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Tag Navigation: Pivot-browsing

Benefit: Switching to related tags/topics.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 16 / 33

Page 17: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Tag Navigation: Popularity

Benefit: What has people considered interesting/relevant for a tag?

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 17 / 33

Page 18: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Tag Navigation: Filtering

Benefit: Retrieving documents containing a tag(s), but not another.Hence, users can retrieve articles related to a topic, and excluding asubtopic.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 18 / 33

Page 19: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

How Can Tagging Enhance Taxonomies? (1)

Definition

Categories must be created before using them, unlike tags, which arecreated the first time a user uses themEach user defines a set of tags, generating a global weighted set of tagsas a result. This allows a tag to be more relevant than another, unlikewith categories, for which an agreement among users is necessary.Tags can handle synonimy, hypernims, hyponims,... unlike categories.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 19 / 33

Page 20: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

How Can Tagging Enhance Taxonomies? (and 2)

Navigation and search

Providing the aforementioned new ways to navigate.Providing new terms to describe the articles.Providing a bottom-up classification, instead of a top-down one.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 20 / 33

Page 21: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

An Example Combining Tags and Categories: Amazon

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 21 / 33

Page 22: Enhancing Navigation on Wikipedia with Social Tags

Benefits of Tagging

Avoiding Tag Mess

Letting users to relate tags, as in Librarything2:

2http://www.librarything.comArkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 22 / 33

Page 23: Enhancing Navigation on Wikipedia with Social Tags

Dataset Generation

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 23 / 33

Page 24: Enhancing Navigation on Wikipedia with Social Tags

Dataset Generation

Dataset Generation

Starting point: a set of 2M+ English Wikipedia3 articles.

Data retrieval:

Tag data for each article on Delicious4.Article content.

Removed not relevant tags for Wikipedia articles: wikipedia,reference, wiki.

Filtered to articles annotated by at least 10 users.

Result: 20,764 tagged Wikipedia articles5.

3http://en.wikipedia.org4http://delicious.com5The dataset is available for download at http://nlp.uned.es/social-tagging/Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 24 / 33

Page 25: Enhancing Navigation on Wikipedia with Social Tags

Results

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 25 / 33

Page 26: Enhancing Navigation on Wikipedia with Social Tags

Results

Results: Tag cloud

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 26 / 33

Page 27: Enhancing Navigation on Wikipedia with Social Tags

Results

Results: Presence of tags

Found Not Found % Found

Document 251,139 206,569 54.86%

Content 202,151 255,557 44.16%

Categories 35,237 422,471 7.70%

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 27 / 33

Page 28: Enhancing Navigation on Wikipedia with Social Tags

Results

Results: Presence of tags

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 28 / 33

Page 29: Enhancing Navigation on Wikipedia with Social Tags

Results

Results: Some examples

Users defined the tag programming for the article Framework, butthat word is not present in content.

The same occurs for the tag mathematics in the article Zipf’s law.

As well as for the tag audio in the article List of Internet stations.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 29 / 33

Page 30: Enhancing Navigation on Wikipedia with Social Tags

Results

Prototype

A preliminary prototype on applying tags to

Wikipedia can be found at:

http://taggedwiki.zubiaga.org

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 30 / 33

Page 31: Enhancing Navigation on Wikipedia with Social Tags

Conclusions

Index

1 Introduction

2 Navigating on Wikipedia

3 Benefits of Tagging

4 Dataset Generation

5 Results

6 Conclusions

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 31 / 33

Page 32: Enhancing Navigation on Wikipedia with Social Tags

Conclusions

Conclusions

A social tagging system would provide new ways to navigateWikipedia:

Pivot-browsingPopularityFiltering

Bottom-up classification besides top-down classification.

An experiment with tags over Wikipedia shows encouraging results.

Providing new unexisting terms.Providing new ways to navigate through tags.Helping to improve the search engine.Discovering popular articles.

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 32 / 33

Page 33: Enhancing Navigation on Wikipedia with Social Tags

Conclusions

Thank You for Your Attention

Achiu Arigato Danke Dhannvaad Dua Netjer en ek EfcharistoGracias Gracies Gratia Grazie Guishepeli Hvala Kiitos

Koszonom Merce Merci Mila esker Obrigado ShukranShukriya Tack Tak Takk Tanan Tapadh leat Tesekkur ederim Thank

you Toda

http://blog.zubiaga.org

Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 33 / 33