exploiting user gratification for collaborative semantic annotation

12
Davide Eynard Marco Colombetti [email protected] [email protected] Exploiting User Gratification for Collaborative Semantic Annotation

Upload: davide-eynard

Post on 11-Nov-2014

1.501 views

Category:

Economy & Finance


1 download

Tags:

DESCRIPTION

Presentation of the paper "Exploiting user gratification for collaborative semantic annotation" at SWUI08

TRANSCRIPT

Page 1: Exploiting user gratification for collaborative semantic annotation

Davide Eynard Marco Colombetti

[email protected] [email protected]

Exploiting User Gratification for Collaborative Semantic Annotation

Page 2: Exploiting user gratification for collaborative semantic annotation

2

Davide Eynard – Marco ColombettiDEI

Intro Annotation systems Our approach

• the basic idea• design and implementation• tests and evaluations

Conclusions and future work

Talk Outline

Page 3: Exploiting user gratification for collaborative semantic annotation

3

Davide Eynard – Marco ColombettiDEI

Intro

Challenge: adding semantics to the “Legacy Web”

We adopt a collaborative approach:

Users, thanks to participation, create huge quantities of data. Our aim is to exploit spontaneous collaboration to increase the amount of formal knowledge.

Semantic Web technologies provide formalisms and tools for knowledge representation and management.Our aim is to use them to create more powerful andrewarding collaborative systems.

Page 4: Exploiting user gratification for collaborative semantic annotation

4

Davide Eynard – Marco ColombettiDEI

Annotation systems

Currently they seem the way to go, allowing for a real “Read-Write Web” “Client-Server-Server” model

Main problems: they currently lack a wide participation! gratification is both a high reward and a low price

• make system easy and intuitive to use• give something back after each contribution

gratification is not only the one you have just received, but also the one you expect

• system cannot begin as empty: how to bootstrap?

Page 5: Exploiting user gratification for collaborative semantic annotation

5

Davide Eynard – Marco ColombettiDEI

Our approach

The bootstrap problem:

“People will not come to a bare site and just start editing blank pages. You have to nurture that community slowly by building a base of readers, and then gradually turning those readers into contributors. The ONLY way to build that reader base is with good content, and because the readers come before contributors, you have to do the contributions yourself.” (David Cohn)

Ontologies are good, but not the best solution see: KIM

Alternative idea: provide no contents, but a way to get them easily each concept triggers a collection of specific search engines see: Gnosis

Page 6: Exploiting user gratification for collaborative semantic annotation

6

Davide Eynard – Marco ColombettiDEI

System design

Motivate users gratification (expected, instant, long term) ease of use

• extension of an existing tool (the browser)• already existing affordances• concept suggestion• few clicks to complete

Make their contributions useful to everyone share annotations with other users

• social network/trust system what kind of related information?

• give a chance to customize results• even these customizations become part of the final value!

make data available as RDF

Page 7: Exploiting user gratification for collaborative semantic annotation

7

Davide Eynard – Marco ColombettiDEI

System architecture

Page 8: Exploiting user gratification for collaborative semantic annotation

8

Davide Eynard – Marco ColombettiDEI

Example

Page 9: Exploiting user gratification for collaborative semantic annotation

9

Davide Eynard – Marco ColombettiDEI

Some results

Page 10: Exploiting user gratification for collaborative semantic annotation

10

Davide Eynard – Marco ColombettiDEI

Evaluation

Users still no community adopting the annotation prototype a small, but expert one around the search tool

Data SPARQL endpoint available advantage: string disambiguation

How much new info? SA vs. Gnosis more sensible to typos no industry terms

(only named entities) larger taxonomy

(book titles, actors, football teams!)

Page 11: Exploiting user gratification for collaborative semantic annotation

11

Davide Eynard – Marco ColombettiDEI

Conclusions

Limits of our approach still a prototype still vulnerable to gaming

Novel contributions additional information is harvested from the Internet

• one possible solution for the bootstrap problem? users can fully customize results (they “choose their rewards”)

Future work/possible extensions release the tool and complete evaluation automatically show related info (such as ISBNs for books) allow more customizations on search templates

Page 12: Exploiting user gratification for collaborative semantic annotation

12

Davide Eynard – Marco ColombettiDEI

Conclusions

Add your questions here ;-)