insemtives iswc2010
DESCRIPTION
TRANSCRIPT
![Page 1: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/1.jpg)
Ten ways to make your semantic app addictive
Elena SimperlISWC 2010
www.insemtives.eu 1
![Page 2: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/2.jpg)
Executive summary• Many aspects of semantic content authoring naturally rely
on human contribution.
• Motivating users to contribute is essential for semantic technologies to reach critical mass and ensure sustainable growth.
• This tutorial is about– Methods and techniques to study incentives and motivators
applicable to semantic content authoring scenarios.– How to implement the results of such studies through
technology design, usability engineering, and game mechanics.
www.insemtives.eu 2
![Page 3: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/3.jpg)
Our approach
• Typology of semantic content authoring tasks andthe ways they could motivate users to contribute.
• Methodology for analyzing and designingincentivized semantic applications.
• Pilots, showcases and technology.
www.insemtives.eu 3
![Page 4: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/4.jpg)
www.insemtives.eu 4
Incentives and motivation• Incentives are ‘rewards’ assigned by an external ‘judge’
to a performer for undertaking a specific task.
• Common belief (among economists): incentives can be translated into a sum of money for all practical purposes.
• Incentives can be related to both extrinsic and intrinsic motivations.– Extrinsic motivation if task is considered
• Boring, dangerous, useless, socially undesirable, dislikable by the performer.
– Intrinsic motivation if• The performer likes what he/she is doing• The act is satisfying in itself (for various reasons).
![Page 5: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/5.jpg)
www.insemtives.eu 5
Examples (i)
![Page 6: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/6.jpg)
Examples (ii)
www.insemtives.eu 6
![Page 7: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/7.jpg)
Examples (iii)
www.insemtives.eu 7
![Page 8: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/8.jpg)
Harnessing human intelligence
Facebook reports 4,000,000,000 minutes (> 7500 person years) are spent on the site every day
www.insemtives.eu 8
Recaptcha users solve 60 million CAPTCHAs a day, which accounts for around 160,000 human hours (19 person years)
More than 18 000 titlespreserved in 10 years
![Page 9: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/9.jpg)
Harnessing human intelligence
www.insemtives.eu 9
![Page 10: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/10.jpg)
Which tasks can be crowdsourced?
• Modularity/Divisibility: can the task be divided into smaller chunks (see casual games, Amazon’s Mechanical Turk, open source software)
• Skills and expertise: does the task address a broad audience (seeCAPTCHAs, casualgames)
• Combinability– Additive: pulling a rope
(group performs better than individuals, but each individual pulls less hard)
– Conjunctive: running in a pack (performance is that of the weakest member, group size reduces group performance)
– Disjunctive: answering a quiz (group size increases group performance in term of the time needed to answer)
www.insemtives.eu 10
![Page 11: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/11.jpg)
Example: video annotation
www.insemtives.eu 11
![Page 12: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/12.jpg)
Example: ontology alignment
www.insemtives.eu 12
![Page 13: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/13.jpg)
Example: ontology evaluation
www.insemtives.eu 13
![Page 14: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/14.jpg)
Typology of semantic contentauthoring tasks: Table from D1.2.2
www.insemtives.eu 14
![Page 15: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/15.jpg)
Challenges
• Task selection, work breakdown and distributionof labor
• Domain selection and creation of knowledgecorpus
• Deriving formal representations from user inputs
• Technology design• Intrinsic motivations
www.insemtives.eu 15
![Page 16: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/16.jpg)
Factors affecting participation
• prize is higher• participants are more intrinsically motivated ,
have more free time, are non-experts in the field , and are not participating due to career concerns, social motivations, or to beat others.
www.insemtives.eu 16
(Lakhani et al, 2007)
![Page 17: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/17.jpg)
Outline of the tutorialTime Presentation
09:00 – 09:30 Human contributions in semantic content authoring
09:30 – 10:30 Methods and techniques to analyze and design incentivized semantic applications
10:30 – 11:00 Coffee break
11:00 – 12:30 Guidelines for incentivized technology design
12:30 - 13:30 Lunch break
13:30 – 14:30 Casual games for semantic content creation
14:30 – 15:00 Hands-on (Part I)
15:00 – 15:30 Coffee break
15:30 – 17:00 Hands-on (Part II)
17:00 – 17:30 Wrap-up and closing
www.insemtives.eu 17
![Page 18: Insemtives iswc2010](https://reader034.vdocuments.site/reader034/viewer/2022051513/546f438aaf795958298b5b37/html5/thumbnails/18.jpg)
8/10/2011 www.insemtives.eu 18
Realizing the Semantic Web by encouraging millions of end-users
to create semantic content.