workshop on crowd-sourcing
DESCRIPTION
Introduction to the Workshop on Crowd-sourcing at the 1st Heidelberg Laureate ForumTRANSCRIPT
![Page 1: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/1.jpg)
Crowd-‐Sourcing Workshop Heidelberg Laureate Forum 2013
Dr. rer. nat. Gianluca DemarCni gianlucademarCni.net
exascale.info
![Page 2: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/2.jpg)
Gianluca DemarCni
• M.Sc. at University of Udine, Italy • Ph.D. at University of Hannover, Germany
– EnCty Retrieval • Worked for UC Berkeley (on Crowdsourcing), Yahoo! Research
(Spain), L3S Research Center (Germany)
• Post-‐doc at the eXascale Infolab, Uni Fribourg, Switzerland. • Lecturer for Social Compu,ng in Fribourg
• Tutorial on EnCty Search at ECIR 2012, on Crowdsourcing at ESWC 2013 and ISWC 2013
• Research Interests – InformaCon Retrieval, SemanCc Web, Human ComputaCon
2
Gianluca DemarCni
![Page 3: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/3.jpg)
Schedule
• Intro and Crowdsourcing Overview • The HLF crowd on “Crowdsourcing your Research” – MaYhias Hagen: understand Web search – Dongrui Wu: make flights more efficient – Ioannis Psorakis: classify astronomical images – Trung T. Pham: recognize geometric objects – Rose Yu: anomaly detecCon on social networks
• Ethics in Crowdsourcing & Conclusions
![Page 4: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/4.jpg)
Are humans or machines beYer at
• Music?
• Art? • ComputaCon?
![Page 5: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/5.jpg)
Are humans or computers beYer?
• We are good at doing some things • Computers are good at doing others
• Machines have helped us in MANY domains
• Can WE help them?
![Page 6: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/6.jpg)
![Page 7: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/7.jpg)
Crowdsourcing
• Portmanteau of "crowd" and "outsourcing," first coined by Jeff Howe in a June 2006 Wired magazine arCcle
• [Merriam-‐Webster] the pracCce of obtaining needed services, ideas, or content by soliciCng contribuCons from a large group of people and especially from the online community rather than from tradiConal employees or suppliers
7
![Page 8: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/8.jpg)
Crowdsourcing IncenCves
• Paid Crowdsourcing – Amazon MTurk
• Fun (enjoyment) – Game With a Purpose
• Community (belonging, desire to help) – Wikipedia
8
![Page 9: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/9.jpg)
Crowdsourcing Examples
![Page 10: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/10.jpg)
CiCzen Science
10
![Page 11: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/11.jpg)
QuesCon Answering Systems
11
![Page 12: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/12.jpg)
ParCcipatory Culture – Implicit
12
John Murrell: GM SV 9/17/09
…every Cme we use a Google app or service, we are working on behalf of the search sovereign, creaCng more content for it to index and moneCze or teaching it something potenCally useful about our desires, intenCons and behavior.
![Page 13: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/13.jpg)
OCR errors: reCAPTCHA
13
![Page 14: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/14.jpg)
Case-‐Study: Amazon MTurk
• Micro-‐task crowdsourcing marketplace • On-‐demand, scalable, real-‐Cme workforce
• Online since 2005 (sCll in “beta”) • Currently the most popular plarorm
• Developer’s API as well as GUI • 1M workers (10% acCve)
14
![Page 15: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/15.jpg)
Challenges and OpportuniCes
• OpportuniCes – Get the best out of efficient systems and effec8ve human intelligence
– Design new soluCons to old problems – Interdisciplinary effort
• Challenges – Deal with Human Non-‐determinisCc Quality – Be ready for slow data
• Ethics
![Page 16: Workshop on Crowd-sourcing](https://reader034.vdocuments.site/reader034/viewer/2022052505/554e8d5cb4c905fc368b4a59/html5/thumbnails/16.jpg)
Schedule
• Intro and Crowdsourcing Overview • The HLF crowd on “Crowdsourcing your Research” – MaYhias Hagen: understand Web search
– Dongrui Wu: make flights more efficient – Ioannis Psorakis: classify astronomical images – Trung T. Pham: recognize geometric objects
• Ethics in Crowdsourcing & Conclusions