mechanical turk on rails

19
Mechanical Turk On Rails Renzo Borgatti AMooConf 2010, June 5, Rostock

Upload: renzo-borgatti

Post on 27-Jan-2015

123 views

Category:

Technology


2 download

DESCRIPTION

The Mechanical Turk is the only solution available for specific kind of tasks where human assistance cannot be replaced by machines. Think about moderation of images, web sites or videos that should go public inside your app for example. If you can’t hire people specifically for the task, you can give the Mechanical Turk a try. Interfacing with the Turk isn’t simple though: it’s a highly asynchronous interaction where you need to persist state, then checking for tasks in the queue and acting accordingly. The low level Ruby APIs from Amazon can be used to integrate the service into a Rails application but then you need specific classes to deal with it. This presentation illustrates patterns for creating tasks, observing Turk tasks, parsing results and send events back to the application.

TRANSCRIPT

Page 1: Mechanical Turk On Rails

MechanicalTurk On Rails Renzo Borgatti

AMooConf 2010, June 5, Rostock

Page 2: Mechanical Turk On Rails

Rails iPhoneAgile Productivity

Page 3: Mechanical Turk On Rails

when cpu power is not enoughand cost is an issue

human intelligence on-demandwith a programmable approach

Page 4: Mechanical Turk On Rails

user generated content thatmust obey rules and restrictions or need classification

visual or graphical aspectsoffensive contentout-of-topics

Page 5: Mechanical Turk On Rails

requester submits a HITproperties: tags, expiration, $$

HIT rendered from a HTML Templateworker accepts the HIT

worker executes the task and earn $$retrieve results when HIT Reviewablerequester pays the worker or rejects

Page 6: Mechanical Turk On Rails
Page 8: Mechanical Turk On Rails

Engine

ModerableModerableModerable TaskProps

Template

CallbackNotify

GetResults

Parser

Page 9: Mechanical Turk On Rails
Page 10: Mechanical Turk On Rails
Page 11: Mechanical Turk On Rails
Page 12: Mechanical Turk On Rails
Page 13: Mechanical Turk On Rails
Page 14: Mechanical Turk On Rails

Ninja Tips

initial performance testsupervised training period

add RAILS_ENV to HIT tagsstub MechanicalTurkRequester

Page 18: Mechanical Turk On Rails

Thanks!Questions?

Rate my talk! http://spkr8.com/t/3383

Page 19: Mechanical Turk On Rails