7/29/2019 Massolution NYC 2013: Alegion

1/13

1

!"#$!"#$%&'#$("(%&)*+,-(++

&

John HoskinsSr. Mgr, Amazon Mechanical Turk

Presented by:

Joel SimpsonCEO, Alegion

Where Humans and Machines Meet

7/29/2019 Massolution NYC 2013: Alegion

2/13

2

!"#$!"#$%&'#$("(%&)*+,-(++

Why Automation?

Without automation its difficult to realize

maximum potential of crowdsourcing.

7/29/2019 Massolution NYC 2013: Alegion

3/13

3

!"#$!"#$%&'#$("(%&)*+,-(++

Why Automation?

Automation allows for tighter measurement of

success.

7/29/2019 Massolution NYC 2013: Alegion

4/13

4

!"#$!"#$%&'#$("(%&)*+,-(++

What does automation buy me?

MeasurabilityPredictability

Continual Improvement

2013 Alegion Private and Confidential

7/29/2019 Massolution NYC 2013: Alegion

5/13

5

!"#$!"#$%&'#$("(%&)*+,-(++

But not just machines

Automating with the Human Machine allows you toassess the confidence of the accuracy of every answer

and further improve the heuristics

7/29/2019 Massolution NYC 2013: Alegion

6/13

6

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

7/29/2019 Massolution NYC 2013: Alegion

7/13

7

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

Integrate external data sources programmatically

7/29/2019 Massolution NYC 2013: Alegion

8/13

8

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

Hybrid Crowdleverages internal and external labor pools in same process

7/29/2019 Massolution NYC 2013: Alegion

9/13

9

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

Automate decision making using human judgment

7/29/2019 Massolution NYC 2013: Alegion

10/13

10

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

Identify and reward good workers

7/29/2019 Massolution NYC 2013: Alegion

11/13

11

!"#$!"#$%&'#$("(%&)*+,-(++

Automate the Human Machine

Provide data back to improve heuristic systems

7/29/2019 Massolution NYC 2013: Alegion

12/13

12

!"#$!"#$%&'#$("(%&)*+,-(++

Continual Improvement

Predict

Measure

Improve

RapidIteration

7/29/2019 Massolution NYC 2013: Alegion

13/13

13

!"#$!"#$%&'#$("(%&)*+,-(++

Discussion