data (art &) science

21
1 Data ( art &) Science Strata + Hadoop World 2015 Contact: Eric Colson | ecolson@stitchfix.com Feb 2015

Upload: eric-colson

Post on 15-Jul-2015

378 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Data (art &) Science

1

Data (art &) Science Strata + Hadoop World 2015

Contact: Eric Colson | [email protected] Feb 2015

Page 2: Data (art &) Science

2

Page 3: Data (art &) Science
Page 4: Data (art &) Science

4

Different Capabilities

•  Executing supervised and unsupervised learning algorithms

•  Execution of complex calculations •  Discern between different and

significantly different •  Estimate and apply multivariate

weights •  … etc.

•  Cognitive abil it ies •  Access to additional info •  Powerful distinctions

Let’s  call  this  “Art”   Let’s  call  this  “Science”  

Machine Processing Expert-Human Processing

Page 5: Data (art &) Science
Page 6: Data (art &) Science

6  

1   2   3  

Page 7: Data (art &) Science

Algorithms:  our  differen:a:ng  asset  •  35% of Amazon sales are driven from recommendations •  50% of LinkedIn connections are driven by recommendations •  75% of Netflix videos watched are from recommendations •  100% of Stitch Fix merchandise is sold by recommendations

Page 8: Data (art &) Science

c[]i = { size: ’M’, height: 66,

age: 31,is_mom: True, occupation: ’Teacher’,city: ‘Austin’,

shoulder_fit_pref: ‘tight’, hip_fit_pref: ‘loose’,

color_pref: [‘blue’, ‘green’, ‘mauve’], dress_price_pref: ’50-100’, past_purchases: [5008, 808, 11508, 2204, 3553],

profile_note: ‘I am a teacher. My clothes need to be

appropriate for both the office as well

as 3rd-graders’,pinterest_link: 'http://pinterest.com/stitchfix/

1234',

...}

Page 9: Data (art &) Science

Scaling

Page 10: Data (art &) Science

10

Benefits of Systematizing

1.  Scale 2.  Specialization 3.  Feedback 4.  Controlled Variation

Page 11: Data (art &) Science

11

Feedback for more Learning

Page 12: Data (art &) Science

random()

12

Controlled Variation for more Exploration

random()

Page 13: Data (art &) Science

Generalizing

13  

Page 14: Data (art &) Science

14

Common business processes

Systematize when: •  Both Art & Science are required •  The process can benefit from

•  Scale •  Specialization •  Feedback •  Controlled Variation

Content  Produc:on  

Pricing  

Partner  Management  

Fraud  Detec:on  

Etc.  

Merchandising  

Page 15: Data (art &) Science

15

Building the capability

Process  

Technology  

People  

Page 16: Data (art &) Science

16

People  

Skills: •  Frame the optimization problem •  Train & implement algorithms •  Design systems, processes, and workflows •  Write production code •  Communicate beautifully •  Design experiments & measurement •  Evangelize adoption •  …etc.

1. From Dan Pink’s book, “Drive”

They  do  exist.  The  horns  are  not  always  visible  in  early  development.    

Grow them with big roles that provide autonomy, mastery, purpose1

Data Scientists need to become Data Artists.

Page 17: Data (art &) Science

17

Process  

1.  Form a strong partnership between data science and functional team

2.  Make them accountable 3.  Practice proper experimental design

Page 18: Data (art &) Science

18 18

Technology  

f (�) algorithms   Custom  App  

1. Build custom solutions 2. Build APIs 3. Invest in a logging pipeline

Page 19: Data (art &) Science

19

Enable a ‘Power’1

A capability becomes a “Power” if: 1.  It enables Superior returns 2.  The returns are Significantly differentiating 3.  The capability is Sustainable (hard to copy)

1. See works of Hamilton Helmer, Stanford Consulting Professor, https://economics.stanford.edu/faculty/helmer

Page 20: Data (art &) Science

20

Summary

•  Expert human judgment (Art) and machine processing (Science) contribute differently to strategic capabilities

•  Some processes call precisely for their combination •  Systematizing gets you: Scale, Specialization, Feedback, Controlled Variation •  Building the capability requires the right people, process, technology •  The capability can enable a ‘power’

Page 21: Data (art &) Science

21

Thank you. Questions?