ai/ml for software engineers · coursera data science specialization - brian caffo and roger peng...

34
@robertharrop @skipjaqinc AI/ML for Software Engineers Rob Harrop

Upload: others

Post on 30-Sep-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

AI/ML for Software Engineers

Rob Harrop

Page 2: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

My Journey to Machine Learning

CEO @ SKIPJAQ

CTO and co-founder @ Bamboo Loans

Co-founder of SpringSource

Rob Harrop

Page 3: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

vs.

Page 4: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

1: Machine Learning is competitive advantage

Page 5: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

ML is rapidly becoming competitive necessity

Page 6: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

2: ML is what’s next for software engineers

Page 7: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

How -> How2

Page 8: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

3: Good models don’t happen by accident

Page 9: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

DevOps DevSecOps DevSecOps

ML

Page 10: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

“The way a team plays as a whole determines its

success.”

@robertharrop @skipjaqinc

Page 11: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

“The test of a first-rate intelligence is the ability to

hold two opposed ideas in mind at the same time and

still retain the ability to function”

F. Scott Fitzgerald

Page 12: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Generalisationvs.

Specialisation

Page 13: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Individuals specialise

Teams generalise

Page 14: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

4: You Must Upskill

Page 15: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Theory Practice Intuition

Statistics

Linear Algebra

Calculus

Optimisation

Regression

Classification

Deep Learning

Exploratory analysis

Data preparation

Iterative model development

Deploying and supporting models

Python/R

Numpy/Scikit/Pandas

Tensorflow/Keras/PyTorch

What type of learning problem do I have?

What is optimisation/regression/classification really doing?

How can I think about forward and backward propagation?

What types of things can I learn with a neural network?

Page 16: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Theory

Practice

Intuition

Page 17: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

“Intuition does not

come to an unprepared

mind.”

@robertharrop @skipjaqinc

Page 18: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Practice

Page 19: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

vs.

Page 20: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Page 21: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Theory

Page 22: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Page 23: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Learning Resources - Books

Page 24: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Learning Resources - Online Courses

▸ Coursera Data Science Specialization - Brian Caffo and Roger Peng

▸ Coursera Deep Learning Specialization - Andrew Ng

▸ MIT OCW Linear Algebra - Gilbert Strang

▸ Coursera Calculus One & Two - Jim Fowler

Page 25: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Page 26: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

5: Bias is Everywhere

Page 27: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Human Bias

Page 28: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

“When a measure becomes a target, it ceases to be a good measure.”

- Charles Goodhart

Page 29: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Data Bias

Page 30: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Article 9, Section 1

Processing of personal data revealing racial or ethnic origin, political

opinions, religious or philosophical beliefs, or trade union membership, and

the processing of genetic data, biometric data for the purpose of uniquely

identifying a natural person, data concerning health or data concerning a

natural person's sex life or sexual orientation shall be prohibited.

Page 31: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Learned Bias

Page 32: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

6: Transparency is Hard

Page 33: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

Page 34: AI/ML for Software Engineers · Coursera Data Science Specialization - Brian Caffo and Roger Peng Coursera Deep Learning Specialization - Andrew Ng MIT OCW Linear Algebra - Gilbert

@robertharrop @skipjaqinc

In Summary

▸ ML is competitive necessity. Don’t ignore it

▸ ML is software engineering

▸ Don’t make the mistakes of old; cross-functional teams win

▸ Now more than ever, ethics matter

▸ There’s a lot to learn, but it’s all valuable and it’s all fun