tensorflow and google cloud machine learning …...machine learning specialist, google 2 end to end...

27
Machine learning with TensorFlow and Google Cloud goto; Copenhagen Vijay Reddy Machine Learning Specialist, Google

Upload: others

Post on 22-May-2020

20 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Machine learning with TensorFlow and Google Cloudgoto; Copenhagen

Vijay ReddyMachine Learning Specialist, Google

Page 2: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

22

End to End ML Pipeline

Inputs Train model

Pre processing

Feature Creation

Deploy

Cloud MLPrediction

Model

Remote Clients

REST API call with input variables

Page 3: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Rapid accelerated use of deep learning at Google

Proprietary + Confidential

Page 4: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Google Cloud brings battle hardened tech from Google products

Page 5: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Custom ML models Pre-trained ML models

Machine Learning Engine

TensorFlow

Vision API

Translation API

Natural Language API

Speech API Jobs API

Two Flavors of Machine Learning

Video Intelligence API

Page 6: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

cloud.google.com/translate/

cloud.google.com/vision/ cloud.google.com/speech/

cloud.google.com/natural-language/

Try them in your browser, for free!

Page 7: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction
Page 8: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Custom ML models Pre-trained ML models

Machine Learning Engine

TensorFlow

Vision API

Translation API

Natural Language API

Speech API Jobs API

Two Flavors of Machine Learning

Video Intelligence API

Page 9: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Why Tensorflow?● Largest Developer Community

● Developer Flexibility

● Production Ready

● State of the art ML algorithms built in

● Fast C++ Backend

Page 10: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

As of 6-24-2017

Largest Developer Community

FrameworkG

itHub

Sta

rsTensorFlow

10,000

20,000

30,000

0

40,000

SKLearn Caffe CNTK MXnet Torch

50,000

60,000

Page 11: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

TensorFlow Distributed Execution Engine

CPU GPU Android iOS ...

C++ FrontendPython Frontend ...

Layers

Estimator Keras Model

Canned Estimators

Developer Flexibility

Page 12: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

TensorFlow Distributed Execution Engine

CPU GPU Android iOS ...

C++ FrontendPython Frontend ...

Layers

Estimator Keras Model

Canned Estimators

Production Ready

Page 14: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

State of the Art Algorithms

Page 15: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Fast

https://www.tensorflow.org/performance/benchmarks

Page 16: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

C++ Backend

Page 17: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Why Google Cloud ML Engine? ● Horizontal scaling made easy

● Automatic Hyperparameter Tuning

● Automatic monitoring/logging/versioning

● Built in auto-scaling prediction service

● Access to TPUs (coming soon)

● No lock-in

Page 18: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Tensor Processing Unit

FLOPs 9 Teraflops

180 Teraflops

nVidia k80 TPU

Page 19: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Predicting Housing Prices

PREDICTING HOUSE SALE PRICES

Sq. Footage Price

1,000 $100,000

3,000 $300,000

How much would a 2,000 sq ft. house sell for?

Page 20: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Predicting Housing Prices

PREDICTING HOUSE SALE PRICES

Sq. Footage Price

1,000 $100,000

3,000 $300,000

2,000 $200,000

Page 21: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

A better dataset

PREDICTING HOUSE SALE PRICES

Sq. Footage

Crime Rate (1-100)

School Rating (1-5)

Price

1,000 1 5 $300,000

2,000 50 3 $200,000

4,000 80 1 $100,000

How much would a 3,000 sq ft. house with a crime rate of 30 and a school rating of 2 cost?

Page 22: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Not so easy now...

Page 23: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Google Cloud Training and Certification

To the Cloudhttps://goo.gl/FQK82z

Page 24: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Feature Feature Type Examples TF Function

Price Continuous $300,000 real_valued_column

Department Categorical Math, English sparse_column_with_keys

Occupation Categorical Engineer, Project Manager

sparse_column_with_hash_bucket

And more….

Feature Columns

Page 25: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Estimator Description

LinearClassifier Constructs a linear classification model

DNNClassifier Construct a neural network classification model

DNNLinearCombinedClassifier Best of both worlds!

KMeansClustering Unsupervised Learning

DynamicRnnEstimator Recurrent Neural Network

SVM Support vector machine

Custom Estimator For anything else!

Canned Estimators

Page 26: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

https://www.coursera.org/learn/serverless-machine-learning-gcp

http://shop.oreilly.com/product/0636920057628.do

Learn More

Page 27: TensorFlow and Google Cloud Machine learning …...Machine Learning Specialist, Google 2 End to End ML Pipeline Inputs Train model Pre processing Feature Creation Deploy Cloud ML Prediction

Google Cloud Training and Certification

Thank You