workday: building large scale machine learning pipelines
TRANSCRIPT
![Page 1: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/1.jpg)
Building Large Scale Machine Learning Pipelines
Vlad Giverts
Sr Director of Engineering
![Page 2: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/2.jpg)
Workday Confidential
Background
![Page 3: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/3.jpg)
Workday Confidential
Retention Risk
![Page 4: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/4.jpg)
Architecture
Retention Risk
ML Pipeline
Spark
YARN HDFS
![Page 5: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/5.jpg)
Architecture
Retention Risk
ML Pipeline
Spark Streaming
Kafka
Cassandra
Spark Streaming
![Page 6: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/6.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
![Page 7: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/7.jpg)
Workday Confidential
Data and Features
Num Promotions
Pay Range Penetration
Time in Current Job
Manager Attrition Rate Time Between
Promotions
Tenure
![Page 8: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/8.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
![Page 9: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/9.jpg)
Workday Confidential
Cross Validation
![Page 10: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/10.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
![Page 11: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/11.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
Partition Data
![Page 12: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/12.jpg)
Workday Confidential
What are we predicting?
BarryRaise: $1,000
2014 2016
RaviTransferred
JohnLeft :(
JinPromoted!
YuryHired
TejasLeft :(
RogerLeft :(
![Page 13: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/13.jpg)
So what happens?
![Page 14: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/14.jpg)
Workday Confidential
Results?
95 / 95
![Page 15: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/15.jpg)
What REALLY happens…
![Page 16: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/16.jpg)
Workday Confidential
Results?
15 / 10
![Page 17: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/17.jpg)
What do we want?
![Page 18: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/18.jpg)
Workday Confidential
Temporal Validation
BarryRaise: $1,000
2014 2016
TejasTransferred
JohnLeft :(
JinPromoted!
YuryHired
TejasLeft :(
YuryHired
TejasLeft :(
![Page 19: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/19.jpg)
3 mo 3 mo
Training with Validation
3 mo 3 mo 3 mo 3 mo 3 mo 3 mo
TRAINING VALIDATION
Early 2014 Mid 2015
![Page 20: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/20.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
Partition Data
![Page 21: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/21.jpg)
Workday Confidential
Data Pipeline
Raw Data Feature Engineering
Model Training
Model Validation
Partition Data
![Page 22: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/22.jpg)
Workday Confidential
Results?
2x Precision
3x Recall
30 / 3015 / 10
![Page 23: Workday: Building Large Scale Machine Learning Pipelines](https://reader036.vdocuments.site/reader036/viewer/2022081605/58f2232f1a28abe6098b45c9/html5/thumbnails/23.jpg)
TM
Thank You