real-time estimations and online learning for industrial ......machine learning modeling white box...
TRANSCRIPT
![Page 1: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/1.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
Presented by
Real-time Estimations
and Online Learning for
Industrial Assets at Total
SPINNATO Juliette
![Page 2: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/2.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
AGENDA
► TOTAL: our Company and our data-driven philosophy
► From a Business use case to a data science “Proof Of Concept”
► Online learning for our industrial assets
► Conclusion and Next steps
2
![Page 3: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/3.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
TOTAL: our Company and our
data-driven philosophy
3
![Page 4: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/4.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
TOTAL: Committed to Better Energy
4
WITH OPERATIONS IN MORE THAN
130 COUNTRIES,
we have over 96,000 employees
who are fully committed to better energy.1 Based on market capitalization in U.S. dollars at December 31, 2015
Total is the world’s 4th-ranked oil
and gas company1
and a global leader in solar energy
with SunPower.
![Page 5: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/5.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
TOTAL: Committed to Better Energy
5
![Page 6: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/6.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
TOTAL: Our Data-Driven philosophy
6
A DATA-DRIVEN ACTIVITY WITHIN TOTAL
► Since 2015, Total promotes internally a strong data culture
► To move towards a data-driven and digitalized industry
► Creation of data analytics centers within our company
• Realization of several Proof of Concepts (PoC) to demonstrate data science
added-value for our Businesses
• Industrialization of the best PoCs into long-term solutions
![Page 7: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/7.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
From a Business use case to
a data science POC
7
![Page 8: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/8.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@ 8
USE CASE
TODAY’S SCOPEBUSINESS OBJECTIVE
Increase lab & units efficiency using advanced
analytics
► To reduce the amount of samples processed that
bring little or no added value
► To help the process experts to improve units
outputs
A proof of concept: estimating crude distillation quality
for Antwerp refineryResidue
Naphta
Kerosine
Light Gasoil
Heavy Gasoil
Lighter cuts,
Gas
contains gasoil to
reprocess
Quality lab analysis to
measure the percentage of
gasoil in the residue.Crude
oil
![Page 9: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/9.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
A DATA SCIENCE PROOF OF CONCEPT
9
SUCCESSFUL METHODOLOGY
► A 5 months project following an AGILE method
► A multi-disciplinary team including Business
experts, data scientist, and data owner
DATA SOURCE
80 relevant PI Tags™ identified and extracted from
the PI System®
A one shot study: data extraction using PI
DataLink®
MACHINE LEARNING MODELING
► White box machine learning algorithm
► Highly correlated variables (flow, pressures,
temperatures, …)
Linear Ridge regression
Azure ML Studio:
![Page 10: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/10.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ARCHITECTURE & WORKFLOW
10
Data
Archive
PI DataLink®
1
23
4
Blob storage
HDInsight cluster
PI Tag™ implemented into the PI System®
ML model as a Performance Equation (PE)Secured transfer
![Page 11: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/11.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
RESULTS
11
REAL-TIME ESTIMATION AND MODEL FOLLOW-UP
Model estimation
versus
lab analysis
KPIs to follow the
performances
![Page 12: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/12.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
RESULTS
12
► When do we decide that the model in no longer up-to-date?
► When do we decide to retrain the model?
MODEL SUSTAINABILITY
Need to retrain?
![Page 13: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/13.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
CHALLENGES
13
Maintaining a ML model implemented in a PI System® : KEY QUESTIONS
► How do we decide to retrain the model: detect changes made on the industrial asset,
launch retraining based on a statistical and/or business criteria
► What is the best dataset to take into account?
► How to keep the historic of our online learning?
![Page 14: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/14.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
Online learning for our
industrial assets
14
![Page 15: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/15.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
TARGET ARCHITECTURE
15
Data Archive
Blob storage
Asset Framework (AF)
ODBC
ODBC
PI OLEDB™
ODBC
HDInsight cluster
Azure Explorer
![Page 16: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/16.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Dataset(s) & model(s)
16
Training set
Model deployment Model degradation MODEL INITIALISATION
ONLINE LEARNING – Scenario examples
1
2
3
![Page 17: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/17.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Expert System
17
Start_ Control_Algorithm ()
Inter_V: The time interval controls tags = 30 minutes
Inter_M: Variable check interval = 10 minutes
Perf_model = F (Mean error, accuracy, actual deviation)
Perf_ threshold : Performance threshold set by Business
For each Inter_M
If ( Perf_model < Seuil_Perf ) then
Create N datasets
Dataset = {old dataset, Delta-2, Delta-1, Delta 1, Delta2 }
Modeles_test <- Create 2^N prediction models
Model <- Max (Modeles_test ) # the best model of Modeles_test
End if
End for
End_Control_Algorithm
How to…
► …automatically define the
different datasets and
► …evaluate models
![Page 18: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/18.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: First results
18
MODELING CHOICES
► Elastic-net algorithm: Variables selection and
optimized linear regression
R library : “glmnet: Lasso and Elastic-Net
Regularized Generalized Linear Models”
Ref: [T. Hastie et al. , “The Elements of Statistical
Learning”, Springer Series in Statistics, 2nd Edition,
Springer, 2009]
MODELS EVALUATION
► Performance evaluation: Mean-absolute
error (MAE)
► Business evaluation:
Model equation highlights the main contributions
to estimate the target
Descriptive statistics
![Page 19: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/19.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: First results
19
MODEL INITIALISATION – Estimation Error
Training Validation
0.36 2.08MAE
R RESULTS - Example
![Page 20: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/20.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: First results
20
R RESULTS - Example
1 2 3
Training Validation
1.32 0.93
Training Validation
0.53 1.38
Training Validation
2.52 1.52MAE
![Page 21: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/21.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Models follow-up
21
Power BI Dashboard
PI Tags™
descriptive statistics
to detect important
changes among
input variables
![Page 22: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/22.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Models follow-up
22
Power BI Dashboard
Dynamic
dashboard
Zoom on a
particular variable
![Page 23: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/23.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Models follow-up
23
Power BI Dashboard
Data quantity to
monitor models
retraining
![Page 24: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/24.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
ONLINE LEARNING: Models follow-up
24
Model performances in time
Power BI Dashboard
Variables influence for each model
![Page 25: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/25.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
Conclusion and Next steps
25
![Page 26: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/26.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
CONCLUSIONS
26
BUSINESS OBJECTIVE
Increase lab & units efficiency using advanced
analytics
DATA SCIENCE SOLUTION
Online learning to estimate the % of gasoil remaining
in the residue of a distillation unit
►An automated workflow to extract data, compute
several models and provide data scientists and Business
experts with an updated dashboard
ADDED VALUE
Short term impact
► The proposed workflow is easy to both install
and generalize many ML models for quality
estimation
► Provide a clear and updated view of unit’s
quality to the Business at any time
Long term impact
► Important reduction of processed samples that
bring little or no added value
![Page 27: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/27.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
NEXT STEPS
27
►Create more rules to launch a model retraining automatically
►Give Business experts the possibility to manually launch a model
retraining
►Send online results back to the refinery’s Asset Framework (AF)
![Page 28: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/28.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
RESULTSCHALLENGE SOLUTION
COMPANY and GOAL
Real-time Estimations and Online
Learning for Industrial Assets at Total
TOTAL: committed to better energy
The Business objective is to increase lab & units
efficiency using data science methodology and tools
To build a data-driven modelbased on PI Tags™
In order to anticipate possible model degradation over time, an online retraining has also been developed.
Definition of an online machine
learning workflow using data
science and PI systems tools
An automated workflow scalable,
easy to use and that provides
good quality estimation
• Asset Framework (AF) and PI
OLEDB™ were used to efficiently
extract data
• Data science tools
• Model estimation providing an
error of less than 1.5 point
• A clear and updated view of unit’s
quality to the Business at any time
• Lab samples reduction
• A project for Antwerp Refinery
(Belgium) to estimate the % of
gasoil in the residue of a Crude
Distillation Unit.
![Page 29: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/29.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
Contact Information
Juliette Spinnato
Data Scientist
Total
29
![Page 30: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/30.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@ 30
Questions
Please wait for the
microphone before asking
your questions
Please remember to…
Complete the Online Survey
for this session
State your
name & company
http://bit.ly/uc2017-app
![Page 31: Real-time Estimations and Online Learning for Industrial ......MACHINE LEARNING MODELING White box machine learning algorithm Highly correlated variables (flow, pressures, temperatures,](https://reader034.vdocuments.site/reader034/viewer/2022050219/5f654b3de356e9223d19b47c/html5/thumbnails/31.jpg)
© Copyright 2017 OSIsoft, LLCUSERS CONFERENCE 2017 #OSIsoftUCosisoft@
Thank You