advanced deep learningi-systems.github.io/hse545/machine learning all/workshop/hanwha... ·...
TRANSCRIPT
![Page 1: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/1.jpg)
Advanced Deep Learning
by Prof. Seungchul Lee Industrial AI Lab http://isystems.unist.ac.kr/ POSTECH
Table of Contents
I. 1. Artistic Style TransferII. 2. Discriminant Model vs. Generative ModelsIII. 3. Generative Adversarial Networks (GAN)IV. 4. Deep Learning Implementation
1. Artistic Style TransferOriginal paper (https://arxiv.org/abs/1508.06576 (https://arxiv.org/abs/1508.06576))
https://shafeentejani.github.io/2016-12-27/style-transfer/ (https://shafeentejani.github.io/2016-12-27/style-transfer/)https://harishnarayanan.org/writing/artistic-style-transfer/ (https://harishnarayanan.org/writing/artistic-style-transfer/)
![Page 2: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/2.jpg)
Artistic Style Transfer for Video
Vincent van Gogh
In [1]: %%html <center><iframe src="https://youtube.com/embed/ckqemfh0JMM?rel=0" width="560" height="315" frameborder="0" allowfullscreen></iframe></center>
[iSystems] Video Style Transfer Gogh
Picasso
In [2]: %%html <center><iframe src="https://youtube.com//embed/nMwU4avioVo?rel=0" width="560" height="315" frameborder="0" allowfullscreen></iframe></center>
[iSystems] Video Style Transfer Picasso
![Page 3: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/3.jpg)
Revisit CNN
Hierarchical feature representationContents representationStyle representation
Style Transfer
Image construction
![Page 4: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/4.jpg)
2. Discriminant Model vs. Generative Models
Imbalanced Data
Not enough data from faulty statusData Imbalance
Under samplingOver samplingRe-weighting(Ada)Boosting
![Page 5: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/5.jpg)
Generative Model
Data imbalanceProblematic in realityFor example, 98% OK, 2% NG
![Page 6: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/6.jpg)
Revisit Autoencoder with MNIST Data
![Page 7: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/7.jpg)
Data Generation from Decoder
3. Generative Adversarial Networks (GAN)original paper by Ian J. Goodfellow (https://arxiv.org/abs/1406.2661 (https://arxiv.org/abs/1406.2661))
https://blog.openai.com/generative-models/ (https://blog.openai.com/generative-models/)
Turing test
![Page 8: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/8.jpg)
How to generate data?Train through competitionGenerator vs. Discriminator
![Page 9: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/9.jpg)
4. Deep Learning ImplementationComputation Environment for Model Learning
Development environment (open source)Ubuntu 14.04Python3TensorFlow
MachineGPU: GeForce GTX TITAN X (PASCAL)CPU: Intel i7-5930k 6 Core 3.5GHz processor
Parallel computingMulti GPUs
![Page 10: Advanced Deep Learningi-systems.github.io/HSE545/machine learning all/Workshop/Hanwha... · Advanced Deep Learning by Prof. Seungchul Lee Industrial AI Lab POSTECH Table of Contents](https://reader031.vdocuments.site/reader031/viewer/2022022103/5bc0126e09d3f2e13b8d4477/html5/thumbnails/10.jpg)
Implementation of Deep Learning Model
In [3]: %%html <center><iframe src="https://www.youtube.com/embed/-eqVRXtX44Y?rel=0" width="560" height="315" frameborder="0" allowfullscreen></iframe></center>
[iSystems] Deep Learning on Raspberry Pi
In [4]: %%javascript $.getScript('https://kmahelona.github.io/ipython_notebook_goodies/ipython_notebook_toc.js')