deep learning & artificial intelligence · schedule 17.10.2018 introduction 24.10.2018 basic...
TRANSCRIPT
![Page 1: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/1.jpg)
Deep Learning & Artificial Intelligence
WS 2018/2019
![Page 2: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/2.jpg)
Teaching Team
Dr. Sigurd Spieckermann Prof. Dr. Volker TrespDr. Denis Krompaß
Dr. Florian Buettner Pankaj GuptaDr. Markus GeipelProf. Dr. Matthias Schubert
![Page 3: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/3.jpg)
Schedule17.10.2018 Introduction
24.10.2018 Basic Neural Networks
31.10.2018 Training Neural Networks
07.11.2018 Convolutional Neural Networks
14.11.2018 Recurrent Neural Networks
21.11.2018 Deep Learning and Uncertainty
28.11.2018 Representation and Distributional Learning
05.12.2018 Deep Learning Tools
12.12.2018 Generative Models
19.12.2018 Sequential Decision Problems and Autonomous Agents
09.01.2019 Model-free Reinforcement Learning
16.01.2019 Value Function Approximation
23.01.2019 Policy Gradient and Actor-Critic Learning
30.01.2019 Knowledge Graphs in AI
06.02.2019 Q&A
![Page 4: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/4.jpg)
Deep Learning & Artificial Intelligence
Many people are talking about it,few people really know
what they are talking about.
![Page 5: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/5.jpg)
2016/06/01 SOURCE: http://www.clickode.com/en/2016/02/01/google-rilascia-gratis-lezioni-di-deep-learning/
![Page 6: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/6.jpg)
SOURCE: http://community.mis.temple.edu/mis4596sec003sp2016/2016/01/31/will-robots-take-over-your-job/
![Page 7: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/7.jpg)
Applications & Success Stories
![Page 8: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/8.jpg)
Applications & Success Stories
![Page 9: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/9.jpg)
Applications & Success Stories
![Page 10: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/10.jpg)
Applications & Success Stories
A woman is throwing a frisbee in a park.
![Page 11: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/11.jpg)
Applications & Success Stories
![Page 12: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/12.jpg)
Applications & Success Stories
![Page 13: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/13.jpg)
Applications & Success Stories
![Page 14: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/14.jpg)
Applications & Success Stories
![Page 15: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/15.jpg)
Applications & Success Stories
![Page 17: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/17.jpg)
H. Kim, P. Garrido , A. Tewari, W. Xu, J. Thies, M. Nießner, P. Pérez, C. Richardt, Michael Zollhöfer, C. Theobalt, Deep Video Portraits, ACM Transactions on Graphics (SIGGRAPH 2018)
https://www.youtube.com/watch?v=qc5P2bvfl44
Applications & Success Stories
![Page 18: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/18.jpg)
Applications & Success Stories
Das Wirtschaftswachstum hat sich in den letzten Jahren verlangsamt.
Economic growth has slowed down in recent years.
![Page 19: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/19.jpg)
Applications & Success Stories
This movie was not bad.
![Page 20: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/20.jpg)
Applications & Success Stories
Hello, my name is ...
![Page 21: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/21.jpg)
Applications & Success Stories
Hello, my name is ...
![Page 22: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/22.jpg)
Applications & Success Stories
![Page 23: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/23.jpg)
Applications & Success Stories
![Page 24: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/24.jpg)
Applications & Success Stories
![Page 25: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/25.jpg)
Applications & Success Stories
![Page 26: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/26.jpg)
Success! Success!
But there are also some issues ...
![Page 27: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/27.jpg)
Goodfellow, I. J., Shlens, J., & Szegedy, C. Explaining and harnessing adversarial examples (2014). arXiv preprint arXiv:1412.6572.
![Page 28: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/28.jpg)
Azulay, A., & Weiss, Y. (2018). Why do deep convolutional networks generalize so poorly to small image transformations?. arXiv preprint arXiv:1805.12177.
![Page 29: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/29.jpg)
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017). On calibration of modern neural networks. arXiv preprint arXiv:1706.04599.
![Page 30: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/30.jpg)
https://techcrunch.com/2016/03/24/microsoft-silences-its-new-a-i-bot-tay-after-twitter-users-teach-it-racism/
![Page 31: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/31.jpg)
Brown, T. B., Mané, D., Roy, A., Abadi, M., & Gilmer, J. (2017). Adversarial patch. arXiv preprint arXiv:1712.09665.
![Page 32: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/32.jpg)
Elsayed, G. F., Goodfellow, I., & Sohl-Dickstein, J. (2018). Adversarial Reprogramming of Neural Networks. arXiv preprint arXiv:1806.11146.
![Page 33: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/33.jpg)
Deep Learning & Artificial Intelligence
in a nutshell
![Page 34: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/34.jpg)
Deep Learning & AI
ARTIFICIALINTELLIGENCE
MACHINELEARNING
DEEP LEARNING
DIFFERENTIABLE COMPUTING
Techniques that enable machines to imitate human behavior.
Area of machine learning which generalizes neural networks to computation graphs of (parameterized) differentiable functions.
Statistical techniques that allow machines to “learn” with data without being explicitly programmed.
![Page 35: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/35.jpg)
Machine Learning
SUPERVISEDLEARNING
ClassificationRegression
UNSUPERVISEDLEARNING
ClusteringDimensionality Reduction
Recommendation
REINFORCEMENTLEARNING
Reward maximization
![Page 36: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/36.jpg)
Deep Learning vs. Classic Data Modeling
INPUT
HAND-DESIGNED PROGRAM
OUTPUT
INPUT
HAND-DESIGNED FEATURES
MAPPING FROM FEATURES
OUTPUT
INPUT
FEATURES
MAPPING FROM FEATURES
OUTPUT
INPUT
FEATURES
ADDITIONAL LAYERS OF MORE ABSTRACT
FEATURES
MAPPING FROM FEATURES
OUTPUT
RULE-BASED SYSTEMS CLASSIC MACHINE LEARNING
REPRESENTATION LEARNING
DEEP LEARNING
LEARNED FROM DATA
![Page 37: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/37.jpg)
Example: Sentiment Analysis
This movie was awesome!
This movie was not too bad.
This movie was really bad!
![Page 38: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/38.jpg)
Hierarchical Feature Extraction
SOURCE: http://www.eidolonspeak.com/Artificial_Intelligence/SOA_P3_Fig4.png
![Page 39: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/39.jpg)
SMALLTRAINING
SETS
Why is Deep Learning Taking Off?
Amount of (labeled) data
Per
form
ance
Traditional learning algorithm
Small neural network
Medium neural network
Large neural network
![Page 40: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/40.jpg)
Demystifying Deep Learning & AI
![Page 41: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/41.jpg)
Demystifying Deep Learning & AI
![Page 42: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/42.jpg)
Demystifying Deep Learning & AIBasic Layer Types
DENSE
![Page 43: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/43.jpg)
Demystifying Deep Learning & AIBasic Layer Types
CONV 1D
![Page 44: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/44.jpg)
Demystifying Deep Learning & AIBasic Layer Types
CONV 2D
![Page 45: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/45.jpg)
Demystifying Deep Learning & AIBasic Layer Types
RNN (DENSE)
![Page 46: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/46.jpg)
Demystifying Deep Learning & AIBasic Layer Types
RNN (DENSE)
t=1 t=2 t=3
![Page 47: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/47.jpg)
Development Cycle
Idea Code
Experiment
![Page 48: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/48.jpg)
Deep Learning = Many Layers?
Flexibility due to
computation graphCommon framework for
many applications
Little feature engineering
=Less domain knowledge
=Automated learning
NO … YES … NOT ONLY
![Page 49: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/49.jpg)
What’s new?
Large amounts of
labeled dataMore and faster computational
resources(CPUs, GPUs, ...)
Improved optimization algorithms
Improved software + open source
ecosystem
Improved neural network
architectures+ building blocks
![Page 50: Deep Learning & Artificial Intelligence · Schedule 17.10.2018 Introduction 24.10.2018 Basic Neural Networks 31.10.2018 Training Neural Networks 07.11.2018 Convolutional Neural Networks](https://reader034.vdocuments.site/reader034/viewer/2022050210/5f5d3b77baa77b1ecd707c1c/html5/thumbnails/50.jpg)
See you next week