deep learning – part ii - anyline · deep learning – part ii . title: 20160224 computer vision...
TRANSCRIPT
René Donner Deep Learning
Overview
2
Deep Learning recap
How to classify images
Convolutional Neural Networks (CNNs)
Classifying MNIST with CNNs
René Donner Deep Learning
Image recognition
3
Google Research Blog
René Donner Deep Learning
Scene labeling
4
http://www.purdue.edu/newsroom/releases/2014/Q1/smartphone-to-become-smarter-with-deep-learning-innovation.html
René Donner Deep Learning
Text recognition
5
http://www.pyimagesearch.com/2014/09/22/getting-started-deep-learning-python/
Large-Scale Deep Learning for Intelligent Computer Systems, Jeff Dean, Google, BayLearn 2015
How does it work?
René Donner Deep Learning
Deep learning
7
http://theanalyticsstore.ie/deep-learning/
René Donner Deep Learning
Visualization
8
1. Layer
higher Layers
Emergence of Object-Selective Features in Unsupervised Feature Learning, Adam Coates, NIPS 2012
René Donner Deep Learning
Deep learning
9
How does it work?
http://theanalyticsstore.ie/deep-learning/ http://stats.stackexchange.com/questions/114385/what-is-the-difference-between-convolutional-neural-networks-restricted-boltzma
Getting started with DL
René Donner Deep Learning
Frameworks
11
Caffehttp://caffe.berkeleyvision.org/Plain text filesFastest CNN, GPU
Kerashttps://github.com/fchollet/kerasPython, on top of Theano
TensorFlowhttp://tensorflow.org/Python, by Google
MXNethttps://github.com/dmlc/mxnetPython, R, Julia
Slid
e fro
m c
affe
tuto
rial
René Donner Deep Learning
Tensorflow
12
General optimization framework
C++ / PythonCPU / GPU / (Multi-GPU)
Construct / Execution
René Donner Deep Learning
MNIST
13
René Donner Deep Learning
MNIST
14
https://www.tensorflow.org/versions/r0.7/tutorials/mnist/beginners/index.html#mnist-for-ml-beginners
René Donner Deep Learning
Activation functions
15
http://gforge.se/2015/06/benchmarking-relu-and-prelu/
Rectified linear unit
Tanh
http://blog.otoro.net/2015/03/28/neural-slime-volleyball/
René Donner Deep Learning
MNIST - Demo
16
René Donner Deep Learning
MNIST
17
http://deeplearning4j.org/rbm-mnist-tutorial.html
Accuracy: 91%
Convolutional NN
René Donner Deep Learning
Convolution
20
https://devblogs.nvidia.com/parallelforall/accelerate-machine-learning-cudnn-deep-neural-network-library/https://developer.apple.com/library/ios/documentation/Performance/Conceptual/vImage/ConvolutionOperations/ConvolutionOperations.html
René Donner Deep Learning
Convolution
21
https://sites.google.com/site/shahriarinia/home/ai/machine-learning/neural-networks/deep-learning/theano-mnist/3-convolutional-neural-network-lenet
Accuracy: ~99.2%