deep learning meetup

Download Deep Learning meetup

If you can't read please download the document

Upload: ivan-goloskokovic

Post on 16-Apr-2017

256 views

Category:

Technology


0 download

TRANSCRIPT

Deep Learning
meetup

Protobuf/Lua (Caffe/Torch)Python (TensorFlow)Java (DeepLearning4J)

Programming vs ML

Stage of AI

Deep Learning history

ML algorithms

Training DL model

ConvNets

32323Convolution Layer

32x32x3 image5x5x3 filter

convolve (slide) over all spatial locations

activation map12828

ConvNets

32323

Convolution Layer

activation maps628

For example, if we had 6 5x5 filters, well get 6 separate activation maps:

We processed [32x32x3] volume into [28x28x6] volume.Q: how many parameters are used ?A: (5*5*3)*6 = 450 parameters, (5*5*3)*(28*28*6) = ~350K multiplies

28

InputLayer

ConvLayer

ReLuLayer

PoolLayer

FullyConnLayer

SoftMaxLayer

Models

LeNet - 1998

AlexNet - ILSVRC 2012

ZFNet - ILSVRC 2013

GoogLeNet - ILSVRC 2014

VGGNet - ILSVRC 2014

ResNet - ILSVRC 2015

ILSVRC 2016

Links

Dl4j-examples

Deep Learning Papers

ConvNetJS CIFAR-10 demo

NVIDIA DIGITS

Darknet

Preparing for the Future of AI

Learning for Self-Driving Cars