Upload File

deep learning tutorial

29
Deep learning Tutorial with Caffe Haosdent Huang 08/27/2015

Upload: haosdent-huang

Post on 20-Feb-2017

619 views

Category:

Technology


0 download

Report

TRANSCRIPT

Page 1: Deep learning tutorial

Deep learning Tutorial with Caffe

Haosdent Huang 08/27/2015

Page 2: Deep learning tutorial

Why Deep Learning

Page 3: Deep learning tutorial

Why Deep Learning

https://www.youtube.com/watch?v=V1eYniJ0Rnk

Play games!

Page 4: Deep learning tutorial

Compositional Models and learn end-to-end

Hierarchy of Representations - vision: pixel, part, object - text: character, word, sentence - speech: audio, word - program: statement, function, module

Page 5: Deep learning tutorial

Compositional Models and learn end-to-end

Back-propagation jointly learnsall of the model parameters to optimize the output for the task

Page 6: Deep learning tutorial

xkcd: Tasks

Page 7: Deep learning tutorial

Use Caffe !

How to use deep learning implement these tasks ?

Page 8: Deep learning tutorial

Caffe

Page 9: Deep learning tutorial

Demo: mnist dataset

Classifying Handwritten images

Page 10: Deep learning tutorial

The models use when train mnist

layer { name: "pool1" type: "Pooling" bottom: "conv1" top: "pool1" pooling_param { pool: MAX kernel_size: 2 stride: 2 } }

Page 11: Deep learning tutorial

The models use when train mnist

Page 12: Deep learning tutorial

Train !

caffe train xxx.prototxt

http://localhost:8888/notebooks/sharing/test_capture.ipynb
Page 13: Deep learning tutorial

Model Zoo

• open collection of deep models to share innovation

• help disseminate and reproduce research

• bundled tools for loading and publishing models

https://github.com/BVLC/caffe/wiki/Model-Zoo
Page 14: Deep learning tutorial

Demo: ImageNet

http://localhost:8888/notebooks/sharing/test_classification.ipynb
Page 15: Deep learning tutorial

Open framework, models, and worked examples for deep learning - Pure C++ / CUDA architecture for deep learning - Command line, Python, MATLAB interfaces - Fast, well-tested code - Tools, reference models, demos, and recipes - Seamless switch between CPU and GPU

Prototype Train Deploy

Prototype Train Deploy

Page 16: Deep learning tutorial

demo.caffe.berkeleyvision.org

http://demo.caffe.berkeleyvision.org/
Page 17: Deep learning tutorial

The models use when train mnist

Page 18: Deep learning tutorial

The models use when train mnist

Page 19: Deep learning tutorial

The models use when train mnistFeature extraction using convolution

Page 20: Deep learning tutorial

The models use when train mnist

Feature extraction using convolution

Page 21: Deep learning tutorial

The models use when train mnistPooling(aggregation)

Page 22: Deep learning tutorial

The models use when train mnist

Page 23: Deep learning tutorial

Deep dream

https://github.com/google/deepdream/blob/master/dream.ipynb

Page 24: Deep learning tutorial

Deep dream

Page 25: Deep learning tutorial

Deep dream

Page 26: Deep learning tutorial

Deep dream

Page 27: Deep learning tutorial
Page 28: Deep learning tutorial

Deep dream

Page 29: Deep learning tutorial

Thank you


DATA STRUCTURE BASED THEORY FOR DEEP … · DATA STRUCTURE BASED THEORY FOR DEEP LEARNING ... Mathematics of Deep Learning Tutorial EUSIPCO Conference, Budapest, Hungary August 29

Tutorial on Deep Learning

A Tutorial on Deep Learning Part 1: Nonlinear Classi ers ...ai.stanford.edu/~quocle/tutorial1.pdf · A Tutorial on Deep Learning Part 1: Nonlinear Classi ers and The Backpropagation

Tutorial on Deep learning and Applications

Deep Learning for Recommender Systems RecSys2017 Tutorial

Tutorial Deep Learning - CosmoStatdlm.cosmostat.org/wp-content/uploads/2017/09/DL_Part2... · 2017. 9. 4. · TensorFlow Examples OUTLINE Tutorial Unsupervised Feature Learning -

Tutorial: Beyond Linearization in Deep Learning

A tutorial on deep learning at icml 2013

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

Deep Learning Tutorial, part 1 (Ruslan Salakhutdinov)

A Tutorial on Deep Learning Part 2: Autoencoders ...robotics.stanford.edu/~quocle/tutorial2.pdfA Tutorial on Deep Learning Part 2: Autoencoders, Convolutional Neural Networks and Recurrent

Deep learning Tutorial - Part 2

Deep Learning Tutorial, part 2 (by Ruslan Salakhutdinov)

Deep Learning Tutorial - Machines...Deep Learning Tutorial Brains, Minds, and Machines Summer Course 2018 TA: Eugenio Piasini & Yen-Ling Kuo. ... simple perceptron g is a nonlinear

DIY Deep Learning for Vision- a Hands-On Tutorial With Caffe

RAJA GIRYES TEL AVIV UNIVERSITY - TAUtam-son3.eng.tau.ac.il/~raja/wp...Tutorial-Math-Deep-Learning-Raja.pdf · RAJA GIRYES TEL AVIV UNIVERSITY Mathematics of Deep Learning Tutorial

Deep learning Tutorial - University of North Carolina at …deeplearning.web.unc.edu/.../10/Deep-learning-Tutorial.pdfDeep learning Tutorial Tianxiang Gao Aug 31, 2016 Content 1. Basics

A Tutorial on Deep Learning Part 2: Autoencoders, Convolutional

Deep learning tutorial (i)

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning

Deep Bayesian Learning and Understanding · and machine learning for natural language processing. 2 Tutorial description This tutorial introduces the advances in deep Bayesian learning

Deep Learning Tutorial - cse.iitd.ac.in

Tutorial on Optimization for Deep Networks - Deep Learning · Tutorial on Optimization for Deep Networks Re-Work Deep Learning Summit San Francisco Jan 28, 2016 Ian Goodfellow Senior

Deep Learning for Face Recognition - ShanghaiTechsist.shanghaitech.edu.cn/labs/datasci/ssds2015/slides/tutorial...Deep Learning for Face Recognition ... and X. Tang, “Hybrid Deep

NCAP Summer School 2010 Tutorial on: Deep Learning

Socher & Manning's Deep Learning for NLP tutorialnlp.stanford.edu/courses/NAACL2013/NAACL2013-Socher...Socher & Manning's Deep Learning for NLP tutorial

Tutorial: Learning Deep Architectures - University of …rsalakhu/deeplearning/yoshua_icml2009.pdf · Tutorial: Learning Deep Architectures Yoshua Bengio, U. Montreal Yann LeCun,

Deep learning tutorial with theano study - CH 3, CH 4

IEEE GLOBECOM 2020 Tutorial on Distributed Deep Learning

Deep Learning Tutorial: From Perceptrons to Deep Networks

Tutorial: Learning Deep Architectures

ELEG5491: Introduction to Deep Learning PyTorchBasics Tutorial

CIAR Summer School Tutorial Lecture 2b Learning a Deep Belief Net

CVPR 2012 Tutorial Deep Learning Methods for Vision …fergus/tutorials/deep_learning_cvpr... ·  · 2012-06-17CVPR 2012 Tutorial Deep Learning Methods for Vision (draft) ... Object

A Tutorial on Deep Learning for Music Information Retrieval Tutorial on Deep Learning for Music Information Retrieval Keunwoo Choi [email protected] György Fazekas [email protected]