object recognition 2cvlab.khu.ac.kr/cvlecture20.pdf · 2018-11-27 · vgg net 4 vgg “very deep...
TRANSCRIPT
![Page 1: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/1.jpg)
Object Recognition 2
Computer Vision
![Page 2: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/2.jpg)
![Page 3: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/3.jpg)
Alex Net
3
“ImageNet Classification with Deep Convolutional Neural Networks”, 2012
- ImageNet - ReLU, Dropout, Data augmentation
![Page 4: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/4.jpg)
VGG Net
4
VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015
- ILSVRC 2014 Winner (localization and classification) - 3x3 conv, 2x2 pooling and deeper layers
![Page 5: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/5.jpg)
GoogLeNet
5
GoogleNet “Going deeper with convolutions”, 2014
- ILSVRC 2014 - Inception modules, more than 100 layers
![Page 6: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/6.jpg)
ResNet
6
MS ResNet “Deep Residual Learning for Image Recognition”, 2015
- ILSVRC 2015 Winner - Residual Block, 152 layers
![Page 7: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/7.jpg)
R-CNN
7
R-CNN “Rich feature hierarchies for accurate object detection and semantic segmentation”
- Object detection including classification
![Page 8: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/8.jpg)
![Page 9: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/9.jpg)
![Page 10: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/10.jpg)
![Page 11: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/11.jpg)
![Page 12: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/12.jpg)
![Page 13: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/13.jpg)
![Page 14: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/14.jpg)
![Page 15: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/15.jpg)
![Page 16: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/16.jpg)
![Page 17: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/17.jpg)
![Page 18: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/18.jpg)
Object Recognition in 3D
Computer Vision
![Page 19: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/19.jpg)
![Page 20: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/20.jpg)
![Page 21: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/21.jpg)
![Page 22: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/22.jpg)
https://www.youtube.com/watch?v=-l4ih6bpNTQ
https://www.youtube.com/watch?v=C4DO1nPJo1U
https://www.youtube.com/watch?v=lPQZIrdIo0g
https://www.youtube.com/watch?v=BjL-DW4jVEM
![Page 23: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/23.jpg)
Introduction to the Literature
23
![Page 24: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/24.jpg)
Top Conference in Computer Vision
1. CVPR
2. ICCV
3. ECCV
Top Journal in Computer Vision
1. IEEE TPAMI (IF: 9.455, JCR Ranking 2nd ~0.8%)
2. Springer IJCV (IF: 11.541, JCR Ranking 1st ~1.5%)
h-index: a scholar with an index of h has published h papers
each of which has been cited in other papers at least h times
![Page 25: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/25.jpg)
![Page 26: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/26.jpg)
![Page 27: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/27.jpg)
![Page 28: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/28.jpg)
https://scholar.google.com/citations?view_op=top_venues&hl=en&vq=eng_computervisionpatternrecognition
![Page 29: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/29.jpg)
https://www.thecvf.com/ http://ieeexplore.ieee.org/
![Page 30: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/30.jpg)
Oral presentation
Spotlight presentation
Poster presentation
CVPR 2018 conference
2 column < 9 pages
Peer Review by
AC & 3 Reviewers
~ 3300 submissions ~ 970 accepted papers
![Page 31: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/31.jpg)
![Page 32: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/32.jpg)
![Page 33: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/33.jpg)
![Page 34: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/34.jpg)
![Page 35: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/35.jpg)
![Page 36: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/36.jpg)
Final Project
Computer Vision
![Page 37: Object Recognition 2cvlab.khu.ac.kr/CVLecture20.pdf · 2018-11-27 · VGG Net 4 VGG “Very Deep Convolutional Networks for Large-Scale Image Recognition“. 2015 - ILSVRC 2014 Winner](https://reader034.vdocuments.site/reader034/viewer/2022050509/5f9a13510e21d2221f46f457/html5/thumbnails/37.jpg)
Topics 1. Stereo Matching Improvement
- 수업시간에 배운 방식으로 최적의 성능 내기 + Dynamic Programming 추가
- 기타 새로운 문제 해결 방식 추가: Occlusion, Hole filling, Boundary noise, thin object, non-textured region
Dataset: http://vision.middlebury.edu/stereo/data/scenes2014/
2. Panorama using Homography
- 신뢰도 높고 더 많은 Matching point pair 찾기: ex) SIFT, etc
- Homography 계산 정확도 향상, tone mapping
Dataset: use your own pictures (more than 10 images)
3. Change Detection
- 개선된 Detection Result
- 노이즈 제거, Clutter 제거, Morphological post procession
Dataset: http://jacarini.dinf.usherbrooke.ca/static/dataset/badWeather/skating.zip
4. CNN based Classification using Tensorflow and MNIST
- 개선된 Classification Result on distorted (affine, occlusion, noisy) test images
제출 내용: Commented Source Code, Result Images, Report Document
Pick one!!!!