depth sensors - uni-hamburg.de · savitha ws 2014nagaraju -15 intelligent robotics seminar 2 ....

31
Depth Sensors WS 2014-15 Intelligent Robotics Seminar by Savitha Nagaraju 1

Upload: others

Post on 15-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Depth Sensors

WS 2014-15 Intelligent Robotics Seminar

by Savitha Nagaraju

1

Page 2: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Kinect Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 2

Page 3: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Kinect Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 3

Page 4: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 4

RGB Camera

Page 5: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 5

RGB Camera

RGB Camera

Page 6: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 6

RGB Camera

RGB Camera

Page 7: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 7

RGB Camera

RGB Camera

Page 8: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 8

Page 9: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 9

RGB Camera

Depth Camera

Page 10: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 10

Speckle patterns

Page 11: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Why Depth Sensors?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 11

Source : http://learning.codasign.com/index.php?title=Drawing_Depth_with_the_Kinect

Page 12: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 12

Page 13: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Stereo Triangulation

Time Of Flight

Coded Aperture

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 13

Page 14: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Stereo Triangulation

Savitha Nagaraju 14

WS 2014-15 Intelligent Robotics Seminar

Source:https://courses.cs.washington.edu/courses/cse455/09wi/Lects/lect16.pdf

Page 15: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Time Of Flight

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 15

Source :http://www.ti.com/lit/wp/sloa190b/sloa190b.pdf

Page 16: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Coded Aperture

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 16

Page 17: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Coded Aperture

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 17

Source:Image and Depth from a Conventional Camera with a Coded Aperture Anat Levin, Rob Fergus, Fredo Durand, Bill Freeman appeared in SIGGRAPH 2007

Page 18: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Techniques in Depth Sensors

Coded Aperture

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 18

Source:Image and Depth from a Conventional Camera with a Coded Aperture Anat Levin, Rob Fergus, Fredo Durand, Bill Freeman appeared in SIGGRAPH 2007

Page 19: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Kinect Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 19

Page 20: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Types Of Depth Sensors

Intel Perceptual Computing

Leap Motion

Microsoft Kinect

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 20

Page 21: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Types Of Depth Sensors

Intel Perceptual Computing

•Smaller and less expensive

•Close range tracking

•Hand posture

•Facial analysis

•Speech

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 21

Page 22: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Types Of Depth Sensors

Leap Motion

•Finger tracking is fast and accurate

•Smaller and less expensive

•Compatible with Mac OS and Windows

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 22

Page 23: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Types Of Depth Sensors

Microsoft Kinect

•Most popular among the depth sensors

•It can track 20 joints in human skeleton

•Upto 6 people can be detected and 2 skeletons

can be tracked

•Kinect for windows have near mode which

can track skeleton in sitting position

•Current version is v2.0

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 23

Page 24: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Kinect Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 24

Page 25: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Application Of Kinect Depth Sensors

Object detection and tracking

Pose Estimation

Hand Gesture Analysis

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 25

Page 26: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Application Of Kinect Depth Sensors

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 26

Source:Enhanced Computer Vision with Microsoft Kinect Sensor: A Review Jungong Han, Member, IEEE, Ling Shao, Senior Member, IEEE, Dong Xu, Member, IEEE, and Jamie Shotton, Member, IEEE

Page 27: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Application Of Kinect Depth Sensors

Pose Estimation

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 27

Source:Enhanced Computer Vision with Microsoft Kinect Sensor: A Review Jungong Han, Member, IEEE, Ling Shao, Senior Member, IEEE, Dong Xu, Member, IEEE, and Jamie Shotton, Member, IEEE

Page 28: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Application Of Kinect Depth Sensors

Hand Gesture Recognition

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 28

Source:Enhanced Computer Vision with Microsoft Kinect Sensor: A Review Jungong Han, Member, IEEE, Ling Shao, Senior Member, IEEE, Dong Xu, Member, IEEE, and Jamie Shotton, Member, IEEE

Page 29: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Contents

Why Depth Sensors?

Techniques in Depth Sensors

Types Of Depth Sensors

Application Of Kinect Depth Sensors

Summary

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 29

Page 30: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Summary

•Principle used in Depth Sensors

•Stereo Triangulation, Time of flight, Coded Aperture

•Intel Perceptual Computing, Leap Motion, Microsoft Kinect

•Applications

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 30

Page 31: Depth Sensors - uni-hamburg.de · Savitha WS 2014Nagaraju -15 Intelligent Robotics Seminar 2 . Contents Why Depth Sensors ... •Compatible with Mac OS and Windows Savitha WS 2014Nagaraju

Questions?

Savitha Nagaraju WS 2014-15 Intelligent Robotics Seminar 31