robust visual tracking a brief summary

24
1 ROBUST VISUAL TRACKING A Brief Summary Gagan Mirchandani School of Engineering, University of Vermont 1 1 And Ben Schilling, Clark Vandam, Kevin Haupt

Upload: kaveri

Post on 12-Jan-2016

39 views

Category:

Documents


0 download

DESCRIPTION

ROBUST VISUAL TRACKING A Brief Summary. 1. Gagan Mirchandani School of Engineering, University of Vermont. 1. And Ben Schilling, Clark Vandam, Kevin Haupt. Algorithms from [1],[2]. Examples from [2]. Videos from [3]. [1] J.Wright, A.Y.Yang, A.Ganesh, S.S.Sastry and Y.Ma, - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: ROBUST  VISUAL  TRACKING A Brief Summary

1

ROBUST VISUAL TRACKING

A Brief Summary

Gagan MirchandaniSchool of Engineering, University of Vermont

1

1 And Ben Schilling, Clark Vandam, Kevin Haupt

Page 2: ROBUST  VISUAL  TRACKING A Brief Summary

2

[1] J.Wright, A.Y.Yang, A.Ganesh, S.S.Sastry and Y.Ma, "Robust Face Recognition via Sparse Representation" IEEE Trans. PAMI , Feb. 2009, Vol.31, Issue:2, pp.210-227.

[2] X.Mei and H.Ling, "Robust Visual Tracking and Vehicle Classication via Sparse Representation" IEEE Trans. PAMI , Nov. 2011, Vol.33, Isssue:11, pp.2259-2272.

[3] Ben Schilling, Clark Vandam, Kevin Haupt

Algorithms from [1],[2]. Examples from [2].Videos from [3].

Page 3: ROBUST  VISUAL  TRACKING A Brief Summary

3

1. Introduction

• Background, Goals

• Tracking and Recognition - important topics in Computer Vision

• Studied for decades

Page 4: ROBUST  VISUAL  TRACKING A Brief Summary

4

2. Problem Areas

•• Tracking, recognition and counting objects (pedestrians, vehicles, bicyclists, etc. etc.)

• Needed for Policy determination, optimal traffic management, reduction of fuel, CO2 emission, etc.

• Needed for Surveillance

• Needed for Robotics

Page 5: ROBUST  VISUAL  TRACKING A Brief Summary

5

3. Challenges

• Occlusion, noise, cluttered real-world environment

• Illumination change, many people, changing pose

• Changing background, real-time online implementation

• Computational complexity grows exponentially

Page 6: ROBUST  VISUAL  TRACKING A Brief Summary

6

4. Theory

Basic problem: Given measurements y - Find x

Page 7: ROBUST  VISUAL  TRACKING A Brief Summary

7

Bayesian State Estimation

If f and h linear (and noise Gaussian) then we get the Kalman filter

Page 8: ROBUST  VISUAL  TRACKING A Brief Summary

8

Target candidate represented as sum of 10 templates (from previous frames) and trivial templates

Page 9: ROBUST  VISUAL  TRACKING A Brief Summary

9

Page 10: ROBUST  VISUAL  TRACKING A Brief Summary

10

Estimation Method•Particle filters numerically generate

the particles

• according to the pdf

•This is tracking. The particle filter propagates sample pdfs over time

•Computational effort often a bottleneck

Page 11: ROBUST  VISUAL  TRACKING A Brief Summary

11

5. Examples & Videos

Page 12: ROBUST  VISUAL  TRACKING A Brief Summary

12

Target candidate represented as sum of 10 templates (from previous frames) and trivial templates

Page 13: ROBUST  VISUAL  TRACKING A Brief Summary

13

Person walking; passing pole, high grass, body movement, occlusion.

Page 14: ROBUST  VISUAL  TRACKING A Brief Summary

14

Fast moving car with significant scale changes

Page 15: ROBUST  VISUAL  TRACKING A Brief Summary

Video taken from car in the back. Doll has pose & scale change and occlusion

Page 16: ROBUST  VISUAL  TRACKING A Brief Summary

16

L1, MS, CV, AAPF & ES Trackers

Page 17: ROBUST  VISUAL  TRACKING A Brief Summary

17

Drastic illumination change

Page 18: ROBUST  VISUAL  TRACKING A Brief Summary

18

Partial occlusion, background clutter

Page 19: ROBUST  VISUAL  TRACKING A Brief Summary

19

Severe occlusion

Page 20: ROBUST  VISUAL  TRACKING A Brief Summary

20

Face rotates 180 . Car moves out of frame.o

Page 21: ROBUST  VISUAL  TRACKING A Brief Summary

21

QuickTime™ and a decompressor

are needed to see this picture.

QuickTime™ and a decompressor

are needed to see this picture.

Page 22: ROBUST  VISUAL  TRACKING A Brief Summary

22

QuickTime™ and a decompressor

are needed to see this picture.

QuickTime™ and a decompressor

are needed to see this picture.

Page 23: ROBUST  VISUAL  TRACKING A Brief Summary

23

Page 24: ROBUST  VISUAL  TRACKING A Brief Summary

24

Questions?