1 center for machine perception belongs to: czech technical university in prague faculty of...

1

Center for Machine Perception

Belongs to:• Czech Technical University in

Prague• Faculty of Electrical Engineering• Department of Cybernetics

(head Prof. Vladimír Mařík)Head:

Prof. Václav Hlaváč

http://cmp.felk.cvut.cz

2

Group outline and interests

• University research group established as a computer vision lab in 1986.

• Computer vision, pattern recognition, mathematics of uncertainty

• 26 staff members (2 profs., 2 assoc. profs., 6 assist. profs., 13 researchers, 3 support staff)

• 10 full time PhD students, 15 MSc student theses in progress.

Omni Stereo Reconstruction Recognition Tracking Medical

3

EU IST funded projects

DIPLECS (T. Werner), Dirac (T. Pajdla), e-Trims (R. Šára), VISIONTRAIN (V. Hlaváč), Marie-Curie RTN WARTHE (V. Hlaváč), Marie-Curie RTN.

Past projects: COSPAL (V. Hlaváč, cognitive learning), PRINCESS (V. Hlaváč, structural pattern recognition, paid by INTAS), ActIPret (V. Hlaváč, human action interpretation), BeNoGo, OMNNIVIEWS (T. Pajdla, omnidirectional vision), ISAAC (V. Hlaváč) Image Analysis for Sewer Inspection)

4Nationally funded• 3D reconstruction (R. Šára)

• Multicamera human tracking (T. Svoboda)

• Registration in medical imaging (J. Kybic)

Industry:

• Samsung, Korea (face verification technology)• Bosch, Germany (3D reconstruction)• Boeing, USA (object recognition)• Honeywell, USA (video analysis)• Volkswagen A.G., Germany (vision in a smart car) • Czech Air Force, (vision for autonomous aerial vehicle)• Toyota Motor Company, Japan (vision in a smart car)• Hitachi Central Research Lab, Japan (human faces)• Neovision, Czech Rep. (quality inspection & control)• , Czech Rep. (road traffic monitoring)

National and industrial projects

5

Academic research interests

Geometry of 3D vision (T. Pajdla) Correspondence problem, stereo (R. Šára) Statistical and structural pattern recognition

(V. Hlaváč, J. Matas) Optimization on MRFs (T. Werner) Object recognition in images, face detection

(J. Matas) Mathematics of uncertainty (M. Navara, P.

Pták) Multicamera systems (T. Svoboda) Registration in medical images (J. Kybic)

6

Omnidirectional vision and mosaicing

7

Omni image-based rendering

Circular motion

8

Omni-based rendering, an example

Video, click on it.

9

Image matching and recognition

10

One way sign detection

Video, click on it.

11

Stereo & Reconstruction

Video, click on it.

12

3D reconstruction from images

3D recontruction from unorganized image set

input data result

VRML demoVideo, click on it.

13

Model-based detection and tracking of humans in video

Video, click on it.

14

Model-based detection and tracking of humans in video

Video, click on it.

15

Deformable surface matching asMarkov Random Field optimization

Given two images, estimate a mapping from one image to another providing best visual alignment.

We apply discrete approximation over large search space.

Video, click on it.

16

Multicamera tracking

Video, click on it.

17

Medical Imaging

deformation map

}elasticregistrationof cervicaluterus images

• Image registration • Parallel MRI reconstruction • Object detection in ultrasound signal • MEG/EEG reconstruction

18

Medical Imaging

19

Airborne surveillance

• Cooperation with Czech Airforce R&D unit

• Unmanned aerial vehicle

• The aim is the detection of moving vehicles on a ground (speed 20-150 km/h)

• Compensation for own UAV motion necessary

20

UAV, tracked vehicles

Red and blue blobs point to moving vehicles. Two colorsallow to distinguish the movement direction.

Video, click on it.

21

Tracking, stabilization

Video, click on it.

22

Tracking, stabilization 2

Video, click on it.

23

Stabilized camera head

Developed on the Czech Air Force demand of from 2006 to 2008.

Two CTU teams: Dept. of Cybernetics and Dept. of Control Engineering.

Two feedbacks: • the fast one dumps

vibrations of the UAV, • the slow one tracks the

target.

24

Stabilized camera head, testVideo, click on it.

25

Sputnik tracker

Tracking with a companion.

Finds the companion automatically.

Does not loose tracks when the template is not visible.

Video, click on it.

26

Neovision s.r.o.

• Spin-off company• Founded in 1996• 18 employees• Transfer from CMP to industry

CustomersAVX Czech Republic s.r.o.Czech RepublicTantalum capacitors

Texas Instruments, Inc.USA

Preciosa a.s.Czech Republic

Siemes VDO Frenštát p. Radhoštěm

quality control &precise measurementby image processing

27 Founded in 2006, 4 staff, http://www.eyedea.cz Commercializes results of J. Matas’s group. Main applications in traffic surveillance.