University of São Paulo

Institute of Mathematics and Statistics

Department of Computer Science

Locating and Tracking Facial Landmarks Locating and Tracking Facial Landmarks with Gabor Wavelet Networkswith Gabor Wavelet Networks

Rogério Schmidt Feris

Roberto Marcondes Cesar Junior{rferis,cesar}@ime.usp.br

OutlineOutline

Motivation

Face Representation Using GWNs

Locating and Tracking Facial Landmarks

Experimental Results

Conclusions

MotivationMotivation

Face Recognition from Video Sequences

Problem Assumptions

Gabor Wavelet NetworksGabor Wavelet Networks

)2()2

1exp()( xusinxxx TT

Wavelet Networks

Mother Wavelet: Odd-Gabor Function

f x w xi ni

M

i

~

( ) ( )

1

Face Representation Using GWNsFace Representation Using GWNs

cossin

sin-cos RRotation

ysDilation

0

0sS

x

y

x

c

cc nTranslatio

))(()( cxSRxn

},...,,{21 Mnnn

),,,,( yxyx ssccn

Face Representation Using GWNsFace Representation Using GWNs2

,)(min

i

niiwn

fwfEi

ii

Original Image Wavelet Representation

Wavelet parameters are chosen from the continuous parameters space !!

Face Representation Using GWNsFace Representation Using GWNs

Progressive Attention

Interest32, 52, 100 and 320 wavelets

Direct Calculation of Weights

Face Representation Using GWNsFace Representation Using GWNs

GWN Reparametrization

Face Representation Using GWNsFace Representation Using GWNs

Superwavelet

))(()( cxSRwxi

nin i

),,,,,( xyyxyx sssccn

y

xyx

s

ssS

0

Reparametrization

2min n

ngE

Locating Facial LandmarksLocating Facial Landmarks

Reparametrization in Different Individuals

Optimization Using a Mean Face (Small Databases)

Locating Facial Landmarks

Yale Face Database

Locating Facial LandmarksLocating Facial Landmarks

Tracking Facial LandmarksTracking Facial Landmarks

Reparametrization in each Frame

Overall Face Geometry is Considered

Robustness and Efficiency

2min

tt

ntn

JE

Experimental ResultsExperimental Results

Face Detection Positioning of Facial Landmarks Tracking of Face and Facial Landmarks

http://www.ime.usp.br/~rferis

ConclusionsConclusions

Method Efficient and Robust

Limitations

Future Work

Improve Positioning of Facial Landmarks

3D Wavelet Model

http://www.ime.usp.br/~rferis

Questions ?Questions ?

rferis@ime.usp.br

Rogério Schmidt Feris