facial feature localization presented by: harvest jang spring 2002
TRANSCRIPT
![Page 1: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/1.jpg)
Facial feature localization
Presented by: Harvest JangSpring 2002
![Page 2: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/2.jpg)
OutlineIntroductionAlgorithmEvaluationFuture work
![Page 3: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/3.jpg)
IntroductionFace feature extraction
Low-bit-rate video codingHuman computer interactionHuman face recognition
Automatically facial features Accuracy VS Performance
![Page 4: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/4.jpg)
AlgorithmStep 1: Check image is human face or notStep 2: Find the face boundaryStep 3: Find the eye regionStep 4: Find the horizontal nose positionStep 5: Find the position of irisStep 6: Find the vertical mouth position
![Page 5: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/5.jpg)
Human face checkingUse eigenface method
40 images as training set15 eigenvector for representationSubtract the image with the mean imageProjection the image to the eigenvectorCalculate the distance between the eigenvector and the projection imageSelecting the threshold to reject image
![Page 6: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/6.jpg)
Example
Distance=5223 Distance=4992 Distance=7677
Distance=4544 Distance=3729
*can’t find face boundary
Distance=4303
*can’t find eye region
![Page 7: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/7.jpg)
Face BoundaryAssume the picture is simple backgroundUse SOBEL filter for edge detectionUse horizontal projection of the binary image to find left and right face boundaries
Sobel filter
![Page 8: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/8.jpg)
Eye RegionUse vertical projection to find possible eye regionVerify by property of symmetric of two eyes
Vertical projection of the binary image
![Page 9: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/9.jpg)
Horizontal Nose PositionUse dynamic method to binaries the image
Find the selective thresholdCheck the fill factorRobust to skin color
Use horizontal projection of this binary image
![Page 10: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/10.jpg)
Dynamic binarizationUse intensity histogram to two peak
Skin intensityFeature intensity
Calculate the threshold for binaries with fill factor
skin intensity
feature intensity
Image histogram of the image
![Page 11: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/11.jpg)
Example
Original image
Figure 1
Figure 3
Figure 2
![Page 12: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/12.jpg)
Determine the nose position
Use horizontal projection of the new binary image regionCharacteristics
Three peak two valleys
3 peaks
2 valleys
Horizontal projection of the binary image region
Black line:
Final nose position
![Page 13: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/13.jpg)
Position of irisDivide the eye region into two partsCompute normalized cross-correlation of image and the eye template at each partFind the maximum value (max = 1)
Left and right eye template Correlation result
Left and right part of the eye region
![Page 14: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/14.jpg)
Position of mouthUse the aspect ratio to find
Distance (d) between two eyesDistance between the mouth and eye ( about 1.0d – 1.3d)
![Page 15: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/15.jpg)
Position of mouthUse vertical projectionFind the minimum value
Vertical projection of the binary image mouth region
binary image of mouth region
![Page 16: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/16.jpg)
EvaluationORL face database
40 subjects10 different photos for each subjects
MachineSun Ultra 5/400
97s for 400 photos
![Page 17: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/17.jpg)
Evaluation – ORL face database
Correct #
Error rate(%)
Eye region
393 1.75
Nose pos 376 6.00
Left iris 336 16.00
Right iris 312 22.00
Mouth pos
321 19.75
![Page 18: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/18.jpg)
Future workImprove the accuracy of finding irisDetect human face from a large imageDetect face from video/web cam (face-tracking)
![Page 19: Facial feature localization Presented by: Harvest Jang Spring 2002](https://reader036.vdocuments.site/reader036/viewer/2022062515/56649cfe5503460f949ce1ae/html5/thumbnails/19.jpg)
Thank you!