![Page 1: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/1.jpg)
1
Learning to Compute the Symmetry Plane for Human Faces
Jia Wu ([email protected])ACM-BCB '11, August 2011
![Page 2: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/2.jpg)
3
Landmark by medical experts
Landmarks labeled by experts
Standard symmetry plane
![Page 3: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/3.jpg)
4
Flow chart for training
Landmarks from medical experts
Landmark model training
Points predicted as interesting regions Connected regions
Standard symmetry plane
Symmetry model training
![Page 4: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/4.jpg)
5
10 kinds of landmarks.
– Nose: ac (nose side), prn, sn,se
– Eyes: en, ex– Mouth: (li,ls), ch,
sto– Chin: slab
![Page 5: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/5.jpg)
6
Positive/negative samples
Training for en: the inner corners of the eyes
Training for prn: most protruded point of nasal tip
![Page 6: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/6.jpg)
7
Features: mean and Gaussian curvatures for original head and smoothed head
![Page 7: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/7.jpg)
8
Flow chart
Landmarks from medical experts
Landmark model training
Points predicted as interesting Connected regions
Standard symmetry plane
Symmetry model training
![Page 8: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/8.jpg)
9
Interesting points prediction
Prediction of en: the inner corners of the eyes
Prediction of prn: most protruded point of nasal tip
![Page 9: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/9.jpg)
10
Connected regions
Connected regions for en: each color means one region
Connected regions for prn: each color means one region
![Page 10: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/10.jpg)
11
Flow chart
Landmarks from medical experts
Landmark model training
Points predicted as interesting regions Connected regions
Standard symmetry plane
Symmetry model training
![Page 11: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/11.jpg)
12
How to define “good” symmetric regions• A “good” pair of regions should be symmetric to the standard
symmetry plane• A “good” single region should have the center on the standard
symmetry plane
“good” regions for en “good” regions for prn
![Page 12: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/12.jpg)
13
Feature for regions
Principal component analysis and eigenvalues
![Page 13: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/13.jpg)
14
Flow chart for training
Landmarks from medical experts
Landmark model training
Points predicted as interesting regions Connected regions
Standard symmetry plane
Symmetry model training
![Page 14: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/14.jpg)
15
Procedure for New dataSelect possible landmark
areas( from Landmark model)
Find and pair connected regions
Determine good singles and good pairs ( from Symmetry model)
Get center and draw a plane using learned centers
interesting regions for prn
Predicted as good single
Predicted as good pair
![Page 15: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/15.jpg)
16
Procedure for New Images
Centers of good regions Centers for constructing plane of symmetry Result: Plane of symmetry
![Page 16: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/16.jpg)
17
Experiments
• Compare the plane of symmetry to– Ground truth (plane determined by expert labeled
landmarks)– Mirror method in literature
• Ground truth dataset 1• Ground truth dataset 2• Cleft dataset
![Page 17: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/17.jpg)
18
Mirror method in literature
![Page 18: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/18.jpg)
19
Results compare to ground truth
• Yellow: overlapping with ground truth• Green: ground truth• Purple: extra from each method
our methodAngle:4.03˚
mirror methodAngle:2.15˚
![Page 19: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/19.jpg)
20
Results compare to ground truth
• Yellow: overlapping with ground truth -> true positive• Green: ground truth -> false negative• Purple: extra from each method -> false positive
our method mirror method
![Page 20: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/20.jpg)
21
best
worst
worst
best
![Page 21: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/21.jpg)
22
Ground truth dataset 2
1 2 3 4 5
6 7 8 9 10
![Page 22: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/22.jpg)
23
0 30 60 90
0
1 2 4 7
30
3 5 8 11
60
6 9 12 14
90
10 13 15 16
![Page 23: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/23.jpg)
24
best
worst
worst
best
![Page 24: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/24.jpg)
25
![Page 25: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/25.jpg)
26
Cleft dataset
Learning method
Mirror method
![Page 26: Learning to Compute the Symmetry Plane for Human Faces](https://reader036.vdocuments.site/reader036/viewer/2022062305/56816335550346895dd3bf7a/html5/thumbnails/26.jpg)
27
Questions?