![Page 1: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/1.jpg)
Chenglei Wu2, Derek Bradley1, Pablo Garrido3, Michael Zollhöfer3,
Christian Theobalt3, Markus Gross1,2, Thabo Beeler1
1Disney Research 2ETH Zurich 3Max Planck Institute for Informatics
Model-Based Teeth Reconstruction
![Page 2: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/2.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 2
MOTIVATION
Michael Zollhöfer Model-Based Teeth Reconstruction 2
![Page 3: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/3.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 3
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 3
![Page 4: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/4.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 4
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 4
Berard16
![Page 5: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/5.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 5
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 5
Berard16
Bermano16
![Page 6: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/6.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 6
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 6
Beeler12
Berard16
Bermano16
![Page 7: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/7.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 7
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 7
Beeler12
Berard16
Bermano16
Nagano15
![Page 8: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/8.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 8
MOTIVATION
Input Image Beeler11
Michael Zollhöfer Model-Based Teeth Reconstruction 8
Beeler12
Berard16
Bermano16
Nagano15
Hu14
![Page 9: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/9.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 9
Teeth are missing!
MOTIVATION
Input Image Beeler11
![Page 10: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/10.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 10
MOTIVATION
Input Image Beeler11
Teeth are missing!
![Page 11: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/11.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 11
Complex Appearance
MOTIVATION
Input Image Beeler11
Teeth are missing!
![Page 12: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/12.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 12
Complex Appearance
Featureless
MOTIVATION
Input Image Beeler11
Teeth are missing!
![Page 13: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/13.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 13
Complex Appearance
Occlusions
Featureless
MOTIVATION
Input Image Beeler11
Teeth are missing!
![Page 14: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/14.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 14
Complex Appearance
Occlusions
Featureless
Input Image Our Reconstruction
Teeth are missing!
MOTIVATION
![Page 15: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/15.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 15
RELATED WORK
![Page 16: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/16.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 16
Medical Dentistry
RELATED WORK
From CT images [Omachi07, Yanagisawa14]
![Page 17: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/17.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 17
Medical Dentistry
RELATED WORK
From CT images [Omachi07, Yanagisawa14]
Intra-Oral Scanners[3M True Definition, iTero, 3Shape TRIOS]
![Page 18: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/18.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 18
Medical Dentistry
RELATED WORK
From CT images [Omachi07, Yanagisawa14]
Intra-Oral Scanners[3M True Definition, iTero, 3Shape TRIOS]
Photogrammetric Reconstruction
Shape from Shading[Carter10, Farag13, Mostafa14]
![Page 19: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/19.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 19
Medical Dentistry
RELATED WORK
From CT images [Omachi07, Yanagisawa14]
Intra-Oral Scanners[3M True Definition, iTero, 3Shape TRIOS]
Photogrammetric Reconstruction
Shape from Shading[Carter10, Farag13, Mostafa14]
Contours and Feature Points[Zheng11]
![Page 20: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/20.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 20
Medical Dentistry
RELATED WORK
From CT images [Omachi07, Yanagisawa14]
Intra-Oral Scanners[3M True Definition, iTero, 3Shape TRIOS]
Photogrammetric Reconstruction
Shape from Shading[Carter10, Farag13, Mostafa14]
Contours and Feature Points[Zheng11]
Statistical Models[Mehl05, Buchaillard07]
![Page 21: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/21.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 21
HUMAN TEETH
Scans
![Page 22: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/22.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 22
HUMAN TEETH
Scans
![Page 23: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/23.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 23
HUMAN TEETH
Scans
![Page 24: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/24.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 24
OVERVIEW
Scans
![Page 25: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/25.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 25
OVERVIEW
Scans
Static Images/Video Clip
![Page 26: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/26.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 26
OVERVIEW
Scans
Contour Extraction
Static Images/Video Clip
![Page 27: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/27.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 27
OVERVIEW
Teeth Prior Model
Scans
Dental Scans
Contour Extraction
Static Images/Video Clip
![Page 28: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/28.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 28
OVERVIEW
Teeth Prior Model
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 29: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/29.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 29
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Static Images/Video Clip
Dental Scans
![Page 30: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/30.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 30
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 31: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/31.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 31
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 32: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/32.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 32
TEETH MODEL
• 86 high resolution plaster cast scans
![Page 33: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/33.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 33
TEETH MODEL
• 86 high resolution plaster cast scans
![Page 34: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/34.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 34
Teeth Segmentation Fitted Template
PREPROCESSING
![Page 35: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/35.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 35
Input Scan Teeth Segmentation Fitted Template
PREPROCESSING
![Page 36: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/36.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 36
Input Scan Teeth Segmentation Fitted Template
PREPROCESSING
![Page 37: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/37.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 37
Input Scan Teeth Segmentation Fitted Template
PREPROCESSING
![Page 38: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/38.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 38
𝐙𝛕 = 𝐒 𝑻τ 𝐀𝛕 +
𝐢
𝛂𝛕𝐢𝐁𝛕𝐢
PARAMETRIC TEETH MODEL
![Page 39: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/39.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 39
𝐙𝛕 = 𝐒 𝑻τ 𝐀𝛕 +
𝐢
𝛂𝛕𝐢𝐁𝛕𝐢
PARAMETRIC TEETH MODEL
𝐀𝛕
![Page 40: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/40.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 40
𝐙𝛕 = 𝐒 𝑻τ 𝐀𝛕 +
𝐢
𝛂𝛕𝐢𝐁𝛕𝐢
PARAMETRIC TEETH MODEL
𝛂𝛕𝐢𝐁𝛕𝐢
𝐀𝛕
shape of tooth 𝛕
![Page 41: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/41.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 41
𝐙𝛕 = 𝐒 𝑻τ 𝐀𝛕 +
𝐢
𝛂𝛕𝐢𝐁𝛕𝐢
PARAMETRIC TEETH MODEL
𝛂𝛕𝐢𝐁𝛕𝐢
𝑻τ
𝐀𝛕
position of tooth 𝛕 shape of tooth 𝛕
![Page 42: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/42.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 42
𝐙𝛕 = 𝐒 𝑻τ 𝐀𝛕 +
𝐢
𝛂𝛕𝐢𝐁𝛕𝐢
PARAMETRIC TEETH MODEL
𝛂𝛕𝐢𝐁𝛕𝐢
𝑻τ
𝐀𝛕𝐒
Scale and position position of tooth 𝛕 shape of tooth 𝛕
![Page 43: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/43.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 43
GAUSSIAN DISTRIBUTION
𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
![Page 44: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/44.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 44
GAUSSIAN DISTRIBUTION
• All dimensions modeled via multivariate Gaussians
𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
![Page 45: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/45.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 45
GAUSSIAN DISTRIBUTION
• All dimensions modeled via multivariate Gaussians
𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
![Page 46: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/46.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 46
GAUSSIAN DISTRIBUTION
• All dimensions modeled via multivariate Gaussians
𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
𝒑 𝑿
Teeth Prior
![Page 47: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/47.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 47
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 48: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/48.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 48
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 49: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/49.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 49
CONTOUR EXTRACTION
Scans
![Page 50: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/50.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 50
CONTOUR EXTRACTION
Scans
• Teeth are featureless
![Page 51: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/51.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 51
CONTOUR EXTRACTION
Scans
• Teeth are featureless
Except the silhouette
![Page 52: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/52.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 52
CONTOUR EXTRACTION
Scans
• Teeth are featureless
Except the silhouette
.
![Page 53: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/53.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 53
CONTOUR EXTRACTION
Scans
Boosted Edge Learning (BEL)
• Teeth are featureless
Except the silhouette
.
![Page 54: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/54.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 54
FEATURE FUSION
Scans
![Page 55: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/55.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 55
FEATURE FUSION
Scans
Input
![Page 56: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/56.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 56
FEATURE FUSION
Scans
Input
BEL
![Page 57: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/57.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 57
FEATURE FUSION
Scans
Input
BEL
Gabor
![Page 58: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/58.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 58
FEATURE FUSION
Scans
Input
BEL
Gabor
Fusion
![Page 59: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/59.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 59
FEATURE FUSION
Scans
Input
BEL
Gabor
Fusion
Formulas in the paper!
![Page 60: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/60.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 60
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 61: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/61.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 61
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 62: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/62.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 62
• Given detected contours 𝑪
TEETH FITTING
![Page 63: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/63.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 63
• Given detected contours 𝑪
• Find parameters: 𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
TEETH FITTING
![Page 64: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/64.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 64
• Given detected contours 𝑪
• Find parameters: 𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
𝑿∗ = 𝒂𝒓𝒈𝐦𝐚𝐱𝑿𝒑 𝑿 𝑪
= 𝒂𝒓𝒈𝐦𝐚𝐱𝑿[ 𝒑 𝑪 𝑿 ⋅ 𝒑 𝑿 ]
MAXIMUM A POSTERIORI (MAP) PROBLEM
![Page 65: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/65.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 65
• Given detected contours 𝑪
• Find parameters: 𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
𝑿∗ = 𝒂𝒓𝒈𝐦𝐚𝐱𝑿𝒑 𝑿 𝑪
= 𝒂𝒓𝒈𝐦𝐚𝐱𝑿[ 𝒑 𝑪 𝑿 ⋅ 𝒑 𝑿 ]
Teeth Edge Likelihood
MAXIMUM A POSTERIORI (MAP) PROBLEM
![Page 66: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/66.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 66
• Given detected contours 𝑪
• Find parameters: 𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
𝑿∗ = 𝒂𝒓𝒈𝐦𝐚𝐱𝑿𝒑 𝑿 𝑪
= 𝒂𝒓𝒈𝐦𝐚𝐱𝑿[ 𝒑 𝑪 𝑿 ⋅ 𝒑 𝑿 ]
Teeth Edge Likelihood
Teeth Prior
MAXIMUM A POSTERIORI (MAP) PROBLEM
![Page 67: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/67.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 67
• Given detected contours 𝑪
• Find parameters: 𝑿 = (𝐒 , 𝑻τ, {𝛂𝛕𝐢 })
𝑿∗ = 𝒂𝒓𝒈𝐦𝐚𝐱𝑿𝒑 𝑿 𝑪
= 𝒂𝒓𝒈𝐦𝐚𝐱𝑿[ 𝒑 𝑪 𝑿 ⋅ 𝒑 𝑿 ]
Teeth Edge Likelihood
Teeth Prior
MAXIMUM A POSTERIORI (MAP) PROBLEM
Solve with EM-Algorithm
![Page 68: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/68.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 68
EM ALGORITHM
![Page 69: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/69.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 69
EM ALGORITHM
![Page 70: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/70.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 70
EM ALGORITHM
![Page 71: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/71.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 71
EM ALGORITHM
![Page 72: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/72.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 72
EM ALGORITHM
![Page 73: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/73.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 73
EM ALGORITHM
![Page 74: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/74.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 74
EM ALGORITHM
![Page 75: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/75.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 75
E-STEP
![Page 76: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/76.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 76
TEETH EDGE LIKELIHOOD
𝒑 𝑪 𝑿
Teeth Edge Likelihood
![Page 77: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/77.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 77
TEETH EDGE LIKELIHOOD
𝒑 𝑪 𝑿
Teeth Edge Likelihood
𝒑𝒑 𝑪 𝑿
=
![Page 78: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/78.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 78
TEETH EDGE LIKELIHOOD
𝒑 𝑪 𝑿
Teeth Edge Likelihood
𝒑𝒑 𝑪 𝑿
𝒑𝒏 𝑪 𝑿
=
⋅
![Page 79: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/79.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 79
TEETH EDGE LIKELIHOOD
𝒑 𝑪 𝑿
Teeth Edge Likelihood
𝒑𝒑 𝑪 𝑿
𝒑𝒏 𝑪 𝑿
=
⋅
Formulas in the paper!
![Page 80: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/80.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 80
M-STEP
![Page 81: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/81.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 81
M-STEP
![Page 82: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/82.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 82
ITERATE
![Page 83: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/83.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 83
DONE
![Page 84: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/84.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 84
COLOR AND GUMS
![Page 85: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/85.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 85
COLOR AND GUMS
• Projective Texturing
![Page 86: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/86.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 86
Template
Gum Line
COLOR AND GUMS
• Projective Texturing
• Fit 3D gum template via Laplacian deformation
![Page 87: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/87.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 87
Template
Gum Line
Result
COLOR AND GUMS
• Projective Texturing
• Fit 3D gum template via Laplacian deformation
![Page 88: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/88.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 88
OVERVIEW
Teeth Prior Model 3D Reconstruction
Scans
Teeth Reconstruction
Contour Extraction
Dental Scans
Static Images/Video Clip
![Page 89: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/89.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 89
OVERVIEW
Teeth Prior Model 3D Reconstruction
Static Images/Video Clip
Teeth Reconstruction
Contour Extraction
Dental Scans
![Page 90: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/90.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 90
MULTI-VIEW IMAGES
![Page 91: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/91.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 91
MONOCULAR VIDEO
![Page 92: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/92.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 92
APPLICATION: TOOTH RESTORATION
1 tooth missing 2 teeth missing 4 teeth missing
![Page 93: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/93.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 93
APPLICATION: TOOTH RESTORATION
1 tooth missing 2 teeth missing 4 teeth missing
![Page 94: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/94.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 94
APPLICATION: TOOTH RESTORATION
1 tooth missing 2 teeth missing 4 teeth missing
![Page 95: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/95.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 95
APPLICATION: TOOTH RESTORATION
1 tooth missing 2 teeth missing 4 teeth missing
![Page 96: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/96.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 96
First non-invasive teeth reconstruction approach
CONCLUSION
![Page 97: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/97.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 97
First non-invasive teeth reconstruction approach
Content creation(i.e. digital actor)
CONCLUSION
![Page 98: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/98.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction 98
First non-invasive teeth reconstruction approach
Content creation(i.e. digital actor)
Dentistry(i.e tooth restoration)
CONCLUSION
![Page 99: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/99.jpg)
THANK YOU!
P. Garrido M. ZollhöferC. Wu D. Bradley T. BeelerC. Theobalt M. Gross
![Page 100: Model-Based Teeth Reconstructiongvv.mpi-inf.mpg.de/teaching/gvv_seminar_2019/slides/... · 2017-05-15 · Michael Zollhöfer Model-Based Teeth Reconstruction 20 Medical Dentistry](https://reader034.vdocuments.site/reader034/viewer/2022042322/5f0c51317e708231d434ccaf/html5/thumbnails/100.jpg)
Michael Zollhöfer Model-Based Teeth Reconstruction100
APPENDIX