tooth segmentation on dental meshes using morphologic skeleton kan wu school of software tsinghua...

34
Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics 2013, Hong Kong Jing LI Department of Orthodontics Peking University School and Hospital of Stomatology, P. R. of China Ph.D. Yanheng ZHOU Ph.D. Computers & Graphics

Upload: jameson-clemence

Post on 31-Mar-2015

223 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Tooth Segmentation on Dental Meshes

Using Morphologic Skeleton

Kan WUSchool of Software

Tsinghua University, P. R. of China

M.Eng. Li CHEN Ph.D.

CAD/Graphics 2013, Hong Kong

Jing LIDepartment of Orthodontics

Peking University School and Hospital of Stomatology, P. R. of China

Ph.D. Yanheng ZHOU Ph.D.

Computers & Graphics

Page 2: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Background

our work

Page 3: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Contribution

significantly reduced user interaction

avoid complex mesh feature estimation

an applicable pipeline for dental mesh segmentation

experiments on various clinical cases of different tooth

shapes and various levels of crowding problems

Page 4: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Problems of Current Work

intensive interaction

affected by feature disturbance

not sufficiently accurate Kumar et al.

2011

Kronfeld et al.

2010

“3Shape”

Page 5: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

A Good Dental Segmentation Approach Should

locate teeth area automatically

separate adjacent teeth automatically

less dependent on complex feature estimation

smoothed & fitted boundary

morphologic

skeleton

Page 6: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Why Morphologic Skeleton

insensitive to feature missing & disturbance

simplified approximation of mesh features

easy separation of adjacent objects

ACCURACY

EFFICIENCY

REDUCED INTERACTION

Page 7: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Dental Mesh Segmentation Pipeline

Page 8: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

1st Step: Locating Teeth Parts

automaticplane cutting

region-growing

skeletonization

original mesh

Page 9: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

PCA-basedplane

initialization

energy field

1st Step: Locating Teeth Parts – (1)Estimating Cutting Plane

Page 10: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

(1)Estimating Cutting Plane – PCA-based Plane Initialization

Kronfeld et al., 2010

set of feature vertices

barycentric point

eigenvector corresponding to

the smallest eigenvalue

Page 11: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

weighted distance

feature pointsconnected to

v

(1)Estimating Cutting Plane – Energy Field

Page 12: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

skeleton

1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization

curvature threshholdin

g

connectivity filtering

morphologicoperation

skeletonization

Page 13: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

original morphologic skeleton(Rossl et al., 2000)

improved morphologic skeleton

1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization

Page 14: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

seed points

skeleton

1st Step: Locating Teeth Parts – (3)Region-Growing

Page 15: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

cut

2nd Step: Separating Teeth

Page 16: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

valid cutdiscarded cut

2nd Step: Separating Teeth – Various Scenarios

Page 17: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

2nd Step: Separating Teeth – Results

Page 18: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

3D contours

2D contours

sampled 2D contours sampled 3D contours

interpolated 3D contours

3rd Step: Smoothing Tooth Contours

Page 19: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Direction Change Measure Length Change Measure

center point for contour

middle point

3rd Step: Smoothing Tooth Contours – 2D Sampling

Page 20: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Direction Change Measures

Length Measures

sign(x) = 1 if x > 0, otherwise -1

3rd Step: Smoothing Tooth Contours – 2D Sampling

Page 21: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results – Mild Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 22: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results – Moderate Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 23: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results – Severe Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 24: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results

Page 25: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results

Page 26: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Results

Page 27: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Kumar et al. 2011

Kronfeld et al. 2010

our approach

our approach

Comparative Results – Published Approaches

Page 28: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

when user interaction is not sufficiently accurate enough

“3Shape” Software

“3Shape” Software

our approach

our approach

Comparative Results – “3Shape” Software

Page 29: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Accuracy Evaluation – Mean Errors

The mean errors that compare our results to manually labeled ground truth. The unit is mm.

Page 30: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

the distribution of particular error values across all segmented boundary vertices. The blue, yellow, red lines indicate the ranges of [0, 0.25], [0.25, 0.5], [0.5, 1.5], respectively.

Accuracy Evaluation – Error Distribution

Page 31: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

User Interaction Evaluation

Time consumed by user interactions. The blue and yellow lines indicate manual boundary completion and additional seed adding, respectively. The unit is s

Page 32: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Limitations

a dental mesh benchmark

GPU accelerating

completely eliminate user interaction

Future Work

user interaction still needed

no GPU accelerating

Page 33: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Demo

Page 34: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics

Kan WU ([email protected])

THANK YOU

Li CHEN ([email protected])

Jing LI ([email protected]) Yanheng ZHOU ([email protected])