segmentation reporter: xiaoqun wu date: 2008/10/30

41
Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Upload: griselda-lloyd

Post on 18-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Segmentation

Reporter: Xiaoqun WuDate: 2008/10/30

Page 2: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Papers

Patch-type Segmentation of Voxel Shapes using Simplified Surface Skeletons

Part-type Segmentation of Articulated Voxel Shapes using the Junctions Rules

Page 3: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Authors Dennie Reniers

Ph.D Student of Dept. of Mathematics and Computing Science at Tu/e

His research interests include shape analysis, representation and segmentation, and discrete geometry

Alexandru Telea Assistant Prof. of Dept. of Mathematics and Computing Science at Tu/e

Page 4: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

The Problem

Page 5: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Two Types

Patch-type Segmentation: Geometry-Oriented

Part-type Segmentation Semantically-Oriented

Page 6: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Two Types

Patch-type Part-type

Page 7: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Conceptions Surface skeleton

Curve skeleton

Page 8: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Patch-type Segmentation of Voxel Shapes using Simplified Surface Skeletons

Page 9: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Patch-type Segmentation Main idea:

The boundaries of the surface skeleton map one-to-one to the edges of the 3D shape

Page 10: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Edge DetectionCompute Surface Skeleton

Simplify Skeleton

Edge ErosionHandling Corners

Page 11: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Surface Skeleton

Distance Transform

Feature Transform

Surface Skeleton

: the minimum distance to the boundaryD R

: ( )

( ) { | ( )}

F P

F p q p q D p

( ) { | ( ) 2}S p F p

Page 12: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Surface Skeleton

Foreground Skeleton

Background Skeleton

Page 13: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Surface Skeleton

Background Skeleton

Page 14: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Simplify Skeleton

Importance Measure The length of shortest path on the surface boundary b

etween two feature points F(p)

Simplified Skeleton

, , {0,1}( ) ( , , ) is extended feature transformx y z x y zF p F p x p y p z

, ( )( ) max ( , ) g is the shortest path between a,b

a b F pp g a b

S ( ) { | ( ) }p p

Page 15: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Simplify Skeleton

Page 16: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Simplify SkeletonS ( ) { | ( ) }p p

Page 17: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Edge Detection

Feature collection

Convex Edges

Concave Edges

Edges

( )( ) ( )

p SV S F p

1{ | min ( , ) }

2 nv V

E q g q v

1{ | min ( , ) }

2 nv V

E q g q v

E E E

Page 18: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Edge erosion

Page 19: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Handling Corners

Page 20: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Complexity

Page 21: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 22: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 23: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Comparison

Page 24: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Part-type Segmentation of Articulated Voxel-Shapes using the Junction Rule

Page 25: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Main idea

Page 26: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Main steps

Compute Curve

SkeletonSimplify Skeleton Detect Junction

Place Part Cuts

Page 27: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Surface Skeleton

Distance Transform

Feature Transform

Surface Skeleton

: the minimum distance to the boundaryD R

: ( )

( ) { | ( )}

F P

F p q p q D p

( ) { | ( ) 2}S p F p

Page 28: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Curve Skeleton

The set of shortest paths

Curve Skeleton

, ( )( ) ( , )

a b F pp a b

( ) contains a Jordan Curve

Jordan Curve is a simple closed curve on the boundary

p C p

Page 29: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Curve Skeleton

Page 30: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Simplify Curve Skeleton

C +

i 1

C

C

: ( ) the component set

: C R the importance measure

1 C

( )

if ( ) , discard

i

k

C C P

i k C

p C

p p

Page 31: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Detect Junction

Page 32: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Place part cut

Page 33: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Place part cut

Geodesicness measure

The larger, the better

Page 34: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Place cut part

Page 35: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 36: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 37: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 38: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Results

Page 39: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Comparison

Page 40: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Conclusion

Two Methods Patch-type Segmentation

Surface Skeleton

Part-type Segmentation Curve Skeleton

Page 41: Segmentation Reporter: Xiaoqun Wu Date: 2008/10/30

Thank you!