abstraction of man-made shapes ravish mehra 1,2, qingnan zhou 1, jeremy long 4, alla sheffer 1, amy...

31
Abstraction of Man-Made Shapes Ravish Mehra 1,2 , Qingnan Zhou 1 , Jeremy Long 4 , Alla Sheffer 1 , Amy Gooch 4 , Niloy J. Mitra 2,3 1 Univ. of British Columbia 2 IIT Delhi 3 KAUST 4 Univ. of Victoria Abstraction of Man-Made Abstraction of Man-Made Shapes Shapes

Upload: kayla-rolling

Post on 31-Mar-2015

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Ravish Mehra1,2, Qingnan Zhou1, Jeremy Long4, Alla Sheffer1, Amy Gooch4, Niloy J. Mitra2,3

1Univ. of British Columbia 2 IIT Delhi 3 KAUST 4Univ. of Victoria

Abstraction of Man-Made ShapesAbstraction of Man-Made ShapesAbstraction of Man-Made ShapesAbstraction of Man-Made Shapes

Page 2: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Human Perception

Page 3: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Observation

© Succession Picasso

Page 4: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Observation

o Man-Made objects dominated by flat/smooth faces.o Sharp creases define the shape.

Cole et al. 2008

Page 5: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Abstract Representation

o Abstraction algorithm - curves as building blocks o Extract sparse network of curves + normalso Abstract shape - union of smooth patches

Page 6: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

o Curve based NPR• Suggestive contours [DeCarlo et al. 2003]• Apparent ridges [Judd et al. 2007]

o Curve based surface modeling• Wires [Singh et al. 1998]• Fiber Mesh [Nealen et al. 2007]• iWires [Gal et al. 2009]

o Vector representation• Diffusion Curves [Orzan et al. 2008]

Related Works

Page 7: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Abstraction Pipeline

1. Original model 2. Envelope 3. Curve Network 4. Reconstructionresult

ReconstructionVectorization Envelopegeneration

Page 8: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Challenge

o Input contains multiple self-intersecting components.o Can even be a polygon soup.

Page 9: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Envelope Generation

o Envelope: A tight closed manifold approximation of the original surface.

Page 10: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Envelope Generation: Initialization

o Initial envelope: A manifold surface loosely follow input’s geometry.

Page 11: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Envelope Generation: Iterative Fitting

Preserves local detailsPulls each vertex towards its original position

Pulls each vertex towards its mapped position

Page 12: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Envelope Generation

Page 13: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Vectorization

o Purpose: extract a vector representation o Encodes shape-defining features; concise & enables

reconstruction

Envelope Vector Representation

Page 14: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Vectorization as Mesh Segmentation

o Man-made shapes - union of smooth patches.

o Vectorization as mesh segmentation problem.• Segmentation – collection of charts• Each chart should be smooth

o Vector representation = boundary of segmentation + associated normals

Page 15: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Initial Segmentation

o Variational Shape Approximation [Cohen-Steiner et al. 2004]. • Speed and simplicity• Satisfies smoothness criteria

o Topological Simplification• Merging small charts• Straightening boundaries

[ Julius et al. 2005 ]

Page 16: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Iterative Improvement

o Optimization for each chart• Smooth surface

smoothly varying normals

• Approximate the original shape

• Smooth boundary helps subsequent

regularization phase

Page 17: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Iterative Improvement

o Normal solve • trade-off between smoothness and original normals

o Per-triangle solve• vertex positions satisfying desired normals• stay close to original positions

o Global assembly• reconcile different per-triangle vertex positions

Page 18: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Iterative Improvement

Page 19: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Regularization and Simplification

o Regularity• local : linear, circular, planar • global : parallel, orthogonal,

symmetric

o Hierarchical simplification• higher levels of abstraction• simplify network• regularize again

Page 20: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Curve Extraction

Vector representation of 3D Shapes

Page 21: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Reconstruction

o Reconstruct the abstract model• Embed each boundary loop

into a plane[Kruskal and Wish 1978]

• Triangulate the planar loops [Shewchuk 1996]

• Deform the planar patches using curve’s position and normal as constraints[Popa et al. 2006]

Page 22: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Results

Page 23: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Eiffel tower

15.6K triangles 2417 components 85 curves140 curves

Page 24: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Empire state

16K triangles 17 components 38 curves152 curves

Page 25: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Arc de Triomphe

13K triangles 8 components 139 curves193 curves

Page 26: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Dome of the Rock

3.8K triangles 2 components 26 curves145 curves

Page 27: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Limitations and Future Work

o Thin long features that affect topology

o Not well-known objects

Page 28: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Summary

o Algorithm for generating abstractions of 3D man-made models.

o Simple yet robust mechanism for approximating polygon soup by a manifold surface.

o Novel vector-based representation of 3D geometry.

Page 29: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Video

Page 30: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes

Acknowledgements

Sponsored by

Adobe Inc.MITACS NCEMicrosoft Outstanding YoungFaculty FellowshipNSERC Discover Program

Thanks

Benjamin CecchettoDerek BradleyKaran SinghTiberiu PopaVladislav KraevoyXi ChenAnonymous reviewers

Page 31: Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia

Abstraction of Man-Made Shapes