sketching, scaffolding, and inking€¦ · sketching, scaffolding, and inking: a visual history for...

42
Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian Wyvill

Upload: others

Post on 18-Oct-2020

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Sketching, Scaffolding, and Inking:

A Visual History for Interactive 3D Modeling

Ryan SchmidtKaran Singh

Tobias IsenbergPauline Jepp

Brian Wyvill

Page 2: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

10,000-Foot View

How can we better support the design process in 3D modeling software?

Sketch-Based Modeling

Improve3D modelunderstanding

Page 3: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Production sketch

Visual Representations

Design sketch

Page 4: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 5: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Production sketch Design sketch

Page 6: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 7: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Goals

Figure out how to simulate design sketching

Integrate w/ production sketch rendering

Implement in an interactive 3Dsurface modeler

Page 8: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Design Sketches

© Enes Canay http://www.carbodydesign.com/archive/2006/08/10-audi-sportscoupe-concept/

Page 9: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 10: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

© Stan Lee and John Buscema

Page 11: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Comic Art Pipeline

Sketching / Penciling Inking Coloring

Images © Jerry Holkins, taken from http://pennyarcade.blogspot.com

Page 12: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Sketching / Penciling

Iterative refinement

High-throughput

Consistency

© Stan Lee and John Buscema

Page 13: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Visual Scaffolding

Temporary artist-created design aids

“Construction lines/shapes”, “trace lines”, “guide lines”, etc…

Image © Jerry Holkins © Wizard Entertianment, Inc

Page 14: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Geometric Massing

Architectural Massing Models

Helps with form,perspective

Well-suited for SBM (model-by-part)

© Disney Entertainment, Inc© Wizard Entertianment, Inc

Page 15: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Geometric Massing

Coarse geometricshapes

Partial “shape axes”

Varying occlusion

Lots of overdraw

© Wizard Entertianment, Inc

© Disney Entertainment, Inc

Page 16: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Algorithm

Fit bounding box

Contours from plane intersections

Random perturbation

Fade in/out based on viewing angle

Page 17: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 18: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 19: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 20: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 21: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Erasing vs Deleting

Deleted parts “disappear”

Can’t learn from them

No “mistakes” in design sketching !!!

Exploring alternatives

Not an artifact of paper

Image © Jerry Holkins

Page 22: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 23: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Eraser Marks

Page 24: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 25: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 26: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

“Real-World” Application

Have design sketch “look”

Geometric Massing

Eraser Marks

Composite w/ productionsketch techniques

Pen & Ink

Now to integrate rendererinto an interactive modeling system…

Page 27: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Integration

Page 28: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Practical Limitations

Free-form modeling

NURBS, SubD, Implicit

Interactivity is critical

Meshes are low-res

Ugly contours

Mesh is dynamic

Can’t precompute!

Page 29: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 30: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 31: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 32: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Silhouettes

Sub-Poly Contours

on Base Mesh

Project Refine

Page 33: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 34: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian
Page 35: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Caveats

Need functional surface normals

Base mesh needs to capture topology of surface

Page 36: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Hidden Line Removal & Stippling

Surfel approach (“tiny canvasses”)

Cover base mesh w/ surfels

Project to surface

Hierarchical culling, lazy generation

base mesh as spatial data structure

Page 37: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Surfel Distribution

“As-uniform-as-possible”

Take surface curvatureinto account

Page 38: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Wins

Visual Scaffolding Geometric Massing,

Eraser Marks

Real-Time Pen & Ink on dynamic surfaces Implicit, NURBS, SubDs

Fully object-space

Supports incremental refinement

Frame-coherent as long as base mesh triangles do not change

Smoother-looking surfaceat equivalent interactiveframerate!

Page 39: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

The Future

Other visual scaffolding types

Interactive Scaffolding

“Conjecturing” scaffolding?

www.shapeshop3d.com(Under “Downloads” -> “Extras”)

Enes Canay http://www.carbodydesign.com/archive/2006/08/10-audi-sportscoupe-concept/

Page 40: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Surfel Rasterization

Page 41: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Surfel Distribution

“As-uniform-as-possible”

Take surface curvatureinto account

View-dependent density

Page 42: Sketching, Scaffolding, and Inking€¦ · Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling Ryan Schmidt Karan Singh Tobias Isenberg Pauline Jepp Brian

Sketching Videos

Eyes: http://www.youtube.com/watch?v=GAi7cHiaf-U Superman: http://www.youtube.com/watch?v=EZZtXKUHUyU Jim Lee: http://www.youtube.com/watch?v=Ys5UmSx9rfA Great quick sketches http://www.youtube.com/watch?v=kygMLl60Bt4 Wolverine! http://www.youtube.com/watch?v=v_kB6GzzCkU Stewie http://www.youtube.com/watch?v=-AH4Zrw7MwM Drawing a head http://www.youtube.com/watch?v=erKzKlSJxxk Hand http://www.youtube.com/watch?v=p2-aheNqhRM Geometric Massing http://www.youtube.com/watch?v=rRj5CaMjTNs Spongebob Squarepants http://www.youtube.com/watch?v=m6MfGYwsy80 Adam Hughes

http://www.youtube.com/watch?v=UvaG1EZ9shM

http://www.youtube.com/watch?v=mAO3sUyg-Bw (talks about construction lines!)