geometric algorithms in 3d real-time rendering and facial expression modeling prof. marina l....
TRANSCRIPT
![Page 1: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/1.jpg)
Geometric Algorithms in 3D Real-Time Rendering and
facial Expression Modeling
Prof. Marina L. Gavrilova
University of Calgary
![Page 2: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/2.jpg)
Quote:"Perseverance is not a long race;
it is many short races one after another."-Walter Elliott
![Page 3: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/3.jpg)
• Brief Overview of the Area
• Geometric Approaches for mesh reconstruction and image morphing
• Real-Time Optimally Adapting Mesh Algorithms
• Non Photo-realistic Facial Expression Modeling and Morphing Algorithms
• Swarm Real-time Visualization System
Presentation Outline
![Page 4: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/4.jpg)
Objective:To showcase the power of the geometric and
topology-based approaches in 3D visualization and modeling
![Page 5: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/5.jpg)
Relevant Areas
• Computer-Aided Design• Geographical Information Systems• Biometrics• 3D Animation• Computer Games• Strategic Planning• Defense• Other areas
![Page 6: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/6.jpg)
State of the Art
• TERRAIN MODELING
• Multi-resolution dynamic mesh• Viewer-dependent refinement• Culling techniques• View frustum algorithms• Triangle-count preservation• Subdivision refinement• Controlled LOD
• Visual continuity and smooth transition are crucial
• Lindstrom, Hoppe, Duchaineauy, Hesse, Silva, Skala, Kolingerova
• EXPRESSION MODELING
• Multi-resolution adaptable mesh• Light source and view point
dependent rendering• Control points and areas• Tracking algorithms for transforming • Fitting algorithms for modeling• Wavelets to extract specific
characteristics• Visual continuity and feature
preservation are crucial
• Jain, Salesin, Gooch, Gordon, Thalmann, Plemenos, Sourin
![Page 7: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/7.jpg)
Our Approach TERRAIN MODELING
Challenge: massive amount of data, smooth rendering
Methodology:• Multi-resolution dynamic triangle
mesh with new refinement strategy• New split and merge queue operations• Frame-to-frame coherence algorithm
for local updates• New geo-morph smoothing algorithm Outcome:• Visual continuity, rendering
efficiency, frame-rate constancy for massive terrain
EXPRESSION MODELING
Challenge: massive amount of detail, tracking changes
Methodology:• NPR approach to feature extraction and
modeling• New Distance-Transform algorithm for
morphing• Delaunay triangulation for mesh
representation• Image segmentation and feature-line
extraction algorithm
Outcome: Expressive detail preservation, efficient
storage, fast processing, 3D controllable deformations
![Page 8: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/8.jpg)
Our Focus
• Topology preservation and geometry plays an important role in many algorithms, allowing for rendering efficiency, visual continuity and feature preservation.
![Page 9: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/9.jpg)
Part I:3D Real-Time Massive Terrain Visualization
![Page 10: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/10.jpg)
Sourcing data from real world
![Page 11: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/11.jpg)
Understanding Height FieldsDEM: Digital Elevation Model
• Contains only relative Height
• Regular interval
• Pixel color determine height
•Discrete resolution
![Page 12: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/12.jpg)
Converting Height field data into 3D topological mesh
200 255 150 100
100 255 255 200
200 150 200 100
• Pixel value (z) is used as Height Map
• Vertices are generated as points in 3D
• A Mesh is triangulated
![Page 13: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/13.jpg)
Terminology
DEM: Digital Elevation ModelVDR: Viewer Dependent RefinementROAM: Realtime Optimally Adapting MeshCLOD: Continuous Level of Detail
![Page 14: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/14.jpg)
What is mesh?
• It is often required to convert geometric objects in any other form to polygonal meshes of geometric simplexes (i.e. triangles) before rendering
• Meshes are used for computer modeling, biometric, GIS, cartographic, and animation applications
• Mesh optimization techniques are used to reduce the mesh to an acceptable size (user defined), minimizing the loss of quality (subject to some form of error analysis).
![Page 15: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/15.jpg)
Mesh definition
• A mesh is defined as a pair (V,K) where V is the set of vertices and K is a simplicial complex specifying the connectivity of the mesh simplices (the adjacency of the vertices, edges and faces).
• The 0-simplices are called vertices, the 1-simpices are called edges, and the 2-simplices are called faces.
• Triangulation is an example of mesh.
![Page 16: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/16.jpg)
Example: 3D Terrain Rendering
• Uses DEM as input of the application
•Generates dynamic mesh to achieve frame coherent animated view in real-time
![Page 17: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/17.jpg)
Contribution• In our work we used the ROAM definition introduced in
[Duchaineauy], and developed a number of algorithms that rely heavily on topological properties of the modeled terrain in order to handle massive data sets.
• The observation of hardware performance reacting to strip length allowed us to design a fast and effective greedy approach to dynamically maintain triangle stripping. The method resulted in achieving rendering efficiency and frame rate constancy.
• We further improved the rendering efficiency while preserving important terrain features utilizing topological information.
• We eliminated the priority queue for merge operation, amortized update cost by allowing split queue to degenerate, took advantage of frame-to-frame coherence for local update and devised an efficient method for mesh-smoothing using geo-morph while preserving important terrain features.
![Page 18: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/18.jpg)
Methodology applications
• Massive terrain rendering
• Realistic deformation modeling using mass spring system
• Adaptive spatial memory subdivision in robot motion planning simulation
![Page 19: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/19.jpg)
Basic Approach
• The entire optimization process can be viewed as an optimal spatial subdivision problem. There exist only two legal moves to achieve optimality: subdivide and merge.
• Models that are based on this concept do not require computationally extensive optimization process. Instead, the mesh progressively adapts to an optimal solution.
• These models usually define a multi-criteria based error metric to assess the energy of the mesh.
![Page 20: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/20.jpg)
Conventional Approach
• Regular Grid and TIN: Triangulated Irregular Network• Problems:
– Significant preprocessing– Generates too many triangles– the visible area might constitute a tiny fraction of that detail– Viewpoint dependent refinement is not possible with static
meshes. – Have a bad triangle to screen pixel ration.– Unable to obtain a steady performance.
• Unable to Render Massive Terrain
![Page 21: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/21.jpg)
Problems with static mesh
d
h h
21 unit
a2
a2h
h1
1d
d
2p
2a p
2 tan2
h da
1screen pixel ratio 1:r h h
![Page 22: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/22.jpg)
Problems with static mesh …
Detail
98.5%
1.5%
Screen
10%
90%
![Page 23: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/23.jpg)
A Static Mesh (40,000 tri)
![Page 24: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/24.jpg)
Dynamic mesh
• Dynamic mesh generation is based on real-time adaptive models that allow local transformation of a given mesh to different levels of details and adapt progressively to the changes in the rendering environment.
• Dynamic models use some form of hierarchical data structure to store a mesh in multiple LOD.
• There are many different versions of dynamic mesh currently under research and development. Several patented technologies have been released in the industry (i.e. Intels MRM). The two most prominent approaches are Progressive Meshes (PM) and Real-time Optimally Adapting Mesh (ROAM).
![Page 25: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/25.jpg)
![Page 26: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/26.jpg)
ROAM :•Can Subdivide when more details necessary
•Merge & Split Queue
•Tree Structured
![Page 27: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/27.jpg)
ROAM (25,000 Triangles)
![Page 28: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/28.jpg)
The ROAM Advantage
![Page 29: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/29.jpg)
ROAM advantages
• An efficient top-down dynamic mesh model. • Display of complex surfaces can be provided by
dynamically computing a multi-resolution triangular mesh for each view.
• One can minimize geometric distortions on the screen while maintaining a fixed triangle count.
• Visual discontinuities could be minimized, and efficient mesh corrections can ensure selected lines of site, or object proximity are correctly represented.
• An incremental priority-queue based approach in ROAM allows exploiting frame-to-frame coherence for fast efficient computation of the adapting mesh.
![Page 30: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/30.jpg)
Geometric subdivision
Problems with Geometric Subdivisions
![Page 31: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/31.jpg)
ROAM principle
The basic operating principle of ROAM
![Page 32: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/32.jpg)
Quadtree and Bintree for ROAM
Comparison between Quadtree (top) and Bintree (bottom)
![Page 33: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/33.jpg)
ROAM Model
DEM
Inte
rpola
tion
En
gin
e Triangle Bin Tree Data structure
Render
Ref
ine
Err
orM
etri
c
Speed: 15.0 FPS
Size: 15000 Tri
![Page 34: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/34.jpg)
Our ROAM Model
Speed: 45.0 FPS
Size: 19000 Tri
DEM
Inte
rpola
tion
En
gin
e Triangle Quad Tree Data structure
Err
orM
etri
c
Ref
ine
Render
G Q
Wavelet
ErrorAnalysis C
lean
up
Op
era
tion
![Page 35: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/35.jpg)
ROAM Implementation and Improvements
• Pre-process DEM• Reduce overhead for maintaining Split queue• Use degenerated split queue• Replace priority merge queue (HEAP) with a
simple FIFO queue.• Merge arbitrary obscured regions (outside visible
frustum) only • Improve smoothness, reduce popping effect
![Page 36: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/36.jpg)
Proposed Unique Geometry-based methodology
• DEM Analysis
• Adaptive Loop Subdivision
• Geo-Morphing
• Visible frustum computation
• CCM - Cascading Coupling March method for massive terrain
![Page 37: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/37.jpg)
Preprocessing of DEM input
• Convolute the surface (2nd Difference)
• Efficient LOD distribution
• Used in Advanced Shading (feature preservation)
![Page 38: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/38.jpg)
Differentiating the Surface: Convolution
Original DEM of Kluane Park First differentiation. Blue area Shows steep mountains.
Final LOD distribution image Shows rocky areas require more details
Second Differentiation. Blue areas indicate steep mountain peaks.
![Page 39: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/39.jpg)
Differentiating the Surface (cont’d)…
• Take Weighted Average of neighboring pixel Gradients
• 2 passes gives us the rate of gradient changes
![Page 40: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/40.jpg)
Statistical Analysis of ROAM
• Bottleneck: Split and Merge Operation and visibility test• Only 2.7% triangles are merged within the visible frustum• 75% of split operations occurs on closest 5% region of the
visible frustum• Taking above into account, special priority function for
split queue was developed based on U=Uniformity • F=Frustum priority• D=Curvature priority• P=Distance priority• DET=Curvature (preprocessed)• Lev(f)=Subdivision level of face f
![Page 41: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/41.jpg)
Methodology: Speeding up the process - Amortizing refinement
• Updating the Split queue over multiple frames
• Allow split queue (heap) to degenerate• Refine integrity using error threshold test• Re-generate queue after constant number of
frames• Dramatic gain in speed
![Page 42: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/42.jpg)
Methodology: Maintaining Degenerated S-Queue
![Page 43: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/43.jpg)
Methodology: Geo-Morph
• Smooth interpolation of vertex over subdivision
• Requires maintenance of one additional queue (G-queue)
![Page 44: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/44.jpg)
Methodology: Smoothing
• Compute face normal • Compute vertex normal• Local computation of normal
during refinement (Geo-Morph)
• Apply vertex normal when rendering
• Advanced shading: Linear combination of face and vertex normal (Hybrid)
![Page 45: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/45.jpg)
Example of smoothing
![Page 46: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/46.jpg)
Result with Texturing
![Page 47: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/47.jpg)
Massive Terrain Model: ALS
Adaptive Loop Subdivision and Cascading Coupling March
![Page 48: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/48.jpg)
Quote:“Map of a region was a size of a city, map of an
Empire was a size of a Province."Jorge Luis Borges
![Page 49: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/49.jpg)
Loop Scheme
![Page 50: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/50.jpg)
Patching alignment
A
B CA
BCFaces:
•Regular
•Tface
Regular Tface
![Page 51: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/51.jpg)
Adaptive Loop Subdivision
![Page 52: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/52.jpg)
Recursive Split
A
A
A
A
BB
B
B
C C
C
C
AB CA
BC
Split
•Prefer: Tface
•Retract Tface
![Page 53: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/53.jpg)
Patch Stitching: CCM
“CASCADING COUPLING MARCH”
![Page 54: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/54.jpg)
Method Description
• We develop CCM to stitch two quadrants of the adaptive mesh patch, and to ensure seamless connectivity by progressively refining and connecting the subdivision tree (quadtree) data structure.
• We ensure integrity of the data structure among multiple patches so that subdivision and simplification are not limited to the boundaries of the patches.
• CCM allows to consider the entire data structure as a number of strongly connected sets of quad-trees. As a result we can refine the mesh as one seamless continuous structure (not patches stitched together).
![Page 55: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/55.jpg)
CCM idea
• We perform a coupled recursive march of the two quad-trees from the top to the bottom of the tree, subdividing or connecting border triangles.
• To increase geometric regularity we used non-orthogonal axis and used space warps to convert the scheme back to orthogonal axis for rendering. This is crucial when we are performing viewer dependent refinements. Patch locating and coordinate transform algorithms are designed to maintain a list of visible patches. Additional patches are added and connected using CCM as the simulation advances. Obscured patches are deleted using recursive march.
• This new method allows a greater flexibility, efficiency and control over smoothness
![Page 56: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/56.jpg)
Two Adjacent Patches
![Page 57: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/57.jpg)
Snapshot 3 … Level 2
![Page 58: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/58.jpg)
Results on Mesh Rendering
- Strategies evolved, Runtime and other aspects
![Page 59: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/59.jpg)
Results (Output obtained)
(a) 0, 1, 4curv dist ur r r= = = (b) 0, 1, 6curv dist ur r r= = = (c) 0, 1, 8curv dist ur r r= = =
(d) 1, 0, 4curv dist ur r r= = = (e) 1, 0, 6curv dist ur r r= = = (f) 1, 0, 8curv dist ur r r= = =
![Page 60: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/60.jpg)
Results (Runtime) (Cont’d)Frame Per Second - Modified ROAM Scheme
0
20
40
60
80
0 10 20 30 40 50 60Time (sec)
Fra
me/
Sec
ond
Kluane 25000 Alaska 35000Fractal 55000 Kluane AveAlaska Ave Fractal AveKluane Alaska Fractal
55.15 39.12 27.87
Average Frame/ Second
![Page 61: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/61.jpg)
Results (Runtime) (Cont’d)
Rendering Statistics for Modified ROAM Scheme
0
5000
10000
15000
20000
25000
0 50 100 150 200
Time of Simulation (Seconds)
Num
ber
o T
rian
gles
Total T riangles Visible T riangles
![Page 62: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/62.jpg)
Results (Runtime) (Cont’d)Average Load of The Geomorph Queue
in ALS Based Models
0
500
1000
1500
2000
2500
3000
3500
Number of Triangles
Aver
age
num
ber
of
ver
tice
s
in t
he
Geo
morp
h q
ueu
e
20 frames 286 427 567 717 805
60 frames 791 1097 1446 1781 2012
100 frames 1019 1746 2382 2842 3276
20000 25000 30000 35000 40000
![Page 63: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/63.jpg)
Summary of Results
• High Speed (45 FPS average) for 20000 faces!!• Static mesh upper limit: 55 FPS• Continuity is achieved (Geo-Morph) – 300
vertices on average for 45 FPS –very small overhead
• Visual appeal (smoothing & Texture)• Less variant Frame rate• Efficient Understructure (amortized update)
![Page 64: Geometric Algorithms in 3D Real-Time Rendering and facial Expression Modeling Prof. Marina L. Gavrilova University of Calgary](https://reader035.vdocuments.site/reader035/viewer/2022081514/56649d215503460f949f615b/html5/thumbnails/64.jpg)
More Results on Mesh Rendering
See Animation Demos