2008 brokerage 03 scalable 3 d models [compatibility mode]
TRANSCRIPT
![Page 1: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/1.jpg)
Scaleable 3D modelsScaleable 3D modelsLuc Van Gool
![Page 2: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/2.jpg)
Large-scale 3D modeling
� Clear trend towards ever more massive 3D models, and
dynamic capture (4D)
� SecondLife, Google Earth, games like the Runaway, 3D
navigation systems, Digital 3D Cartography (AGIV),
digitalisation of museum content (EDL), …digitalisation of museum content (EDL), …
� Developers of acquisition, editing, transmission, rendering,
and presentation technologies are struggling to match
� Problem is huge, as massive, high-quality modelling also
requires bridging the infamous semantic gap
![Page 3: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/3.jpg)
Large-scale 3D modeling
� ACQUISITIONACQUISITION
![Page 4: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/4.jpg)
3D acquisition taxonomy
uni-directional multi-directional
passive
uni-directional multi-directional
active
3D acquisition methods
LIDARStereo
Str. from motion
Shape-from
- texture
- contour
- silhouettes
- defocus
- shading
Line scanning
Structured light
Photom. stereo
![Page 5: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/5.jpg)
3D acquisition taxonomy
uni-directional multi-directional
passive
uni-directional multi-directional
active
3D acquisition methods
LIDARStereo
Str. from motion
Shape-from
- texture
- contour
- silhouettes
- defocus
- shading
Line scanning
Structured light
Photom. stereo
![Page 6: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/6.jpg)
Underlying principles
Structure from motion
Structured light
TRIANGULATION
Structured light
LIDAR TIME-OF-FLIGHT
![Page 7: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/7.jpg)
Stereo
The underlying principle is “triangulation” :
�
![Page 8: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/8.jpg)
Triangulation � 3D measurements
Active triangulation
8
Projector
Camera
![Page 9: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/9.jpg)
Active triangulation
Camera image
![Page 10: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/10.jpg)
Active triangulation
Need for registration...
Has to be automatic for
large-scale work
![Page 11: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/11.jpg)
Time-of-flight
Cyrax
Distance = C x T ÷2
![Page 12: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/12.jpg)
Time-of-flight
Cyrax
Laser sweeps over surface
No correspondences needed
![Page 13: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/13.jpg)
Large-scale 3D capture
� Speed becomes essential
� … fast calculations (e.g. helped by GPU)
� … but also easy setup and data capture
� Increasingly systems that are based on comsumer HW� Increasingly systems that are based on comsumer HW
� … and intelligent modeling tools
� … and automatic data capture
![Page 14: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/14.jpg)
Tracking and
Calibration
Densedepth
estimation
3Dsurface
modeling
3D acquisition / structure-from-motion
Points and cameras 3D modelsDepth map
![Page 15: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/15.jpg)
Shape
3D acquisition / structure-from-motion
Shapefrom Video(KUL)
![Page 16: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/16.jpg)
3D acquisition / structure-from-motion
ShapeShapefrom Stills(KUL)
![Page 17: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/17.jpg)
ARC – Free 3D webservice
ARCARCARCARCAutomatic
Reconstruction Reconstruction
Conduit
non-commercial
use is free
www.arc3d.be
![Page 18: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/18.jpg)
Automatic photo mining
18
(kooaba)
![Page 19: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/19.jpg)
Use in movies / e.g. King Arthur (2003)
Dublin: The Hollywood Valley (Eyetronics)
19
![Page 20: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/20.jpg)
Area B
Use in movies / e.g. King Arthur (2003)
20
![Page 21: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/21.jpg)
Combined areas
Use in movies / e.g. King Arthur (2003)
21
![Page 22: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/22.jpg)
Use in movies / e.g. King Arthur (2003)
![Page 23: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/23.jpg)
Use in movies / e.g. King Arthur (2003)
![Page 24: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/24.jpg)
One-shot
ShapeCam
3D acquisition / structured light
![Page 25: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/25.jpg)
3D acquisition / structured light
Jackie Chan
Latest Latest RushHour Movie
(Eyetronics)
![Page 26: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/26.jpg)
3D acquisition / structured light
MLB
1200 players1200 playersfor gaming
(Eyetronics)
![Page 27: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/27.jpg)
3D acquisition / structured light
MLB
1200 players1200 playersfor gaming
(Eyetronics)
![Page 28: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/28.jpg)
3D acquisition / structured light
MLB
1200 players1200 playersfor gaming
(Eyetronics)
![Page 29: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/29.jpg)
4D acquisition / structured light
3D snapshots in fast succession (KUL)
![Page 30: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/30.jpg)
4D acquisition / structured light
30
(KUL &
ETH Zurich)
![Page 31: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/31.jpg)
4D acquisition / structured light
Real-time 3Dextraction, incl.texture
(KUL &
ETH Zurich)
![Page 32: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/32.jpg)
3D acquisition / structured light
![Page 33: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/33.jpg)
LIDAR
Chevron hydrocarbon plant
![Page 34: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/34.jpg)
LIDAR
Cyrax / Leica
![Page 35: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/35.jpg)
LIDAR
![Page 36: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/36.jpg)
Large-scale 3D modeling
� EDITING / REPRESENTATIONEDITING / REPRESENTATION
![Page 37: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/37.jpg)
LIDAR
(Cyrax / Leica)
![Page 38: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/38.jpg)
LIDAR
![Page 39: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/39.jpg)
39
![Page 40: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/40.jpg)
LIDAR
� 400’x500’ area
� 10 vessels; 5 pumps
� 6,000 objects
� 81 scans from 30 tripod locations
� Cyrax field time = 50 hrs
![Page 41: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/41.jpg)
Measuring for cartographic surveying
Large-scale 3Dmeasurements
Efficiency of the interface !
![Page 42: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/42.jpg)
Procedural modeling
Modeling using rules from a style-specific shape grammar
(ETH Zurich & Procedural)
![Page 43: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/43.jpg)
Large-scale 3D modeling
� STREAMING / RENDERINGSTREAMING / RENDERING
![Page 44: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/44.jpg)
QoS
• Bandwith of channel and type of platform!
• Local, over network, wireless, ...?
• PC cluster, PC, PDA, mobile phone, ...?
• Level-of-Detail mechanisms• Level-of-Detail mechanisms
• Compact representations
• Exploit differential sensitivity HVS
• 3D meshes or... point splashing, IBR, ...?
![Page 45: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/45.jpg)
A4MC3
WIFI
connected
community community
with PDAs
(EDM, IMEC, VUB)
![Page 46: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/46.jpg)
MobiComp
(Un. Kent &&
Bologna )
![Page 47: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/47.jpg)
MeshGrid
A scalable coding scheme for 3D models that:• enables progressive transmission• offers quality, resolution scalability and region-of-interest coding• guarantees a minimum distortion at any bit-rate• provides resilience against transmission errors
![Page 48: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/48.jpg)
MeshGrid
A MeshGrid model consists of a connectivity-wireframe (CW) and a reference-grid (RG) that acts as the reference-system (RS) of the model.
![Page 49: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/49.jpg)
MeshGrid
G1
V
G2
G1
G2
V
1
1 2
, with [0,1)G V
offset offsetG G
= ∈
uuuur
uuuuur
Vertex offset is a relative value:
1 1 2G V G G offset=
uuuur uuuuur�
Update vertex position whengrid is deformed or animated:
![Page 50: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/50.jpg)
MeshGrid
� Volumetric Morphing
� Volumetric Animation
� Scalability, Regions Of Interest Coding
(a) (b) (c)
� Volumetric Animation
![Page 51: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/51.jpg)
Image-based Rendering
(KUL)
(Un. Bonn)
51(EDM)
![Page 52: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/52.jpg)
Large-scale 3D modeling
� PRESENTATIONPRESENTATION
![Page 53: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/53.jpg)
Shuttered Walls & Synchronized Cameras
Blue-C project
walls transparent –acquisition, no projection
walls opaque –no acquisition, projection
(ETH Zurich)
![Page 54: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/54.jpg)
Blue-C project
![Page 55: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/55.jpg)
CyberWalk project
![Page 56: 2008 brokerage 03 scalable 3 d models [compatibility mode]](https://reader033.vdocuments.site/reader033/viewer/2022052906/558862e7d8b42a590e8b45a2/html5/thumbnails/56.jpg)
Towards holistic vision – 3D & recognition
56