image-based modeling and rendering cs 6998 lecture 6
Post on 20-Dec-2015
223 views
TRANSCRIPT
![Page 1: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/1.jpg)
Image-Based Modeling and Rendering
CS 6998 Lecture 6
![Page 2: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/2.jpg)
Next few slides courtesy Paul Debevec; SIGGRAPH 99 course notes
![Page 3: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/3.jpg)
![Page 4: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/4.jpg)
![Page 5: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/5.jpg)
![Page 6: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/6.jpg)
IBR: Pros and Cons
• Advantages– Easy to capture images: photorealistic by defn– Simple, universal representation– Often bypass geometry estimation?– Independent of scene complexity?
• Disadvantages– WYSIWYG but also WYSIAYG– Explosion of data as flexibility increased– Often discards intrinsic structure of model?
![Page 7: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/7.jpg)
![Page 8: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/8.jpg)
IBR: A brief history
• Texture maps, bump maps, env. maps [70s]
• Poggio et al. MIT: Faces, image-based analysis/synthesis
• Modern Era– Chen and Williams 93, View Interpolation [Images with depth]
– Chen 95 Quicktime VR [Images from many viewpoints]
– McMillan and Bishop 95 Plenoptic Modeling [Images w disparity]
– Gortler et al, Levoy and Hanrahan 96 Light Fields [4D]
– Shade et al. 98 Layered Depth Images [2.5D]
– Debevec et al. 00 Reflectance Field [4D]
– Inverse rendering methods (Sato,Yu,Marschner,Boivin,…)
• Fundamentally, sampled representations in graphics
![Page 9: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/9.jpg)
![Page 10: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/10.jpg)
![Page 11: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/11.jpg)
Outline
• Overview of IBR
• Basic approaches– Image Warping– Light Fields– Survey of some recent work– Later and next week: Paper presentations
![Page 12: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/12.jpg)
Warping slides courtesy Leonard McMillan, SIGGRAPH 99 course notes
![Page 13: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/13.jpg)
![Page 14: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/14.jpg)
![Page 15: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/15.jpg)
![Page 16: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/16.jpg)
![Page 17: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/17.jpg)
![Page 18: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/18.jpg)
![Page 19: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/19.jpg)
![Page 20: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/20.jpg)
![Page 21: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/21.jpg)
![Page 22: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/22.jpg)
![Page 23: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/23.jpg)
Outline
• Overview of IBR
• Basic approaches– Image Warping
• [2D + depth. Requires correspondence/disparity]
– Light Fields [4D]– Survey of some recent work– Later and next week: Paper presentations
![Page 24: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/24.jpg)
![Page 25: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/25.jpg)
![Page 26: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/26.jpg)
![Page 27: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/27.jpg)
![Page 28: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/28.jpg)
![Page 29: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/29.jpg)
![Page 30: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/30.jpg)
![Page 31: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/31.jpg)
![Page 32: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/32.jpg)
![Page 33: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/33.jpg)
![Page 34: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/34.jpg)
Outline
• Overview of IBR
• Basic approaches– Image Warping
• [2D + depth. Requires correspondence/disparity]
– Light Fields [4D]– Survey of some recent work– Later and next week: Paper presentations
![Page 35: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/35.jpg)
Refresher: LDIs
• Layered depth images [Shade et al. 98]
Geometry
Camera
Slide from Agrawala, Ramamoorthi, Heirich, Moll, SIGGRAPH 2000
![Page 36: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/36.jpg)
Refresher: LDIs
• Layered depth images [Shade et al. 98]
LDI
![Page 37: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/37.jpg)
Refresher: LDIs
• Layered depth images [Shade et al. 98]
LDI
(Depth, Color)
![Page 38: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/38.jpg)
![Page 39: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/39.jpg)
Surface Light Fields• Miller 98, Nishino 99, Wood 00
• Reflected light field (lumisphere) on surface
• Explicit geometry as against light fields. Easier compress
![Page 40: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/40.jpg)
Acquiring Reflectance Field of Human Face [Debevec et al. SIGGRAPH 00]
Illuminate subject from many incident directions
![Page 41: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/41.jpg)
Example Images
Images from Debevec et al. 00
![Page 42: Image-Based Modeling and Rendering CS 6998 Lecture 6](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d4b5503460f94a27fc5/html5/thumbnails/42.jpg)
Conclusion (my views)
• Real issue is compactness/flexibility vs. rendering speed
• IBR is use of sampled representations. Easy to interpolate, fast to render. If samples images, easy to acquire.
• IBR in pure form not really practical– WYSIAYG
– Explosion as increase dimensions (8D transfer function)
– Ultimately, compression, flexibility needs geometry/materials
• Right question is tradeoff compactness/efficiency– Factored representations
– Understand sampling rates and reconstruction