visualization of scene structure uncertainty in a multi-view reconstruction pipeline
DESCRIPTION
Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline. Shawn Recker 1 , Mauricio Hess-Flores 1 , Mark A. Duchaineau 2 , and Kenneth I. Joy 1. 1 University of California, Davis, USA, { strecker , mhessf , joy}@ucdavis.edu - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/1.jpg)
1
Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline
Shawn Recker1, Mauricio Hess-Flores1, Mark A. Duchaineau2, and
Kenneth I. Joy1
1University of California, Davis, USA, {strecker, mhessf, joy}@ucdavis.edu2 Lawrence Livermore National Labs. [email protected]
Vision, Modeling, and Visualization (VMV) Workshop 2012Magdeburg, Germany12 -14 November 2012
![Page 2: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/2.jpg)
2
Multi-View Reconstruction
Bundle Adjustment
‘dinosaur’ dataset images from [1].
![Page 3: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/3.jpg)
3
Structural Uncertainty Visualization
![Page 4: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/4.jpg)
Volume Visualization Techniques
0 1 2
321
2 3 41 2 3
432
3 4 52 3 4
543
4 5 6
Volume Rendering
Contouring
4
![Page 5: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/5.jpg)
Procedure
…
5
![Page 6: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/6.jpg)
6
Evaluated Test Cases
• Frame decimation simulation• Feature matching inaccuracy• Self calibration tests
![Page 7: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/7.jpg)
7
Frame Decimation Graphs
![Page 8: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/8.jpg)
8
Frame Decimation Results
30 cameras 15 cameras 10 cameras
8 cameras 4 cameras 2 cameras
![Page 9: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/9.jpg)
9
Feature Tracking Graphs
![Page 10: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/10.jpg)
10
Feature Tracking Inaccuracy Results
0% Error 1% Error 2% Error
5% Error 10% Error 20% Error
![Page 11: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/11.jpg)
11
Self-Calibration Graphs
![Page 12: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/12.jpg)
12
Self-Calibration Results
0% 1% 2% 5% 10% 20%
Principal Point Variation
Focal Length Decrease
![Page 13: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/13.jpg)
13
Conclusions and Future Work
• Presentation of a structural uncertainty visualization tool
• Continued visualization of computer vision• Investigation of our cost function– Scene structure computation– Camera pose estimation
![Page 14: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/14.jpg)
14
Acknowledgements
• This work was supported in part by Lawrence Livermore National Laboratory and the National Nuclear Security Agency through Contract No. DE-FG52-09NA29355
![Page 15: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/15.jpg)
15
References
[1] Oxford Visual Geometry Group, “Multi-view and Oxford Colleges building reconstruction,” August 2009.[2] V. Rodehorst, M. Heinrichs, and O. Hellwich, “Evaluation of relative pose estimation methods for multi-camera setups,” in International Archives of Photogrammetry and Remote Sensing (ISPRS ’08), (Beijing, China), pp. 135–140, 2008.[3] D. Knoblauch, M. Hess-Flores, M. A. Duchaineau, and F. Kuester, “Factorization of correspondence and camera error for unconstrained dense correspondence applications,” in 5th International Symposium on Visual Computing, pp. 720–729, 2009.[4] T. Torsney-Weir, A. Saad, T. M´’oller, H.-C. Hege, B. Weber, and J.-M. Verbavatz, “Tuner: Principled parameter finding for image segmentation algorithms using visual response surface exploration,” IEEE Trans. On Visualization and Computer Graphics, vol. 17, no. 12, pp. 1892–1901, 2011.[5] A. Saad, T. M´’oller, and G. Hamarneh, “Probexplorer: Uncertainty guided exploration and editing of probabilistic medical image segmentation,” Computer Graphics Forum, vol. 29, no. 3, pp. 1113–1122, 2010.
![Page 16: Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline](https://reader035.vdocuments.site/reader035/viewer/2022062811/56815fd9550346895dcedc7a/html5/thumbnails/16.jpg)
16
Reprojection Error versus Angular Error
Reprojection Error Scalar Field
Average Scalar Field