lighting-up geometry: accurate 3d modelling with a torch and a camera george vogiatzis, carlos...
TRANSCRIPT
![Page 1: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/1.jpg)
Lighting-up geometry: accurate 3D modelling with
a torch and a camera
George Vogiatzis, Carlos Hernández, Roberto CipollaUniversity of Cambridge, Toshiba Research
![Page 2: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/2.jpg)
Our technique• Aquire high-res mesh from images taken
under changing camera position and illumination
• Changing illumination uncovers fine geometric detail
• Assumptions:– Lambertian surface,
isolated highlights– Single, distant light-source– Silhouettes of object can be
extracted
![Page 3: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/3.jpg)
Image Acquisition Setup
![Page 4: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/4.jpg)
In a nutshell:In a nutshell:
• Estimate light direction in each image• With known light directions can estimate
surface normals n from pixel intensities i• Integrate normals to get geometry
n
il
![Page 5: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/5.jpg)
• Calibration object– Fully known geometry– Light can be estimated from intensity of all points
Light estimation
![Page 6: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/6.jpg)
• Visual hull
Light estimation
![Page 7: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/7.jpg)
Light estimation• Virtual calibration object
– Partially known geometry– Light can be estimated from intensity of correct points
![Page 8: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/8.jpg)
Surface Evolution: Deformable 3D Mesh
Evolve mesh until it is predicted appearance under recovered illumination matches images
![Page 9: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/9.jpg)
Results
![Page 10: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/10.jpg)
Results
![Page 11: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/11.jpg)
Results
![Page 12: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/12.jpg)
Results
![Page 13: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/13.jpg)
Results
![Page 14: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/14.jpg)
Results
![Page 15: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/15.jpg)
Results
![Page 16: Lighting-up geometry: accurate 3D modelling with a torch and a camera George Vogiatzis, Carlos Hernández, Roberto Cipolla University of Cambridge, Toshiba](https://reader035.vdocuments.site/reader035/viewer/2022081603/56649e6b5503460f94b68c42/html5/thumbnails/16.jpg)
Advantages
– Fully uncalibrated. Camera position and illumination are recovered from images alone
– Low cost, practical and efficient alternative to laser range scanning
– First image based method to obtain full 3D geometry of untextured objects