light field photography introduction

17
Light Field Photography Gordon Wetzstein Research Scientist MIT Media Lab . Camera Culture media.mit.edu/~gordonw slides: many talks & computational photography courses from Media Lab, CSAIL (Fredo Durand), Stanford (Marc Levoy)

Upload: mit-media-lab-camera-culture-group

Post on 01-Sep-2014

549 views

Category:

Business


1 download

DESCRIPTION

 

TRANSCRIPT

  • Light Field Photography Gordon Wetzstein Research Scientist MIT Media Lab . Camera Culture media.mit.edu/~gordonw slides: many talks & computational photography courses from Media Lab, CSAIL (Fredo Durand), Stanford (Marc Levoy)
  • Conventional Photo Large ApertureScene from Above
  • Conventional Photo Small ApertureScene from Above
  • Scene from Above Proposed Technology: Mask-Coded Light Field Projection Coded Attenuation Mask
  • Scene from Above Light Field
  • Light FieldScene from Above
  • Scene from Above Applications: Image Refocus
  • Scene from Above Applications: Depth, Segmentation, Object Recognition,
  • Scene from Above Applications: Change Viewpoint & 3D Display e.g., Tensor Displays [Wetzstein et al. 2012]
  • Camera Arrays e.g., [Wilburn et al. 2002,2005] How is it done today? Sequential Acquisition e.g., [Levoy and Hanrahan 1996], [Liang et al. 2008]
  • Scene from Above Lenslet Array [Lippman 1908], [Adelson and Wang 1992], [Ng et al. 2005] Integral Imaging # Sensor Pixels X #SensorPixelsY
  • Scene from Above Integral Imaging
  • Scene from Above # Sensor Pixels X / # Views X #SensorPixelsY/#ViewsY Example Sensor with 2000 x 1000 pixels 5 x 5 light field views, each with 400 x 200 pixels Integral Imaging: Spatio-Angular Resolution Tradeoff!Spatio-Angular Resolution Tradeoff!
  • Light Field is Redundant!Scene from Above
  • Exploit redundancy Compressive Reconstruction Key Insights Light Field Atoms Sparsify Preserve information Mask-based Light Field Coding