Baseline and Triangulation Geometry in a Standard Plenoptic Camera

In this paper, we demonstrate light field triangulation to determine depth distances and baselines in a plenoptic camera. Advances in micro lenses and image sensors have enabled plenoptic cameras to capture a scene from different viewpoints with sufficient spatial resolution. While object distances can be inferred from disparities in a stereo viewpoint pair using triangulation, this concept remains ambiguous when applied in the case of plenoptic cameras. We present a geometrical light field model allowing the triangulation to be applied to a plenoptic camera in order to predict object distances or specify baselines as desired. It is shown that distance estimates from our novel method match those of real objects placed in front of the camera. Additional benchmark tests with an optical design software further validate the model’s accuracy with deviations of less than ±0.33% for several main lens types and focus settings. A variety of applications in the automotive and robotics field can benefit from this estimation model.

[1]  Alan Hirshfeld,et al.  Parallax: The Race to Measure the Cosmos , 2001 .

[2]  Christopher Hahne,et al.  The standard plenoptic camera: applications of a geometrical light field model , 2016 .

[3]  Marc Levoy,et al.  Light field microscopy , 2006, ACM Trans. Graph..

[4]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[6]  Jitendra Malik,et al.  Shape Estimation from Shading, Defocus, and Correspondence Using Light-Field Angular Coherence , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Vladan Velisavljevic,et al.  Baseline of virtual cameras acquired by a standard plenoptic camera setup , 2014, 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[8]  Aaron F. Bobick,et al.  Large Occlusion Stereo , 1999, International Journal of Computer Vision.

[9]  M. Levoy,et al.  The light field , 1939 .

[10]  Alan L. Yuille,et al.  Local, global, and multilevel stereo matching , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  In So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light-Field Cameras Using Line Features , 2014, ECCV.

[13]  A. Lumsdaine Full Resolution Lightfield Rendering , 2008 .

[14]  Donald William MacVicar,et al.  Real-time stereo vision using FPGAs , 2003 .

[15]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, ACM Trans. Graph..

[16]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[17]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[18]  Vladan Velisavljevic,et al.  Light field geometry of a Standard Plenoptic Camera. , 2014, Optics express.

[19]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[20]  Wilhelm Burger,et al.  Principles of Digital Image Processing - Core Algorithms , 2009, Undergraduate Topics in Computer Science.

[21]  Thomas Pock,et al.  Shape from Light Field Meets Robust PCA , 2014, ECCV.

[22]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Vladan Velisavljevic,et al.  Refocusing distance of a standard plenoptic camera. , 2016, Optics express.

[25]  Richard Szeliski,et al.  Refocusing plenoptic images using depth-adaptive splatting , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[26]  J. Brian Caldwell Fast Wide-Range Zoom for 35mm Format , 2000 .

[27]  Shing-Chow Chan,et al.  Light Field , 2014, Computer Vision, A Reference Guide.

[28]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[29]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[30]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[31]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[32]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[33]  Donald G. Dansereau,et al.  Plenoptic Signal Processing for Robust Vision in Field Robotics , 2013 .