Investigating mathematical models for focused plenoptic cameras

This paper presents a mathematical projection model for focused plenoptic cameras. The model defines the projection from object space to the virtual image space inside the plenoptic camera. We estimate the camera model by performing bundle adjustment based on a 3D calibration target. In this article we investigate different depth distortion models as well as the influence of a sensor tilted with respect to the main lens. We evaluate what depth accuracies can be achieved based on the presented models.

[1]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[2]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[4]  A. Lumsdaine.  Full Resolution Lightfield Rendering , 2008 .

[5]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[6]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[7]  Bastian Goldlücke,et al.  On the Calibration of Focused Plenoptic Cameras , 2013, Time-of-Flight and Depth Imaging.

[8]  Uwe Stilla,et al.  Calibration and accuracy analysis of a focused plenoptic camera , 2014 .

[9]  Stephan Hussmann,et al.  Automated robust metric calibration of multi-focus plenoptic cameras , 2015, 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[10]  Uwe Stilla,et al.  Establishing a Probabilistic Depth Map from Focused Plenoptic Cameras , 2015, 2015 International Conference on 3D Vision.

[11]  Uwe Stilla,et al.  Depth estimation and camera calibration of a focused plenoptic camera for visual odometry , 2016 .

[12]  Uwe Stilla,et al.  METRIC CALIBRATION OF A FOCUSED PLENOPTIC CAMERA BASED ON A 3D CALIBRATION TARGET , 2016 .

[13]  Klaus H. Strobl,et al.  Stepwise calibration of focused plenoptic cameras , 2016, Comput. Vis. Image Underst..

[14]  Stephan Hussmann,et al.  Automated Robust Metric Calibration Algorithm for Multifocus Plenoptic Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.