Virtual Image Points Based Geometrical Parameters’ Calibration for Focused Light Field Camera

In the light field imaging, the geometrical parameters’ calibration of the light field camera is the foundation of computational imaging techniques, such as the calibration of the light field data, digital refocusing, depth reconstruction, all-in-focus imaging, and so on. In this paper, we propose a virtual image points based geometrical parameters’ calibration for focused light field camera. In the forward model, the mapping from the object points to the virtual image points with respect to the main lens as well as the mapping from the virtual image points to the image points on the detector with respect to the microlens array are established. While calibrating geometrical parameters, the inverse problem of calculating the virtual image points from the corner on the detector is established and the model of calculating the geometrical parameters of the focused light field camera is established. Levenberg–Marquardt algorithm is used to solve the geometrical parameters iteratively. We use the checkerboard for the calibration experiment and validate the calculation via the reprojection of the checkerboard corners.

[1]  Tsuhan Chen,et al.  A Self-Reconfigurable Camera Array , 2004, Rendering Techniques.

[2]  Klaus H. Strobl,et al.  Stepwise calibration of focused plenoptic cameras , 2016, Comput. Vis. Image Underst..

[3]  P. Gill,et al.  Algorithms for the Solution of the Nonlinear Least-Squares Problem , 1978 .

[4]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[5]  Qing Wang,et al.  A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  A. Lumsdaine.  Full Resolution Lightfield Rendering , 2008 .

[7]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[8]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[10]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  M. Levoy,et al.  Light field microscopy , 2006, SIGGRAPH 2006.

[12]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[13]  Uwe Stilla,et al.  Depth estimation and camera calibration of a focused plenoptic camera for visual odometry , 2016 .

[14]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Yael Pritch,et al.  Scene reconstruction from high spatio-angular resolution light fields , 2013, ACM Trans. Graph..

[16]  Sébastien Ourselin,et al.  Corner-Based Geometric Calibration of Multi-focus Plenoptic Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[18]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[19]  In-So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light Field Cameras Using Line Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  M. Levoy,et al.  The light field , 1939 .

[22]  S A Self,et al.  Focusing of spherical Gaussian beams. , 1983, Applied optics.

[23]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[24]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[25]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Leonard McMillan,et al.  A Real-Time Distributed Light Field Camera , 2002, Rendering Techniques.

[27]  Qing Wang,et al.  Decoding and calibration method on focused plenoptic camera , 2016, Computational Visual Media.

[28]  Bastian Goldlücke,et al.  On the Calibration of Focused Plenoptic Cameras , 2013, Time-of-Flight and Depth Imaging.

[29]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[30]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[32]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .