A Light Field Camera Calibration Method Using Sub-Aperture Related Bipartition Projection Model and 4D Corner Detection

Accurate calibration of intrinsic parameters of the light field (LF) camera is the key issue of many applications, especially of the 3D reconstruction. In this paper, we propose the Sub-Aperture Related Bipartition (SARB) projection model to characterize the LF camera. This projection model is composed with two sets of parameters targeting on center view sub-aperture and relations between sub-apertures. Moreover, we also propose a corner point detection algorithm which fully utilizes the 4D LF information in the raw image. Experimental results have demonstrated the accuracy and robustness of the corner detection method. Both the 2D re-projection errors in the lateral direction and errors in the depth direction are minimized because two sets of parameters in SARB projection model are solved separately.

[1]  Uwe Stilla,et al.  From the Calibration of a Light-Field Camera to Direct Plenoptic Odometry , 2017, IEEE Journal of Selected Topics in Signal Processing.

[2]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[3]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Rui Yu,et al.  All-In-Focus Synthetic Aperture Imaging , 2014, ECCV.

[7]  Ren Ng.  Fourier Slice Photography , 2005 .

[8]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[11]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[12]  Robert E. Mahony,et al.  Calibrating Light-Field Cameras Using Plenoptic Disc Features , 2018, 2018 International Conference on 3D Vision (3DV).

[13]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[14]  Ravi Ramamoorthi,et al.  A Light Transport Framework for Lenslet Light Field Cameras , 2015, TOGS.

[15]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[16]  Na Liu,et al.  A new imaging model of Lytro light field camera and its calibration , 2019, Neurocomputing.

[17]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Ramesh Raskar,et al.  Axial-cones: modeling spherical catadioptric cameras for wide-angle light field rendering , 2010, SIGGRAPH 2010.

[19]  Marc Levoy,et al.  Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Qing Wang,et al.  A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[22]  In So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light-Field Cameras Using Line Features , 2014, ECCV.

[23]  Ping Zhou,et al.  A two-step calibration method of lenslet-based light field cameras , 2019 .

[24]  Stephan Hussmann,et al.  Automated Robust Metric Calibration Algorithm for Multifocus Plenoptic Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.

[25]  A. Thetford.  Introduction to Matrix Methods in Optics , 1976 .

[26]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[27]  Sébastien Ourselin,et al.  Corner-Based Geometric Calibration of Multi-focus Plenoptic Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[28]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[29]  Ryad Benosman,et al.  Plenoptic cameras in real-time robotics , 2013, Int. J. Robotics Res..

[30]  Michel Dhome,et al.  Light-Field Camera Calibration from Raw Images , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).