Blur Aware Calibration of Multi-Focus Plenoptic Camera

This paper presents a novel calibration algorithm for Multi-Focus Plenoptic Cameras (MFPCs) using raw images only. The design of such cameras is usually complex and relies on precise placement of optic elements. Several calibration procedures have been proposed to retrieve the camera parameters but relying on simplified models, reconstructed images to extract features, or multiple calibrations when several types of micro-lens are used. Considering blur information, we propose a new Blur Aware Plenoptic (BAP) feature. It is first exploited in a pre-calibration step that retrieves initial camera parameters, and secondly to express a new cost function for our single optimization process. The effectiveness of our calibration method is validated by quantitative and qualitative experiments.

[1]  Marlien Herselman,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2015 .

[2]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[3]  Stephan Hussmann,et al.  Automated Robust Metric Calibration Algorithm for Multifocus Plenoptic Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.

[4]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[5]  Bastian Goldlücke,et al.  On the Calibration of Focused Plenoptic Cameras , 2013, Time-of-Flight and Depth Imaging.

[6]  Shengxian Shi,et al.  Parametric study on light field volumetric particle image velocimetry , 2016 .

[7]  Robert E. Mahony,et al.  Calibrating Light-Field Cameras Using Plenoptic Disc Features , 2018, 2018 International Conference on 3D Vision (3DV).

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  Andrew Lumsdaine,et al.  The multifocus plenoptic camera , 2011, Electronic Imaging.

[10]  W. Freeman,et al.  Understanding Camera Trade-Offs through a Bayesian Analysis of Light Field Projections , 2008, ECCV.

[11]  Ping Zhou,et al.  A two-step calibration method of lenslet-based light field cameras , 2019 .

[12]  Tomasz Wrona,et al.  Microlens array calibration method for a light field camera , 2018, 2018 19th International Carpathian Control Conference (ICCC).

[13]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[14]  Uwe Stilla,et al.  Calibration and accuracy analysis of a focused plenoptic camera , 2014 .

[15]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Brian S. Thurow,et al.  Calibration of a Microlens Array for a Plenoptic Camera , 2014 .

[17]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[18]  In-So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light Field Cameras Using Line Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[20]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[21]  Michel Dhome,et al.  Light-Field Camera Calibration from Raw Images , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[22]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[23]  Di He,et al.  Virtual Image Points Based Geometrical Parameters’ Calibration for Focused Light Field Camera , 2018, IEEE Access.

[24]  Biao Zhang,et al.  Geometric calibration of focused light field camera for 3-D flame temperature measurement , 2016, 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[25]  Sébastien Ourselin,et al.  Corner-Based Geometric Calibration of Multi-focus Plenoptic Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Vladan Velisavljevic,et al.  Real-Time Refocusing Using an FPGA-Based Standard Plenoptic Camera , 2018, IEEE Transactions on Industrial Electronics.

[27]  Qing Wang,et al.  Unconstrained Two-parallel-plane Model for Focused Plenoptic Cameras Calibration , 2016, ArXiv.

[28]  Shengxian Shi,et al.  Volumetric calibration enhancements for single-camera light-field PIV , 2019, Experiments in Fluids.

[29]  Andrew Lumsdaine,et al.  Resolution in Plenoptic Cameras , 2009 .

[30]  Qing Wang,et al.  Decoding and calibration method on focused plenoptic camera , 2016, Computational Visual Media.

[31]  Klaus H. Strobl,et al.  Stepwise calibration of focused plenoptic cameras , 2016, Comput. Vis. Image Underst..

[32]  Uwe Stilla,et al.  METRIC CALIBRATION OF A FOCUSED PLENOPTIC CAMERA BASED ON A 3D CALIBRATION TARGET , 2016 .