High-Accuracy Correction of a Microlens Array for Plenoptic Imaging Sensors

Microlens array (MLA) errors in plenoptic cameras can cause the confusion or mismatching of 4D spatio-angular information in the image space, significantly affecting the accuracy and efficiency of target reconstruction. In this paper, we present a high-accuracy correction method for light fields distorted by MLA errors. Subpixel feature points are extracted from the microlens subimages of a raw image to obtain correction matrices and perform registration of the corresponding subimages at a subpixel level. The proposed method is applied for correcting MLA errors of two different categories in light-field images, namely form errors and orientation errors. Experimental results show that the proposed method can rectify the geometric and intensity distortions of raw images accurately and improve the quality of light-field refocusing. Qualitative and quantitative comparisons between images before and after correction verify the performance of our method in terms of accuracy, stability, and adaptability.

[1]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Ping Zhou,et al.  A two-step calibration method of lenslet-based light field cameras , 2019 .

[3]  Qianlong Wang,et al.  Assessment of plenoptic imaging for reconstruction of 3D discrete and continuous luminous fields. , 2019, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Tomasz Wrona,et al.  Microlens array calibration method for a light field camera , 2018, 2018 19th International Carpathian Control Conference (ICCC).

[5]  Jianliang Xiao,et al.  Mechanics and optics of stretchable elastomeric microlens array for artificial compound eye camera , 2015 .

[6]  Gil Ju Lee,et al.  Large area fabrication of engineered microlens array with low sag height for light-field imaging. , 2019, Optics express.

[7]  Yuan Yuan,et al.  Rectification of Images Distorted by Microlens Array Errors in Plenoptic Cameras , 2018, Sensors.

[8]  Brian S Thurow,et al.  Uncertainty characterization of particle location from refocused plenoptic images. , 2017, Optics express.

[9]  Liu Bin,et al.  Local error and its identification for microlens array in plenoptic camera , 2018 .

[10]  Jae Woo Kim,et al.  Content-Aware Focal Plane Selection and Proposals for Object Tracking on Plenoptic Image Sequences , 2019, Sensors.

[11]  Yuanchi Ma,et al.  A depth estimation algorithm of plenoptic camera for the measurement of particles , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[12]  Homer H. Chen,et al.  Analysis of the effect of calibration error on light field super-resolution rendering , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Bin Liu,et al.  Simulation of light-field camera imaging based on ray splitting Monte Carlo method , 2015 .

[14]  Jun Cao,et al.  Calibrating the orientation between a microlens array and a sensor based on projective geometry , 2016 .

[15]  Volker Sick,et al.  Human iris three-dimensional imaging at micron resolution by a micro-plenoptic camera. , 2017, Biomedical optics express.

[16]  Chuanlong Xu,et al.  Characteristics of tomographic reconstruction of light-field Tomo-PIV , 2019, Optics Communications.

[17]  Jonathan Ko,et al.  Imaging through strong turbulence with a light field approach. , 2016, Optics express.

[18]  He-Ping Tan,et al.  Light field imaging analysis of flame radiative properties based on Monte Carlo method , 2018 .

[19]  Yiwei Cao,et al.  An effective rectification method for lenselet-based plenoptic cameras , 2016, SPIE/COS Photonics Asia.

[20]  Qian Chen,et al.  Inclinometer Assembly Error Calibration and Horizontal Image Correction in Photoelectric Measurement Systems , 2018, Sensors.

[21]  Qing Wang,et al.  A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[23]  Shugui Liu,et al.  Identification and compensation of main machining errors on surface form accuracy in ultra-precision diamond turning , 2016 .

[24]  Viktor Malyarchuk,et al.  Digital cameras with designs inspired by the arthropod eye , 2013, Nature.

[25]  Chuanlong Xu,et al.  Three-dimensional temperature field measurement of flame using a single light field camera. , 2016, Optics express.

[26]  Liu Bin,et al.  Influence of microlens array manufacturing errors on light-field imaging , 2018 .

[27]  Shengxian Shi,et al.  Volumetric calibration enhancements for single-camera light-field PIV , 2019, Experiments in Fluids.

[28]  Chuanlong Xu,et al.  Liquid lens-based optical sectioning tomography for three-dimensional flame temperature measurement , 2017 .

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  In-So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light Field Cameras Using Line Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Reinhard Koch,et al.  Robust Depth Estimation for Light Field Microscopy , 2019, Sensors.

[32]  Xiang Peng,et al.  Light field 3D measurement using unfocused plenoptic cameras. , 2018, Optics letters.

[33]  H. Tan,et al.  Microlens assembly error analysis for light field camera based on Monte Carlo method , 2016 .

[34]  H. Tan,et al.  Identification and correction of microlens array rotation error in plenoptic imaging systems , 2019, Optics and Lasers in Engineering.