Rectification of Images Distorted by Microlens Array Errors in Plenoptic Cameras

A plenoptic cameras is a sensor that records the 4D light-field distribution of target scenes. The surface errors of a microlens array (MLA) can cause the degradation and distortion of the raw image captured by a plenoptic camera, resulting in the confusion or loss of light-field information. To address this issue, we propose a method for the local rectification of distorted images using white light-field images. The method consists of microlens center calibration, geometric rectification, and grayscale rectification. The scope of its application to different sized errors and the rectification accuracy of three basic surface errors, including the overall accuracy and the local accuracy, are analyzed through simulation of imaging experiments. The rectified images have a significant improvement in quality, demonstrating the provision of precise light-field data for reconstruction of real objects.

[1]  Sangyoun Lee,et al.  Face Liveness Detection Using a Light Field Camera , 2014, Sensors.

[2]  Fengzhou Fang,et al.  Influence of machining errors on form errors of microlens arrays in ultra-precision turning , 2015 .

[3]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[4]  Giovanni Maria Farinella,et al.  Distortion adaptive Sobel filters for the gradient estimation of wide angle images , 2017, J. Vis. Commun. Image Represent..

[6]  Shengxian Shi,et al.  Parametric study on light field volumetric particle image velocimetry , 2016 .

[7]  Jiwang Yan,et al.  Ductile machining of single-crystal silicon for microlens arrays by ultraprecision diamond turning using a slow tool servo , 2017 .

[8]  Bin Liu,et al.  Light-field-camera imaging simulation of participatory media using Monte Carlo method , 2016 .

[9]  Marc Levoy,et al.  Light field microscopy , 2006, ACM Trans. Graph..

[10]  Liu Bin,et al.  Local error and its identification for microlens array in plenoptic camera , 2018 .

[11]  Yuan Yuan,et al.  Correction model for microlens array assembly error in light field camera. , 2016, Optics express.

[12]  Brian S. Thurow,et al.  Calibration of a Microlens Array for a Plenoptic Camera , 2014 .

[13]  Fernando Pérez,et al.  Automated Software Acceleration in Programmable Logic for an Efficient NFFT Algorithm Implementation: A Case Study , 2017, Sensors.

[14]  João Pedro Barreto,et al.  sRD-SIFT: Keypoint Detection and Matching in Images With Radial Distortion , 2012, IEEE Transactions on Robotics.

[15]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  T. Fahringer,et al.  Volumetric particle image velocimetry with a single plenoptic camera , 2015 .

[17]  Ming Liu,et al.  Centroid shift analysis of microlens array detector in interference imaging system , 2015 .

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[20]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[21]  Yuan Yuan,et al.  High-Accuracy Correction of a Microlens Array for Plenoptic Imaging Sensors , 2019, Sensors.

[22]  Qian Chen,et al.  Inclinometer Assembly Error Calibration and Horizontal Image Correction in Photoelectric Measurement Systems , 2018, Sensors.

[23]  Yiwei Cao,et al.  An effective rectification method for lenselet-based plenoptic cameras , 2016, SPIE/COS Photonics Asia.

[24]  Matthew Johnson-Roberson,et al.  Towards real-time underwater 3D reconstruction with plenoptic cameras , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Giovanni Maria Farinella,et al.  Affine Covariant Features for Fisheye Distortion Local Modeling , 2017, IEEE Transactions on Image Processing.

[26]  David Hernández,et al.  Super-Resolution in Plenoptic Cameras Using FPGAs , 2014, Sensors.

[27]  Chuanlong Xu,et al.  Three-dimensional temperature field measurement of flame using a single light field camera. , 2016, Optics express.

[28]  Liu Bin,et al.  Influence of microlens array manufacturing errors on light-field imaging , 2018 .

[29]  H. Tan,et al.  Microlens assembly error analysis for light field camera based on Monte Carlo method , 2016 .

[30]  Svorad Stolc,et al.  A Review of Depth and Normal Fusion Algorithms , 2018, Sensors.

[31]  T. Fahringer,et al.  The E ect of Grid Resolution on the Accuracy of Tomographic Reconstruction Using a Plenoptic Camera , 2013 .

[32]  Ryad Benosman,et al.  Plenoptic cameras in real-time robotics , 2013, Int. J. Robotics Res..

[33]  Bin Liu,et al.  Simulation of light-field camera imaging based on ray splitting Monte Carlo method , 2015 .

[34]  Giovanni Maria Farinella,et al.  Generalized Sobel Filters for gradient estimation of distorted images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[35]  Hao Chen,et al.  Three-Dimensional Three-Component Air Flow Visualization in a Steady-State Engine Flow Bench Using a Plenoptic Camera , 2017 .

[36]  Dan Xie,et al.  Rapid fabrication of thermoplastic polymer refractive microlens array using contactless hot embossing technology. , 2015, Optics express.

[37]  Sen-Yue Yang,et al.  Imprinting of double-sided microstructures with rapid induction heating and gas-assisted pressuring , 2017 .

[38]  Jean-Philippe Thiran,et al.  Scale Invariant Feature Transform on the Sphere: Theory and Applications , 2011, International Journal of Computer Vision.

[39]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Hsiao-Yu Chou,et al.  Fabrication of a double-sided micro-lens array by a glass molding technique , 2011 .