Automatic calibration method for plenoptic camera

Abstract. An automatic calibration method is proposed for a microlens-based plenoptic camera. First, all microlens images on the white image are searched and recognized automatically based on digital morphology. Then, the center points of microlens images are rearranged according to their relative position relationships. Consequently, the microlens images are located, i.e., the plenoptic camera is calibrated without the prior knowledge of camera parameters. Furthermore, this method is appropriate for all types of microlens-based plenoptic cameras, even the multifocus plenoptic camera, the plenoptic camera with arbitrarily arranged microlenses, or the plenoptic camera with different sizes of microlenses. Finally, we verify our method by the raw data of Lytro. The experiments show that our method has higher intelligence than the methods published before.

[1]  Desheng Wen,et al.  A Sub-pixel Centroid Algorithm for Star Image Based on Gaussian Distribution , 2011 .

[2]  Vladan Velisavljevic,et al.  Light field geometry of a Standard Plenoptic Camera. , 2014, Optics express.

[3]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[4]  Chunsheng Hu,et al.  Advances and accuracy performance of the star trackers , 2013, Other Conferences.

[5]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[6]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[7]  Reinhard Koch,et al.  Lens-Based Depth Estimation for Multi-focus Plenoptic Cameras , 2014, GCPR.

[8]  Peng Liu,et al.  Artifacts Reduction in Image Rendering of the Focused Plenoptic Camera , 2015, ICIS 2015.

[9]  P. Nussbaum,et al.  Design, fabrication and testing of microlens arrays for sensors and microsystems , 1997 .

[10]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[12]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[14]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[15]  Peng Liu,et al.  Digital Depth of Field Control in Photography based on Focused Plenoptic Camera , 2015, ICIS 2015.

[16]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Tae-Sun Choi,et al.  Focusing techniques , 1992, Other Conferences.

[18]  ChunHong Wu,et al.  Depth Mapping of Integral Images Through Viewpoint Image Extraction With a Hybrid Disparity Analysis Algorithm , 2008, Journal of Display Technology.

[19]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.