Analysis of the effect of calibration error on light field super-resolution rendering

Light field photography, which has recently drawn considerable attention, provides novel functionalities such as refocusing and depth estimation at the same time. However, the resolution of the rendered refocus image is incomparably lower than the number of light ray samples in the light field. In this paper, we show that super-resolution can be performed to bridge the gap and that deconvolution, which is missing in most previous methods, is essential to the success of light field super-resolution rendering. In addition, we investigate the effect of four different kinds of camera calibration error on the quality of rendered images. Given an expected level of image quality, the upperbound of the camera calibration error is analyzed.

[1]  Andrew Lumsdaine,et al.  Superresolution with the focused plenoptic camera , 2011, Electronic Imaging.

[2]  Fernando Pérez,et al.  Fourier Slice Super-resolution in plenoptic cameras , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[3]  Fernando P. Nava,et al.  Super-Resolution in Plenoptic Cameras by the Integration of Depth from Focus and Stereo , 2010, ICCCN.

[4]  Ren Ng.  Fourier slice photography , 2005, ACM Trans. Graph..

[5]  Gordon Wetzstein,et al.  Computational Plenoptic Imaging , 2011, Comput. Graph. Forum.

[6]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[7]  Andrew Lumsdaine,et al.  Using Focused Plenoptic Cameras for Rich Image Capture , 2011, IEEE Computer Graphics and Applications.

[8]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[9]  J. P. Luke,et al.  Simultaneous estimation of super-resolved depth and all-in-focus images from a plenoptic camera , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[10]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[11]  Homer H. Chen,et al.  Light Field Analysis for Modeling Image Formation , 2011, IEEE Transactions on Image Processing.

[12]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[13]  Tom E. Bishop,et al.  Light field superresolution , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[14]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .