A simple and robust super resolution method for light field images

Light field cameras generate low-resolution images due to the tradeoff between spatial and angular resolution. Traditional light field super-resolution (LFSR) methods depend on prior knowledge of depth information. This paper presents a projection-based LFSR solution without prior information based on redefinition of the mapping function between disparity and shearing shift. Moreover, simplified variational regularization is imposed in global optimization formulation to the rendered high-resolution images. Both a synthetic dataset and a real-world dataset of light field images captured by a self-developed light field camera are used to demonstrate the state-of-the-art performance of the proposed method.

[1]  Seong-Deok Lee,et al.  Improving the spatail resolution based on 4D light field data , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Zhenan Sun,et al.  Eyelash Removal Using Light Field Camera for Iris Recognition , 2014, CCBR.

[3]  Tieniu Tan,et al.  Albedo assisted high-quality shape recovery from 4D light fields , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Tom E. Bishop,et al.  Light field superresolution , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[5]  Sven Wanner,et al.  Spatial and Angular Variational Super-Resolution of 4D Light Fields , 2012, ECCV.

[6]  J. P. Luke,et al.  Simultaneous estimation of super-resolved depth and all-in-focus images from a plenoptic camera , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[7]  In-So Kweon,et al.  Learning a Deep Convolutional Network for Light-Field Image Super-Resolution , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Sven Wanner,et al.  Datasets and Benchmarks for Densely Sampled 4D Light Fields , 2013, VMV.

[10]  Liu Peng,et al.  All-in-Focus Image Reconstruction Based on Plenoptic Cameras , 2013, 2013 Seventh International Conference on Image and Graphics.

[11]  Ravi Ramamoorthi,et al.  A Light Transport Framework for Lenslet Light Field Cameras , 2015, TOGS.

[12]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Sven Wanner,et al.  Variational Light Field Analysis for Disparity Estimation and Super-Resolution , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[15]  Andrew Lumsdaine,et al.  Superresolution with Plenoptic 2.0 Cameras , 2009 .

[16]  Tieniu Tan,et al.  Efficient auto-refocusing of iris images for light-field cameras , 2014, IEEE International Joint Conference on Biometrics.

[17]  H AdelsonEdward,et al.  Single Lens Stereo with a Plenoptic Camera , 1992 .

[18]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.