High angular resolution light field reconstruction with coded-aperture mask

In the past decade, light field imaging has greatly extended the imaging capabilities of traditional photography. However, the applications of light field imaging are limited by the aliasing artifacts due to the plenoptic sampling trade-off between angular and spatial domains. We propose to use a coded aperture light field camera instead of the traditional one, which can get more angular information without losing spatial resolution. To that end, we exploit a theoretical model to explain the relationship between light field and the raw data captured by the sensor. Then, we design a mask to code the rays using compressive sensing. Last, the sparse characteristic of light field in gradient domain and the corresponding optimization methods are utilized to reconstruct the high angular resolution light field. Experimental results on synthetic data and real data demonstrate that our system can obtain high angular resolution light field by producing a low-aliasing refocused image and high PSNR multi-view images.

[1]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[2]  W. Freeman,et al.  Understanding Camera Trade-Offs through a Bayesian Analysis of Light Field Projections , 2008, ECCV.

[3]  Zhaolin Xiao,et al.  Aliasing Detection and Reduction in Plenoptic Imaging , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Aggelos K. Katsaggelos,et al.  Compressive Light Field Sensing , 2012, IEEE Transactions on Image Processing.

[5]  Chia-Kai Liang,et al.  Programmable aperture photography: multiplexed light field acquisition , 2008, SIGGRAPH 2008.

[6]  Dehui Kong,et al.  High-Resolution Light Field Capture With Coded Aperture , 2015, IEEE Transactions on Image Processing.

[7]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[8]  Shree K. Nayar,et al.  Computational Cameras: Approaches, Benefits and Limits , 2011 .

[9]  Frédo Durand,et al.  Linear view synthesis using a dimensionality gap light field prior , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[11]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[12]  Gordon Wetzstein,et al.  On Plenoptic Multiplexing and Reconstruction , 2012, International Journal of Computer Vision.

[13]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[14]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[15]  Shree K. Nayar,et al.  Programmable Aperture Camera Using LCoS , 2012, IPSJ Trans. Comput. Vis. Appl..

[16]  Qionghai Dai,et al.  Light field from micro-baseline image pair , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ashok Veeraraghavan,et al.  Towards Motion Aware Light Field Video for Dynamic Scenes , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Mark A. Neifeld,et al.  Compressive light field imaging , 2010, Defense + Commercial Sensing.

[20]  Edmund Y Lam,et al.  High-resolution lightfield photography using two masks. , 2012, Optics express.