Improved resolution integral imaging using random aperture coding based on compressive sensing

Abstract The low-resolution of the three-dimensional (3D) image is the main limitation for the development of integral imaging. We proposed a resolution enhanced integral imaging method by using a randomly coded aperture based on compressive sensing (CS). The compressive integral imaging model is derived based on wave optics theory. Instead of sensing raw pixel data, the recording device measures the compressive samples of the observed 3D scene through a random phase mask attached to each lenslet. The coded elemental images are captured with a single exposure and the super-resolution elemental images can be reconstructed by an optimization algorithm. In this paper, we use CS in the acquisition of the elemental images, and ultimately on improving the image quality of reproduced 3D scene either by optical experiment or computational method. Both the theoretical model and experimental results show the feasibility of the proposed method.

[1]  M McCormick,et al.  Discussion of the optics of a new 3-D imaging system. , 1988, Applied optics.

[2]  M. Gu,et al.  Advanced Optical Imaging Theory , 1999 .

[3]  H. Hua,et al.  Theoretical analysis for integral imaging performance based on microscanning of a microlens array. , 2008, Optics letters.

[4]  Bahram Javidi,et al.  Single exposure super-resolution compressive imaging by double phase encoding. , 2010, Optics express.

[5]  Aswin C. Sankaranarayanan,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[6]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[7]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[8]  Anting Wang,et al.  Resolution-enhanced integral imaging using two micro-lens arrays with different focal lengths for capturing and display. , 2015, Optics express.

[9]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[10]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[11]  F. Okano,et al.  Analysis of resolution limitation of integral photography , 1998 .

[12]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[13]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[14]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[15]  Byoungho Lee,et al.  Recent progress in three-dimensional information processing based on integral imaging. , 2009, Applied optics.

[16]  Rebecca Willett,et al.  Compressive coded aperture imaging , 2009, Electronic Imaging.

[17]  Helen H. Hu,et al.  Ray Tracing from the Ground Up , 2007 .

[18]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[19]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[20]  C. Burckhardt.  Optimum Parameters and Resolution Limitation of Integral Photography , 1968 .

[21]  Byung-Gook Lee,et al.  Resolution-enhanced integral imaging in focal mode with a time-multiplexed electrical mask array. , 2014, Optics express.

[22]  Bahram Javidi,et al.  Three-Dimensional Imaging, Visualization, and Display 2012 , 2012 .

[23]  Trac D. Tran,et al.  Fast compressive sampling with structurally random matrices , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  A. Stern,et al.  Random Projections Imaging With Extended Space-Bandwidth Product , 2007, Journal of Display Technology.

[25]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[26]  B. Javidi,et al.  Three-dimensional visualization of partially occluded objects using integral imaging , 2005, Journal of Display Technology.

[27]  B. Javidi,et al.  Three-dimensional synthetic aperture integral imaging. , 2002, Optics letters.

[28]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[29]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[30]  Khashayar Mehrany,et al.  Improved resolution three-dimensional integral imaging using optimized irregular lens-array structure. , 2012, Applied optics.