Feasibility study for super-resolution 3D integral imaging using time-multiplexed compressive coding.

We propose a novel super-resolution 3D II method using a time-multiplexed coding mask for improving the resolution of 3D imaging based on compressive sensing (CS) theory. Instead of sensing raw pixel data, the recording device measures the compressive samples of the observed 3D scene through a coding mask placed in the aerial pickup plane in a 3D II system. With the aid of CS framework, we design an optimum coding mask pattern and use the time-multiplexed scheme to achieve a sequence of low-resolution elemental images (EIs), which contain the subpixel details of the observed 3D scene. The super-resolution EIs array is further recovered by an optimization algorithm. Both computational reconstruction and optical experimental results show the validity of the proposed method.

[1]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[2]  F. Okano,et al.  Analysis of resolution limitation of integral photography , 1998 .

[3]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[4]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[5]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[6]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[7]  Bahram Javidi,et al.  Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing. , 2004, Optics express.

[8]  Myungjin Cho,et al.  3D passive integral imaging using compressive sensing. , 2012, Optics express.

[9]  C. Burckhardt.  Optimum Parameters and Resolution Limitation of Integral Photography , 1968 .

[10]  B. Javidi,et al.  Integral three-dimensional imaging with digital reconstruction. , 2001, Optics letters.

[11]  Byung-Gook Lee,et al.  Resolution-enhanced integral imaging in focal mode with a time-multiplexed electrical mask array. , 2014, Optics express.

[12]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[13]  M McCormick,et al.  Discussion of the optics of a new 3-D imaging system. , 1988, Applied optics.

[14]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[15]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[16]  Byoungho Lee,et al.  Recent progress in three-dimensional information processing based on integral imaging. , 2009, Applied optics.

[17]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[18]  B. Javidi,et al.  Enhanced depth of field integral imaging with sensor resolution constraints. , 2004, Optics express.

[19]  Bahram Javidi,et al.  Feasibility study for compressive multi-dimensional integral imaging. , 2013, Optics express.

[20]  B. Javidi,et al.  Three-dimensional synthetic aperture integral imaging. , 2002, Optics letters.

[21]  E. Candès.  The restricted isometry property and its implications for compressed sensing , 2008 .

[22]  Bahram Javidi,et al.  Generalization of three-dimensional N-ocular imaging systems under fixed resource constraints. , 2012, Optics letters.

[23]  Eun-Soo Kim,et al.  Resolution-enhanced three-dimensional image reconstruction by use of smart pixel mapping in computational integral imaging. , 2008, Applied optics.

[24]  B. Javidi,et al.  Effects of device resolution on three-dimensional integral imaging. , 2004, Optics letters.

[25]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[26]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[27]  Chen Yang,et al.  Three-Dimensional Super Resolution Reconstruction by Integral Imaging , 2015, Journal of Display Technology.