Shearlet Enhanced Snapshot Compressive Imaging

Snapshot compressive imaging (SCI) is a promising approach to capture high-dimensional data with low dimensional sensors. With modest modifications to off-the-shelf cameras, SCI cameras encode multiple frames into a single measurement frame. These correlated frames can then be retrieved by reconstruction algorithms. Existing reconstruction algorithms suffer from low speed or low fidelity. In this paper, we propose a novel reconstruction algorithm, namely, Shearlet enhanced Snapshot Compressive Imaging (SeSCI), which exploits the sparsity of the image representation in both frequency domain and shearlet domain. Towards this end, we first derive our SeSCI algorithm under the alternating direction method of multipliers (ADMM) framework. We then propose an efficient solution of SeSCI algorithm. Moreover, we prove that the improved SeSCI algorithm converges to a fixed point. Experimental results on both synthetic data and real data captured by SCI cameras demonstrate the significant advantages of SeSCI, which outperforms the conventional algorithms by more than 2dB in PSNR. At the same time, the SeSCI achieves a speed-up more than $100\times $ over the state-of-the-art algorithm.

[1]  Guillermo Sapiro,et al.  Low-Cost Compressive Sensing for Color Video and Depth , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Hamid Krim,et al.  A Shearlet Approach to Edge Analysis and Detection , 2009, IEEE Transactions on Image Processing.

[3]  Guihua Zeng,et al.  Fast first-photon ghost imaging , 2018, Scientific Reports.

[4]  Qionghai Dai,et al.  Rank Minimization for Snapshot Compressive Imaging , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ingrid Daubechies,et al.  1. The What, Why, and How of Wavelets , 1992 .

[6]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[7]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[8]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[9]  Guillermo Sapiro,et al.  Compressive Sensing by Learning a Gaussian Mixture Model From Measurements , 2015, IEEE Transactions on Image Processing.

[10]  Wang-Q Lim,et al.  ShearLab 3D , 2014, 1402.5670.

[11]  Xin Yuan,et al.  Snapshot Compressed Sensing: Performance Bounds and Algorithms , 2018, IEEE Transactions on Information Theory.

[12]  Gitta Kutyniok,et al.  Asymptotic Analysis of Inpainting via Universal Shearlet Systems , 2014, SIAM J. Imaging Sci..

[13]  Wang-Q Lim,et al.  Optimally Sparse Image Representations using Shearlets , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[14]  Jocelyn Chanussot,et al.  A New Pansharpening Method Based on Spatial and Spectral Sparsity Priors , 2014, IEEE Transactions on Image Processing.

[15]  Albert J. P. Theuwissen,et al.  Computational imaging , 2012, 2012 IEEE International Solid-State Circuits Conference.

[16]  Zheng Shou,et al.  Deep Tensor ADMM-Net for Snapshot Compressive Imaging , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[17]  Xin Yuan,et al.  Generalized alternating projection based total variation minimization for compressive sensing , 2015, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Shree K. Nayar,et al.  Video from a single coded exposure photograph using a learned over-complete dictionary , 2011, 2011 International Conference on Computer Vision.

[19]  Tao Zhang,et al.  HyperReconNet: Joint Coded Aperture Optimization and Image Reconstruction for Compressive Hyperspectral Imaging , 2019, IEEE Transactions on Image Processing.

[20]  Xin Yuan,et al.  Compressive Hyperspectral Imaging With Side Information , 2015, IEEE Journal of Selected Topics in Signal Processing.

[21]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[22]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[23]  Klaus Diepold,et al.  Cartoon-like image reconstruction via constrained ℓp-minimization , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[25]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[26]  Guillermo Sapiro,et al.  Video Compressive Sensing Using Gaussian Mixture Models , 2014, IEEE Transactions on Image Processing.

[27]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[28]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[29]  Saurabh Prasad,et al.  Morphologically Decoupled Structured Sparsity for Rotation-Invariant Hyperspectral Image Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[31]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[32]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[33]  Vivek K Goyal,et al.  Quantum-inspired computational imaging , 2018, Science.

[34]  Demetrio Labate,et al.  Characterization and Analysis of Edges Using the Continuous Shearlet Transform , 2009, SIAM J. Imaging Sci..

[35]  Henry Arguello,et al.  Temporal Colored Coded Aperture Design in Compressive Spectral Video Sensing , 2019, IEEE Trans. Image Process..

[36]  Xue Liu,et al.  Data Loss and Reconstruction in Wireless Sensor Networks , 2014, IEEE Transactions on Parallel and Distributed Systems.

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Wang-Q Lim,et al.  Image interpolation using shearlet based iterative refinement , 2013, Signal Process. Image Commun..

[39]  Henry Arguello Fuentes,et al.  Temporal Colored Coded Aperture Design in Compressive Spectral Video Sensing , 2019, IEEE Transactions on Image Processing.

[40]  D. Labate,et al.  Characterization and analysis of edges in piecewise smooth functions , 2016 .