A nonlocal patch-based video compressive sensing recovery algorithm

Compressive sensing (CS) theory proves that signals can be recovered from far fewer random measurements than that suggested by Nyquist-Shannon theorem. This advantage of CS is extremely useful in some data processing applications, especially in video processing. Considering that nonlocal patch-based CS methodology has achieved an impressive performance in image CS field, it motivates us to generalize the idea into the video CS filed. In this paper, by taking account of the spatiotemporal information, we propose a novel strategy to reconstruct the non-key frames of a video sequence by introducing the nonlocal similar patch group from some key frames. Experimental results illustrate that our proposed nonlocal patch-based video CS recovery algorithm can extremely exploit the information of the key frames, and achieve a better performance compared with some existing popular video CS recovery algorithms. It is noted that our idea to construct a spatiotemporal comprehensive patch group may be combined with any nonlocal patch-based CS method for video reconstruction, which leads to various of nonlocal patch-based compressive sensing video recovery algorithms.

[1]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[2]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[3]  Wen Gao,et al.  Structural Group Sparse Representation for Image Compressive Sensing Recovery , 2013, 2013 Data Compression Conference.

[4]  Jian Zhang,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014, Signal Process..

[5]  Namrata Vaswani,et al.  LS-CS-Residual (LS-CS): Compressive Sensing on Least Squares Residual , 2009, IEEE Transactions on Signal Processing.

[6]  James E. Fowler,et al.  Video Compressed Sensing with Multihypothesis , 2011, 2011 Data Compression Conference.

[7]  Chen Chen,et al.  Compressed-sensing recovery of images and video using multihypothesis predictions , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[8]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[9]  Martin Burger,et al.  Block compressive sensing of image and video with nonlocal Lagrangian multiplier and patch-based sparse representation , 2017, Signal Process. Image Commun..

[10]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[11]  Leon Axel,et al.  On compressed sensing in parallel MRI of cardiac perfusion using temporal wavelet and TV regularization , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  James E. Fowler,et al.  Residual Reconstruction for Block-Based Compressed Sensing of Video , 2011, 2011 Data Compression Conference.

[13]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[14]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[15]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[16]  Ali Bilgin,et al.  Compressed sensing using a Gaussian Scale Mixtures model in wavelet domain , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Wen Gao,et al.  Video Compressive Sensing Reconstruction via Reweighted Residual Sparsity , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[19]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[20]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.