Image/video compressive sensing recovery using joint adaptive sparsity measure

Compressive sensing (CS) is a recently emerging technique and an extensively studied problem in signal and image processing, which enables joint sampling and compression into a unified approach. Recently, local smoothness and nonlocal self-similarity have both led to superior sparsity priors for CS image restoration. In this paper, first, a new sparsity measure called joint adaptive sparsity measure (JASM) is introduced. The proposed JASM enforces both local sparsity and nonlocal 3D sparsity in transform domain, concurrently, providing a powerful mechanism for characterizing the structured sparsities of natural image. More precisely, the local sparsity depicts the local smoothness redundancies exploited by an adaptively learned sparsifying basis, and the nonlocal 3D sparsity corresponds to the nonlocal self-similarity constraint achieved by a new proposed nonlocal statistical sparse modeling. Then, two novel techniques for high-fidelity CS image and video recovery via JASM are proposed. The proposed methods are formulated in the form of minimization functional under regularization-based framework which is solved via an efficient alternating minimization algorithm based on split Bregman framework. Comprehensive experimental results are reported to manifest the effectiveness of the proposed methods compared with the current state-of-the-art methods in CS image/video restoration. HighlightsA new sparsity measure called joint adaptive sparsity measure (JASM) is established.The proposed JASM enforces both local and nonlocal 3D sparsity in transform domain.Two novel techniques for high-fidelity CS image/video recovery via JASM are proposed.Extensive experimental results validate the effectiveness of the proposed methods.

[1]  Nasser Eslahi,et al.  Mixed Gaussian-impulse noise removal from highly corrupted images via adaptive local and nonlocal statistical priors , 2015, 2015 9th Iranian Conference on Machine Vision and Image Processing (MVIP).

[2]  Narendra Ahuja,et al.  Imaging via three-dimensional compressive sampling (3DCS) , 2011, 2011 International Conference on Computer Vision.

[3]  Shuyuan Yang,et al.  Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction , 2011, Neurocomputing.

[4]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[5]  Chen Chen,et al.  Compressed-sensing recovery of images and video using multihypothesis predictions , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[6]  Jian Zhang,et al.  Improved total variation based image compressive sensing recovery by nonlocal regularization , 2012, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[7]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[8]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[9]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[10]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  W. Dong,et al.  Compressive sensing via reweighted TV and nonlocal sparsity regularisation , 2013 .

[12]  L. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[13]  Yuan Xie,et al.  Single image super-resolution using combined total variation regularization by split Bregman Iteration , 2014, Neurocomputing.

[14]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[15]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[16]  Lei Zhang,et al.  Image reconstruction with locally adaptive sparsity and nonlocal robust regularization , 2012, Signal Process. Image Commun..

[17]  James E. Fowler,et al.  Block compressed sensing of images using directional transforms , 2009, ICIP.

[18]  Samuel Cheng,et al.  Compressive video sampling , 2008, 2008 16th European Signal Processing Conference.

[19]  J. CandesE.,et al.  Near-Optimal Signal Recovery From Random Projections , 2006 .

[20]  Jintao Li,et al.  Image reconstruction algorithm from compressed sensing measurements by dictionary learning , 2015, Neurocomputing.

[21]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[22]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[23]  Liangpei Zhang,et al.  Hyperspectral Image Classification by Nonlocal Joint Collaborative Representation With a Locally Adaptive Dictionary , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jian Zhang,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014, Signal Process..

[25]  Gerlind Plonka-Hoch,et al.  Compressive Video Sampling With Approximate Message Passing Decoding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[27]  Richard G. Baraniuk,et al.  An Architecture for Compressive Imaging , 2006, 2006 International Conference on Image Processing.

[28]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[29]  Nasser Eslahi,et al.  Recovery of compressive video sensing via dictionary learning and forward prediction , 2014, 7'th International Symposium on Telecommunications (IST'2014).

[30]  Eddie L. Jacobs,et al.  Video compressive sensing using spatial domain sparsity , 2009 .

[31]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[32]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[33]  Tiexiang Wen,et al.  A novel Bayesian-based nonlocal reconstruction method for freehand 3D ultrasound imaging , 2015, Neurocomputing.

[34]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[35]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[36]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[37]  Konstantinos N. Plataniotis,et al.  High-Accuracy Total Variation With Application to Compressed Video Sensing , 2013, IEEE Transactions on Image Processing.

[38]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[39]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[40]  Michael Elad,et al.  Improving Dictionary Learning: Multiple Dictionary Updates and Coefficient Reuse , 2013, IEEE Signal Processing Letters.

[41]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[42]  Richard G. Baraniuk,et al.  Compressive imaging for video representation and coding , 2006 .

[43]  Bin Song,et al.  Dictionary learning based reconstruction for distributed compressed video sensing , 2013, J. Vis. Commun. Image Represent..

[44]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[45]  Jin Liu,et al.  A self-learning image super-resolution method via sparse representation and non-local similarity , 2016, Neurocomputing.

[46]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[49]  Michael B. Wakin,et al.  A multiscale framework for Compressive Sensing of video , 2009, 2009 Picture Coding Symposium.

[50]  Feng Jiang,et al.  Hierarchical frame based spatial-temporal recovery for video compressive sensing coding , 2016, Neurocomputing.

[51]  Lei Zhang,et al.  A learning-based method for compressive image recovery , 2013, J. Vis. Commun. Image Represent..

[52]  Xavier Bresson,et al.  Nonlocal Mumford-Shah Regularizers for Color Image Restoration , 2011, IEEE Transactions on Image Processing.

[53]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[54]  Michael Elad,et al.  Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling , 2014, IEEE Transactions on Image Processing.

[55]  Ming Li,et al.  Motion-Aware Decoding of Compressed-Sensed Video , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Chun-Shien Lu,et al.  Dictionary learning-based distributed compressive video sensing , 2010, 28th Picture Coding Symposium.

[57]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[58]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[59]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[60]  Guillermo Sapiro,et al.  Video Compressive Sensing Using Gaussian Mixture Models , 2014, IEEE Transactions on Image Processing.

[61]  J. CandesE.,et al.  Robust uncertainty principles , 2006 .

[62]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.

[63]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[64]  Xinbo Gao,et al.  Photo-sketch synthesis and recognition based on subspace learning , 2010, Neurocomputing.

[65]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[66]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[67]  Samuel Cheng,et al.  Compressive Sampling of Binary Images , 2008, 2008 Congress on Image and Signal Processing.

[68]  Jian Yang,et al.  Mixed Noise Removal by Weighted Encoding With Sparse Nonlocal Regularization , 2014, IEEE Transactions on Image Processing.

[69]  Dacheng Tao,et al.  Multi-Task Pose-Invariant Face Recognition , 2015, IEEE Transactions on Image Processing.

[70]  Xin Li,et al.  Image Recovery Via Hybrid Sparse Representations: A Deterministic Annealing Approach , 2011, IEEE Journal of Selected Topics in Signal Processing.

[71]  Jun Yu,et al.  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding , 2014, IEEE Transactions on Image Processing.

[72]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[73]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[74]  Xinbo Gao,et al.  Image super-resolution using non-local Gaussian process regression , 2016, Neurocomputing.

[75]  Stefano Tubaro,et al.  Joint Compressive Video Coding and Analysis , 2010, IEEE Transactions on Multimedia.

[76]  Thomas S. Huang,et al.  Distributed Video Coding using Compressive Sampling , 2009, 2009 Picture Coding Symposium.

[77]  Meng Wang,et al.  Image clustering based on sparse patch alignment framework , 2014, Pattern Recognit..

[78]  Jian Zhang,et al.  Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[79]  Guangming Shi,et al.  Model-Assisted Adaptive Recovery of Compressed Sensing with Imaging Applications , 2012, IEEE Transactions on Image Processing.