Compressed sensing image reconstruction via adaptive sparse nonlocal regularization

Compressed sensing (CS) has been successfully utilized by many computer vision applications. However,the task of signal reconstruction is still challenging, especially when we only have the CS measurements of an image (CS image reconstruction). Compared with the task of traditional image restoration (e.g., image denosing, debluring and inpainting, etc.), CS image reconstruction has partly structure or local features. It is difficult to build a dictionary for CS image reconstruction from itself. Few studies have shown promising reconstruction performance since most of the existing methods employed a fixed set of bases (e.g., wavelets, DCT, and gradient spaces) as the dictionary, which lack the adaptivity to fit image local structures. In this paper, we propose an adaptive sparse nonlocal regularization (ASNR) approach for CS image reconstruction. In ASNR, an effective self-adaptive learning dictionary is used to greatly reduce artifacts and the loss of fine details. The dictionary is compact and learned from the reconstructed image itself rather than natural image dataset. Furthermore, the image sparse nonlocal (or nonlocal self-similarity) priors are integrated into the regularization term, thus ASNR can effectively enhance the quality of the CS image reconstruction. To improve the computational efficiency of the ASNR, the split Bregman iteration based technique is also developed, which can exhibit better convergence performance than iterative shrinkage/thresholding method. Extensive experimental results demonstrate that the proposed ASNR method can effectively reconstruct fine structures and suppress visual artifacts, outperforming state-of-the-art performance in terms of both the PSNR and visual measurements.

[1]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[2]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[3]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[4]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[5]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[6]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[8]  Gabriel Peyré,et al.  Image Processing with Nonlocal Spectral Bases , 2008, Multiscale Model. Simul..

[9]  E.J. Candes Compressive Sampling , 2022 .

[10]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[11]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[12]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[13]  Cláudio Rosito Jung,et al.  Block-based image inpainting in the wavelet domain , 2007, The Visual Computer.

[14]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[15]  Shanmuganathan Raman,et al.  Robust PCA-based solution to image composition using augmented Lagrange multiplier (ALM) , 2016, The Visual Computer.

[16]  Jian Zhang,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014, Signal Process..

[17]  Renjie Huang,et al.  Learning to pool high-level features for face representation , 2014, The Visual Computer.

[18]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[19]  James E. Fowler,et al.  Residual Reconstruction for Block-Based Compressed Sensing of Video , 2011, 2011 Data Compression Conference.

[20]  Karen O. Egiazarian,et al.  Compressed Sensing Image Reconstruction Via Recursive Spatially Adaptive Filtering , 2007, ICIP.

[21]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[22]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[23]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[24]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[25]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[27]  Xavier Bresson,et al.  Nonlocal Mumford-Shah Regularizers for Color Image Restoration , 2011, IEEE Transactions on Image Processing.

[28]  Caiming Zhang,et al.  Adaptive sparse coding on PCA dictionary for image denoising , 2015, The Visual Computer.

[29]  Hefeng Wu,et al.  Robust tracking via discriminative sparse feature selection , 2014, The Visual Computer.

[30]  Lei Zhang,et al.  Image reconstruction with locally adaptive sparsity and nonlocal robust regularization , 2012, Signal Process. Image Commun..

[31]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[32]  Michael Elad,et al.  A Plurality of Sparse Representations Is Better Than the Sparsest One Alone , 2009, IEEE Transactions on Information Theory.

[33]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[34]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[35]  A. Tikhonov,et al.  Use of the regularization method in non-linear problems , 1965 .

[36]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[37]  SapiroGuillermo,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2010 .

[38]  Byeungwoo Jeon,et al.  Multi-scale/multi-resolution Kronecker compressive imaging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[39]  Michael Elad,et al.  Closed-Form MMSE Estimation for Signal Denoising Under Sparse Representation Modeling Over a Unitary Dictionary , 2010, IEEE Transactions on Signal Processing.

[40]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[41]  Guillermo Sapiro,et al.  Compressive Sensing by Learning a Gaussian Mixture Model From Measurements , 2015, IEEE Transactions on Image Processing.

[42]  Shree K. Nayar,et al.  Video from a single coded exposure photograph using a learned over-complete dictionary , 2011, 2011 International Conference on Computer Vision.

[43]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[44]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[45]  GaoWen,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014 .

[46]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[47]  Xiangjun Zhang,et al.  Model-Guided Adaptive Recovery of Compressive Sensing , 2009, 2009 Data Compression Conference.

[48]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[49]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[50]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[51]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[52]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[53]  LiuQian,et al.  Adaptive sparse coding on PCA dictionary for image denoising , 2016 .

[54]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[55]  Lawrence Carin,et al.  Tree-Structured Compressive Sensing With Variational Bayesian Analysis , 2010, IEEE Signal Processing Letters.