Group sparsity residual constraint for image denoising with external nonlocal self-similarity prior

Abstract Nonlocal image representation has been successfully used in many image-related inverse problems including denoising, deblurring and deblocking. However, most existing methods only consider the nonlocal self-similarity (NSS) prior of degraded observation image, and few methods use the NSS prior from natural images. In this paper we propose a novel method for image denoising via group sparsity residual constraint with external NSS prior (GSRC-ENSS). Different from the previous NSS prior-based denoising methods, two kinds of NSS prior (e.g., NSS priors of noisy image and natural images) are used for image denoising. In particular, to enhance the performance of image denoising, the group sparsity residual is proposed, and thus the problem of image denoising is translated into reducing the group sparsity residual. Because the groups contain a large amount of NSS information of natural images, to reduce the group sparsity residual, we obtain a good estimation of the group sparse coefficients of the original image by the external NSS prior based on Gaussian Mixture Model (GMM) learning, and the group sparse coefficients of noisy image are used to approximate the estimation. To combine these two NSS priors better, an effective iterative shrinkage algorithm is developed to solve the proposed GSRC-ENSS model. Experimental results demonstrate that the proposed GSRC-ENSS not only outperforms several state-of-the-art methods, but also delivers the best qualitative denoising results with finer details and less ringing artifacts.

[1]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[2]  Tony Jacob,et al.  Single Image Super-Resolution Using a Joint GMM Method , 2016, IEEE Transactions on Image Processing.

[3]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[4]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dacheng Tao,et al.  Single Image Superresolution via Directional Group Sparsity and Directional Features , 2015, IEEE Transactions on Image Processing.

[6]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Ming-Hsuan Yang,et al.  Learning Recursive Filters for Low-Level Vision via a Hybrid Neural Network , 2016, ECCV.

[8]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Michal Irani,et al.  Combining the power of Internal and External denoising , 2013, IEEE International Conference on Computational Photography (ICCP).

[11]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[12]  Jian Zhang,et al.  Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Peng Ren,et al.  An adaptive bilateral filter based framework for image denoising , 2014, Neurocomputing.

[14]  Shu-Tao Xia,et al.  PMPA: A patch-based multiscale products algorithm for image denoising , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[17]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[18]  David Zhang,et al.  Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising , 2014, IEEE Transactions on Image Processing.

[19]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[20]  Guangming Shi,et al.  Image Restoration via Simultaneous Sparse Coding: Where Structured Sparsity Meets Gaussian Scale Mixture , 2015, International Journal of Computer Vision.

[21]  Yoram Bresler,et al.  FRIST—flipping and rotation invariant sparsifying transform learning and applications , 2015, ArXiv.

[22]  Massoud Babaie-Zadeh,et al.  Image Restoration Using Gaussian Mixture Models With Spatially Constrained Patch Clustering , 2015, IEEE Transactions on Image Processing.

[23]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[24]  Xinggan Zhang,et al.  Analyzing the group sparsity based on the rank minimization methods , 2016, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[26]  Daniel Pak-Kong Lun,et al.  Robust Fringe Projection Profilometry via Sparse Representation , 2016, IEEE Transactions on Image Processing.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[29]  Xiaoyan Sun,et al.  Image Denoising by Exploring External and Internal Correlations , 2015, IEEE Transactions on Image Processing.

[30]  Michel Verleysen,et al.  A principled approach to image denoising with similarity kernels involving patches , 2010, Neurocomputing.

[31]  Lan Tang,et al.  Compressed sensing image reconstruction via adaptive sparse nonlocal regularization , 2016, The Visual Computer.

[32]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[33]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[34]  Gabriel Peyré,et al.  Image Processing with Nonlocal Spectral Bases , 2008, Multiscale Model. Simul..

[35]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[36]  Shu-Tao Xia,et al.  Entropy-based bilateral filtering with a new range kernel , 2017, Signal Process..

[37]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[38]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  H. Engl,et al.  Convergence rates for Tikhonov regularisation of non-linear ill-posed problems , 1989 .

[40]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[42]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[43]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[44]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[45]  Stefan Harmeling,et al.  Learning How to Combine Internal and External Denoising Methods , 2013, GCPR.

[46]  Dapeng Tao,et al.  Discriminative dictionary learning via Fisher discrimination K-SVD algorithm , 2015, Neurocomputing.

[47]  Lu Li,et al.  Smooth incomplete matrix factorization and its applications in image/video denoising , 2013, Neurocomputing.

[48]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[49]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[50]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[51]  James Zijun Wang,et al.  Image-Specific Prior Adaptation for Denoising , 2015, IEEE Transactions on Image Processing.

[52]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[53]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[54]  Xinggan Zhang,et al.  Nonconvex Weighted $\ell _p$ Minimization Based Group Sparse Representation Framework for Image Denoising , 2017, IEEE Signal Processing Letters.

[55]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Yoram Bresler,et al.  Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications , 2015, International Journal of Computer Vision.

[57]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[58]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[59]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Hagen Spies,et al.  Fast Prototype Based Noise Reduction , 2009, SCIA.

[61]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[63]  Lan Tang,et al.  Image denoising via group sparsity residual constraint , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[64]  Truong Q. Nguyen,et al.  Adaptive Image Denoising by Mixture Adaptation , 2016, IEEE Transactions on Image Processing.

[65]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.