RLGC: residual low rank group sparsity constraint for image denoising

Image denoising is an important topic in the field of image processing. With the application of nonlocal similarity in sparse representation, the work of image denoising began to be performed on similar patch groups. The sparse representations of patches in a group will be learned together. In this paper, we propose a novel image denoising model by combining group sparsity residual with low-rankness. Firstly, motivated by the relationship between low rank and sparsity, a low rank constraint is imposed on the sparse coefficient matrix of each similar patch group to enhance the sparsity. Secondly, since 𝛾-norm can most closely match the true rank of a matrix, it is applied for rank approximation in our model. Finally, in view of the fact that numerous iterations are required in the group sparse representation (GSR) model, we develop an efficient algorithm based on the Majorize-Minimization (MM) optimization. It greatly reduces the computational complexity and the number of iterations. Experimental results show that our model makes great improvements in image denoising and outperforms many state-of-the-art methods.

[1]  K. Lange The MM Algorithm , 2013 .

[2]  Tommi S. Jaakkola,et al.  Weighted Low-Rank Approximations , 2003, ICML.

[3]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[4]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[5]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[6]  Jiantao Zhou,et al.  A Benchmark for Sparse Coding: When Group Sparsity Meets Rank Minimization , 2020, IEEE Transactions on Image Processing.

[7]  Jian Dong,et al.  Accelerated low-rank visual recovery by random projection , 2011, CVPR 2011.

[8]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[9]  Zhao Kang,et al.  Robust PCA Via Nonconvex Rank Approximation , 2015, 2015 IEEE International Conference on Data Mining.

[10]  Xin Yuan,et al.  Image Restoration Using Joint Patch-Group-Based Sparse Representation , 2020, IEEE Transactions on Image Processing.

[11]  Anders P. Eriksson,et al.  Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L1 norm , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Guoxia Xu,et al.  TV2++: a novel spatial-temporal total variation for super resolution with exponential-type norm , 2020, EURASIP J. Wirel. Commun. Netw..

[13]  Huimin Lu,et al.  Dilated-aware discriminative correlation filter for visual tracking , 2018, World Wide Web.

[14]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Xinggan Zhang,et al.  Nonconvex Weighted $\ell _p$ Minimization Based Group Sparse Representation Framework for Image Denoising , 2017, IEEE Signal Processing Letters.

[16]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Andrew W. Fitzgibbon,et al.  Damped Newton algorithms for matrix factorization with missing data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[19]  Guoxia Xu,et al.  TNLRS: Target-Aware Non-Local Low-Rank Modeling With Saliency Filtering Regularization for Infrared Small Target Detection , 2020, IEEE Transactions on Image Processing.

[20]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[21]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[22]  Wen Gao,et al.  Image denoising via adaptive soft-thresholding based on non-local samples , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[24]  Xin Yuan,et al.  Reconciliation Of Group Sparsity And Low-Rank Models For Image Restoration , 2020, 2020 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Jiantao Zhou,et al.  Group Sparsity Residual Constraint With Non-Local Priors for Image Restoration , 2020, IEEE Transactions on Image Processing.

[29]  Stephen P. Boyd,et al.  A rank minimization heuristic with application to minimum order system approximation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[30]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[31]  Video smoke removal based on low‐rank tensor completion via spatial‐temporal continuity constraint , 2021, Concurr. Comput. Pract. Exp..

[32]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[33]  Lan Tang,et al.  Group Sparsity Residual with Non-Local Samples for Image Denoising , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[35]  Xinfeng Zhang,et al.  Retrieval Compensated Group Structured Sparsity for Image Super-Resolution , 2017, IEEE Transactions on Multimedia.

[36]  Seokho Lee,et al.  A coordinate descent MM algorithm for fast computation of sparse logistic PCA , 2013, Comput. Stat. Data Anal..

[37]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[38]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[39]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[40]  Hong Yan,et al.  Discriminative tracking via supervised tensor learning , 2018, Neurocomputing.