An adaptive boosting procedure for low-rank based image denoising

Abstract Low-rank methods have shown great potential in many low-level vision tasks, especially in image denoising. Nevertheless, state-of-the-art algorithms still have limitations in some aspects, such as a heavy reliance on empirical values when setting the denoising parameters and the lack of consideration of the noise effect on the selection of similar patches. To address these problems, an adaptive boosting technique for improving the low-rank based image denoising results is proposed. In particular, different from adding the residual back to the image, we consider strengthening the signal by leveraging the availability of the previous denoised image and combine this boosting technique with dynamic parameters applied to the weighted nuclear norm minimization (WNNM) method, whose feasibility is derived and proved theoretically. In each iteration of the boosting scheme, the dynamic boosting parameters are motivated by an optimal solution analysis. In addition, in the process of image denoising, an adaptive patch search scheme is put forward to gain an effective index of similar patches. Furthermore, to adaptively determine the optimal number of iterations, a stopping criterion with the correlation coefficient is applied. The experimental results demonstrate that the proposed approach can preserve more detail information while removing noise and can outperform various state-of-the-art denoising algorithms in terms of both PSNR and SSIM.

[1]  Daniel T. Larose,et al.  k‐Nearest Neighbor Algorithm , 2005 .

[2]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[3]  Zhixun Su,et al.  Fixed-rank representation for unsupervised visual learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Anders P. Eriksson,et al.  Efficient Computation of Robust Weighted Low-Rank Matrix Approximations Using the L_1 Norm , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Hong Sun,et al.  Image Denoising via Nonlocal Low Rank Approximation With Local Structure Preserving , 2019, IEEE Access.

[6]  Chen Yang,et al.  A New Weight for Nonlocal Means Denoising Using Method Noise , 2012, IEEE Signal Processing Letters.

[7]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[8]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[10]  Michael Elad,et al.  Improving K-SVD denoising by post-processing its method-noise , 2013, 2013 IEEE International Conference on Image Processing.

[11]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[12]  Zhiwei Xiong,et al.  Deep Boosting for Image Denoising , 2018, ECCV.

[13]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[14]  Bo Wang,et al.  Adaptive boosting for image denoising: Beyond low-rank representation and sparse coding , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[15]  Yu Liu,et al.  Image Denoising Using Quadtree-Based Nonlocal Means With Locally Adaptive Principal Component Analysis , 2016, IEEE Signal Processing Letters.

[16]  Caiming Zhang,et al.  Adaptive Texture-Preserving Denoising Method Using Gradient Histogram and Nonlocal Self-Similarity Priors , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[18]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[19]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2016, International Journal of Computer Vision.

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[23]  Xiao-Yuan Jing,et al.  Image denoising using weighted nuclear norm minimization with multiple strategies , 2017, Signal Process..

[24]  Raj Rao Nadakuditi,et al.  OptShrink: An Algorithm for Improved Low-Rank Signal Matrix Denoising by Optimal, Data-Driven Singular Value Shrinkage , 2013, IEEE Transactions on Information Theory.

[25]  Caiming Zhang,et al.  Image denoising by low-rank approximation with estimation of noise energy distribution in SVD domain , 2019, IET Image Process..

[26]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Andrew B. Nobel,et al.  Reconstruction of a low-rank matrix in the presence of Gaussian noise , 2010, J. Multivar. Anal..

[28]  Peyman Milanfar,et al.  Patch-Based Near-Optimal Image Denoising , 2012, IEEE Transactions on Image Processing.

[29]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[30]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[31]  Zhou Wang,et al.  The Use of Residuals in Image Denoising , 2009, ICIAR.

[32]  Christian Desrosiers,et al.  Structure preserving image denoising based on low-rank reconstruction and gradient histograms , 2018, Comput. Vis. Image Underst..

[33]  P. Bühlmann,et al.  Boosting With the L2 Loss , 2003 .

[34]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[35]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[36]  Michael Elad,et al.  Boosting of Image Denoising Algorithms , 2015, SIAM J. Imaging Sci..

[37]  Lan Tang,et al.  Image denoising via group sparsity residual constraint , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[38]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[39]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[40]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[41]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[42]  Xiang Zhu,et al.  How to SAIF-ly Boost Denoising Performance , 2013, IEEE Transactions on Image Processing.