Weighted Tensor Rank-1 Decomposition for Nonlocal Image Denoising

Natural images often contain patches with high similarity. In this paper, to effectively utilize the local and nonlocal self-similarity for low-rank models, we propose a novel weighted tensor rank-1 decomposition method (termed as WTR1) for nonlocal image denoising. Although the low-rank approximation problem has been well studied for matrices, it remains elusive of the theoretical extension to tensors due to the NP-hard tensor decomposition. To tackle this problem, the proposed WTR1 method designs a new efficient CANDECOMP/ PARAFAC (CP) decomposition algorithm and constructs a straightforward low-rank tensor approximation strategy. This is achieved by elegantly manipulating the CP-rank, called intrinsic low-rank tensor approximation. Specifically, the WTR1 method first groups similar patches into a 3D stack and converts the stack into a finite sum of rank-1 products. Then, we deploy the intrinsic low-rank tensor approximation to produce the final denoised image. The proposed WTR1 method can jointly exploit the local and nonlocal self-similarity, thus improving the nonlocal image denoising quality. Experimental results have shown that the proposed WTR1 outperforms several state-of-the-art denoising methods.

[1]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[2]  Dacheng Tao,et al.  Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration , 2016, IEEE Transactions on Image Processing.

[3]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[4]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Shutao Li,et al.  Segmentation Based Sparse Reconstruction of Optical Coherence Tomography Images , 2017, IEEE Transactions on Medical Imaging.

[6]  Adrian Barbu,et al.  RENOIR - A dataset for real low-light image noise reduction , 2014, J. Vis. Commun. Image Represent..

[7]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[10]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[11]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[12]  L. Shao,et al.  From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms , 2014, IEEE Transactions on Cybernetics.

[13]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[14]  Andrew W. Fitzgibbon,et al.  Damped Newton algorithms for matrix factorization with missing data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Matthias Zwicker,et al.  Progressive Image Denoising , 2014, IEEE Transactions on Image Processing.

[16]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[17]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[18]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[19]  Glenn R. Easley,et al.  Shearlet-Based Total Variation Diffusion for Denoising , 2009, IEEE Transactions on Image Processing.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[22]  Jing-Yu Yang,et al.  Estimation of Signal-Dependent Noise Level Function in Transform Domain via a Sparse Recovery Model , 2015, IEEE Transactions on Image Processing.

[23]  Qi Xie,et al.  A Novel Sparsity Measure for Tensor Recovery , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Tommi S. Jaakkola,et al.  Weighted Low-Rank Approximations , 2003, ICML.

[25]  Anders P. Eriksson,et al.  Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L1 norm , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[27]  Gene Cheung,et al.  Graph Laplacian Regularization for Image Denoising: Analysis in the Continuous Domain , 2016, IEEE Transactions on Image Processing.

[28]  Stefan Roth,et al.  Shrinkage Fields for Effective Image Restoration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[30]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[32]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Mansoor Rezghi A Novel Fast Tensor-Based Preconditioner for Image Restoration , 2017, IEEE Transactions on Image Processing.

[34]  Michael Elad,et al.  Image Sequence Denoising via Sparse and Redundant Representations , 2009, IEEE Transactions on Image Processing.

[35]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[36]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[37]  Bo Du,et al.  PLTD: Patch-Based Low-Rank Tensor Decomposition for Hyperspectral Images , 2017, IEEE Transactions on Multimedia.

[38]  Stephen P. Boyd,et al.  A rank minimization heuristic with application to minimum order system approximation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[39]  Wei Yu,et al.  On learning optimized reaction diffusion processes for effective image restoration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[41]  Wen Gao,et al.  Image denoising via adaptive soft-thresholding based on non-local samples , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).