Enhanced residual noise estimation of low rank approximation for image denoising

Abstract Recently, the application of rank minimization to image denoising has shown remarkable denoising results. However, due to iterative nature of low rank optimization, the estimation of noise for next iteration is an essential requirement after each iteration. In the existing approaches, the noise is estimated at the level of patches using l2 norm based comparison of the observed image and its denoised version. Because of l2 norm comparison, these patch-wise noise estimates may be affected in the presence of moderate and severe levels of noise. Also, the patch-wise noise estimates are inferred without considering the geometric details of a given image. Moreover, the number of iterations is pre-specified, heuristically, depending on the known initial noise in the image which limits the applicability of the existing algorithms for practical situation where the noise level is not a priori. In this paper, we attempt to address these limitations by introducing the notion of residual noise for iterative rank minimization. The estimation of residual noise also involves image geometry and statistical characteristics along with patch-wise comparison. In addition to more reliable noise estimation, the residual noise can also be employed as an effective stopping criterion for iterative denoising process. Furthermore, the residual noise estimation is a key factor for computation of thresholding weights, which in turn, yield a more reliable truncated singular value decomposition (SVD) for iterative rank minimization algorithms. Based on more precise truncated SVD, we propose to preserve geometric features like edges and texture in the presence of severe noise. Experimental results show that the proposed method provides better or equivalent results as compared to various state-of-the-art denoising algorithms.

[1]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[2]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[3]  Thomas Brox,et al.  Nonlinear structure tensors , 2006, Image Vis. Comput..

[4]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[5]  Yan Cui,et al.  Mixed noise removal by weighted low rank model , 2015, Neurocomputing.

[6]  Dinggang Shen,et al.  Denoising magnetic resonance images using collaborative non-local means , 2016, Neurocomputing.

[7]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[8]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[9]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Pheng-Ann Heng,et al.  Adaptive total variation denoising based on difference curvature , 2010, Image Vis. Comput..

[11]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[13]  Wenyuan Xu,et al.  Behavioral analysis of anisotropic diffusion in image processing , 1996, IEEE Trans. Image Process..

[14]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Shih-Ming Yang,et al.  A fast method for image noise estimation using Laplacian operator and adaptive edge detection , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[16]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[17]  Thomas Brox,et al.  On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diffusion, Total Variation Regularization, and SIDEs , 2004, SIAM J. Numer. Anal..

[18]  Zhongliang Jing,et al.  Robust image restoration via random projection and partial sorted ℓp norm , 2017, Neurocomputing.

[19]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[22]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[23]  Nikolay N. Ponomarenko,et al.  An automatic approach to lossy compression of AVIRIS images , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Yehoshua Y. Zeevi,et al.  Image enhancement and denoising by complex diffusion processes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kannan Ramchandran,et al.  Low-complexity image denoising based on statistical modeling of wavelet coefficients , 1999, IEEE Signal Processing Letters.

[27]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Mohamed Cheriet,et al.  Non-local adaptive structure tensors: Application to anisotropic diffusion and shock filtering , 2011, Image Vis. Comput..

[29]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[30]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[31]  Joseph Salmon,et al.  On Two Parameters for Denoising With Non-Local Means , 2010, IEEE Signal Processing Letters.

[32]  Ke Chen,et al.  Adaptive smoothing via contextual and local discontinuities , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[34]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[35]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[36]  A. Foi,et al.  Noise variance estimation in nonlocal transform domain , 2009, 2009 International Workshop on Local and Non-Local Approximation in Image Processing.

[37]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Qingshan Liu,et al.  Blessing of Dimensionality: Recovering Mixture Data via Dictionary Pursuit , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Aishy Amer,et al.  Fast and reliable structure-oriented video noise estimation , 2005 .

[40]  Qingshan Liu,et al.  A Deterministic Analysis for LRR , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Fang Hao,et al.  Medical image denoising by parallel non-local means , 2016, Neurocomputing.

[42]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[43]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[44]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.

[45]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[47]  Dai-Gyoung Kim,et al.  Multiscale Hybrid Non-local Means Filtering Using Modified Similarity Measure , 2013, ArXiv.

[48]  Seungjoon Yang,et al.  Block-based noise estimation using adaptive Gaussian filtering , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[49]  Arvid Lundervold,et al.  Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time , 2003, IEEE Trans. Image Process..

[50]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[51]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .