Image Denoising by Gaussian Patch Mixture Model and Low Rank Patches

Non-local self-similarity based low rank algorithms are the state-of-the-art methods for image denoising. In this paper, a new method is proposed by solving two issues: how to improve similar patches matching accuracy and build an appropriate low rank matrix approximation model for Gaussian noise. For the first issue, similar patches can be found locally or globally. Local patch matching is to find similar patches in a large neighborhood which can alleviate noise effect, but the number of patches may be insufficient. Global patch matching is to determine enough similar patches but the error rate of patch matching may be higher. Based on this, we first use local patch matching method to reduce noise and then use Gaussian patch mixture model to achieve global patch matching. The second issue is that there is no low rank matrix approximation model to adapt to Gaussian noise. We build a new model according to the characteristics of Gaussian noise, then prove that there is a globally optimal solution of the model. By solving the two issues, experimental results are reported to show that the proposed approach outperforms the state-of-the-art denoising methods includes several deep learning ones in both PSNR / SSIM values and visual quality.

[1]  Wen-Huang Cheng,et al.  LR3M: Robust Low-Light Enhancement via Low-Rank Regularized Retinex Model , 2020, IEEE Transactions on Image Processing.

[2]  Raymond H. Chan,et al.  A Detection Statistic for Random-Valued Impulse Noise , 2007, IEEE Transactions on Image Processing.

[3]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[4]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[5]  Jiayu Dong,et al.  Low-Rank Laplacian-Uniform Mixed Model for Robust Face Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[9]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Soon Ki Jung,et al.  Spatiotemporal Low-Rank Modeling for Complex Scene Background Initialization , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[13]  Siyuan Cao,et al.  Seismic data denoising for complex structure using BM3D and local similarity , 2019 .

[14]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[15]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Peyman Milanfar,et al.  Learning denoising bounds for noisy images , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Liang Xiao,et al.  Structure-Based Low-Rank Model With Graph Nuclear Norm Regularization for Noise Removal , 2017, IEEE Transactions on Image Processing.

[18]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[19]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[20]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[21]  Ming Yang,et al.  Image Blind Denoising with Generative Adversarial Network Based Noise Modeling , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Steven L. Brunton,et al.  Compressed dynamic mode decomposition for background modeling , 2015, Journal of Real-Time Image Processing.

[25]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[26]  Raymond H. Chan,et al.  Minimization of a Detail-Preserving Regularization Functional for Impulse Noise Removal , 2007, Journal of Mathematical Imaging and Vision.

[27]  Yi Shen,et al.  Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising , 2017, Signal Process..

[28]  Jinye Peng,et al.  Kernel Wiener filtering model with low-rank approximation for image denoising , 2018, Inf. Sci..

[29]  A. Baudes,et al.  A Nonlocal Algorithm for Image Denoising , 2005, CVPR 2005.

[30]  Charles Kervrann,et al.  Nonlocal Means and Optimal Weights for Noise Removal , 2017, SIAM J. Imaging Sci..

[31]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Zhengyuan Zhou,et al.  Robust Low-Rank Tensor Recovery with Rectification and Alignment , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Jian Yang,et al.  Learning robust and discriminative low-rank representations for face recognition with occlusion , 2017, Pattern Recognit..

[35]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Raymond H. Chan,et al.  An Efficient Two-Phase ${\rm L}^{1}$-TV Method for Restoring Blurred Images with Impulse Noise , 2010, IEEE Transactions on Image Processing.

[37]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[38]  Qiyu Jin,et al.  Convergence Theorems for the Non-Local Means Filter , 2012, 1211.6143.

[39]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..