Structure preserving image denoising based on low-rank reconstruction and gradient histograms

Abstract One of the main challenges of denoising approaches is preserving images details, like textures and edges, while suppressing noise. The preservation of such details is essential to ensure good quality, especially in high-resolution images. This paper presents a novel denoising method that combines a low-rank regularization of similar non-local patches with a texture preserving prior based on the histogram of gradients. A dynamic thresholding operator, deriving from the weighted nuclear norm, is also used to reconstruct groups of similar patches more accurately, by applying less shrinkage to the larger singular values. Moreover, an efficient iterative approach based on the ADMM algorithm is proposed to compute the denoised image, under low-rank and histogram preservation constraints. Experiments on two benchmark datasets of high-resolution images show that the proposed method to outperform state-of-the-art approaches, for all noise levels.

[1]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[2]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[4]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[6]  R. Lotufo,et al.  Morphological Image Processing , 2008 .

[7]  Richard Szeliski,et al.  Image Restoration by Matching Gradient Distributions , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Peyman Milanfar,et al.  Clustering-Based Denoising With Locally Learned Dictionaries , 2009, IEEE Transactions on Image Processing.

[9]  Yi Liu,et al.  Salt and pepper noise removal in surveillance video based on low-rank matrix recovery , 2015, Computational Visual Media.

[10]  Christian Desrosiers,et al.  A sparse coding method for semi-supervised segmentation with multi-class histogram constraints , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[11]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[12]  Zhixun Su,et al.  Fixed-rank representation for unsupervised visual learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Licheng Jiao,et al.  Comparing Noisy Patches for Image Denoising: A Double Noise Similarity Model , 2015, IEEE Transactions on Image Processing.

[14]  Necdet Serhat Aybat,et al.  An alternating direction method with increasing penalty for stable principal component pursuit , 2013, Computational Optimization and Applications.

[15]  B. Datta Numerical Linear Algebra and Applications , 1995 .

[16]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[17]  Caiming Zhang,et al.  Atlas-based reconstruction of high performance brain MR data , 2018, Pattern Recognit..

[18]  Yann Gousseau,et al.  Wasserstein Loss for Image Synthesis and Restoration , 2016, SIAM J. Imaging Sci..

[19]  Jean-François Aujol,et al.  Texture Reconstruction Guided by a High-Resolution Patch , 2017, IEEE Transactions on Image Processing.

[20]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[21]  Anders P. Eriksson,et al.  Efficient Computation of Robust Weighted Low-Rank Matrix Approximations Using the L_1 Norm , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Stanley Osher,et al.  A Low Patch-Rank Interpretation of Texture , 2013, SIAM J. Imaging Sci..

[23]  Mingrui Liu,et al.  ADMM without a Fixed Penalty Parameter: Faster Convergence with New Adaptive Penalization , 2017, NIPS.

[24]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[25]  Raymond H. Chan,et al.  Journal of Mathematical Imaging and Vision 2012 1 Exact Histogram Specification for Digital Images Using a Variational Approach , 2022 .

[26]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[27]  Yücel Altunbasak,et al.  A Histogram Modification Framework and Its Application for Image Contrast Enhancement , 2009, IEEE Transactions on Image Processing.

[28]  David Zhang,et al.  Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising , 2014, IEEE Transactions on Image Processing.

[29]  Wenhan Yang,et al.  Isophote-Constrained Autoregressive Model With Adaptive Window Extension for Image Interpolation , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[32]  Yan Liang,et al.  Nonlocal Spectral Prior Model for Low-Level Vision , 2012, ACCV.

[33]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[34]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[35]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[36]  Damek Davis,et al.  Convergence Rate Analysis of Several Splitting Schemes , 2014, 1406.4834.

[37]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Caiming Zhang,et al.  Effective document image deblurring via gradient histogram preservation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[39]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[40]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[41]  Ronan Fablet,et al.  Missing data super-resolution using non-local and statistical priors , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[42]  Lihe Zhang,et al.  Low-rank decomposition and Laplacian group sparse coding for image classification , 2014, Neurocomputing.

[43]  Caiming Zhang,et al.  Effective compressive sensing via reweighted total variation and weighted nuclear norm regularization , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  Wenhan Yang,et al.  Image Super-Resolution Based on Structure-Modulated Sparse Representation , 2015, IEEE Transactions on Image Processing.

[45]  Christian Desrosiers,et al.  Image denoising based on sparse representation and gradient histogram , 2017, IET Image Process..

[46]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  Wen Gao,et al.  Low-Rank Decomposition-Based Restoration of Compressed Images via Adaptive Noise Estimation , 2016, IEEE Transactions on Image Processing.

[49]  Yi Ma,et al.  TILT: Transform Invariant Low-Rank Textures , 2010, ACCV 2010.

[50]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[51]  Euhanna Ghadimi,et al.  Optimal Parameter Selection for the Alternating Direction Method of Multipliers (ADMM): Quadratic Problems , 2013, IEEE Transactions on Automatic Control.

[52]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[53]  Carlo Fischione,et al.  On the Convergence of Alternating Direction Lagrangian Methods for Nonconvex Structured Optimization Problems , 2014, IEEE Transactions on Control of Network Systems.

[54]  Dinesh Manocha,et al.  Fast GPU-based locality sensitive hashing for k-nearest neighbor computation , 2011, GIS.

[55]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[56]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..