Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights

Image denoising is an important problem in image processing since noise may interfere with visual or automatic interpretation. This paper presents a new approach for image denoising in the case of a known uncorrelated noise model. The proposed filter is an extension of the nonlocal means (NL means) algorithm introduced by Buades, which performs a weighted average of the values of similar pixels. Pixel similarity is defined in NL means as the Euclidean distance between patches (rectangular windows centered on each two pixels). In this paper, a more general and statistically grounded similarity criterion is proposed which depends on the noise distribution model. The denoising process is expressed as a weighted maximum likelihood estimation problem where the weights are derived in a data-driven way. These weights can be iteratively refined based on both the similarity between noisy patches and the similarity of patches extracted from the previous estimate. We show that this iterative process noticeably improves the denoising performance, especially in the case of low signal-to-noise ratio images such as synthetic aperture radar (SAR) images. Numerical experiments illustrate that the technique can be successfully applied to the classical case of additive Gaussian noise but also to cases such as multiplicative speckle noise. The proposed denoising technique seems to improve on the state of the art performance in that latter case.

[1]  Jérôme Darbon,et al.  Fast nonlocal filtering applied to electron cryomicroscopy , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[3]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[4]  Marc Sigelle,et al.  Fast SAR image restoration, segmentation, and detection of high-reflectance regions , 2003, IEEE Trans. Geosci. Remote. Sens..

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[7]  Jaakko Astola,et al.  Directional varying scale approximations for anisotropic signal processing , 2004, 2004 12th European Signal Processing Conference.

[8]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[9]  Yehoshua Y. Zeevi,et al.  Estimation of optimal PDE-based denoising in the SNR sense , 2006, IEEE Transactions on Image Processing.

[10]  Kostadin Dabov,et al.  BM3D Image Denoising with Shape-Adaptive Principal Component Analysis , 2009 .

[11]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[12]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  Suyash P. Awate,et al.  Higher-order image statistics for unsupervised, information-theoretic, adaptive, image filtering , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[16]  Kostadin Dabov,et al.  A NONLOCAL AND SHAPE-ADAPTIVE TRANSFORM-DOMAIN COLLABORATIVE FILTERING , 2008 .

[17]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Nikos Paragios,et al.  Spatio-temporal speckle reduction in ultrasound sequences. , 2008, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[19]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[20]  Stephen Lin,et al.  A Probabilistic Intensity Similarity Measure based on Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[23]  M. Omair Ahmad,et al.  Spatially Adaptive Wavelet-Based Method Using the Cauchy Prior for Denoising the SAR Images , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Nuno Vasconcelos,et al.  A Kullback-Leibler Divergence Based Kernel for SVM Classification in Multimedia Applications , 2003, NIPS.

[25]  Fabrizio Argenti,et al.  Segmentation-Based MAP Despeckling of SAR Images in the Undecimated Wavelet Domain , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[27]  A. Lopes,et al.  On the true multilook intensity distribution in SAR imagery , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[28]  J. Polzehl,et al.  Propagation-Separation Approach for Local Likelihood Estimation , 2006 .

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[31]  Ian R. Greenshields,et al.  A Nonlocal Maximum Likelihood Estimation Method for Rician Noise Reduction in MR Images , 2009, IEEE Transactions on Medical Imaging.

[32]  Aleksandra Pizurica,et al.  An improved non-local denoising algorithm , 2008 .

[33]  Pierrick Coupé,et al.  Fast Non Local Means Denoising for 3D MR Images , 2006, MICCAI.

[34]  Fabrizio Argenti,et al.  Multiresolution MAP Despeckling of SAR Images Based on Locally Adaptive Generalized Gaussian pdf Modeling , 2006, IEEE Transactions on Image Processing.

[35]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[36]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[37]  Pierrick Coupé,et al.  Bayesian non local means-based speckle filtering , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[38]  Jianqing Fan,et al.  Local maximum likelihood estimation and inference , 1998 .

[39]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[40]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[41]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[42]  Fawwaz T. Ulaby,et al.  SAR speckle reduction using wavelet denoising and Markov random field modeling , 2002, IEEE Trans. Geosci. Remote. Sens..

[43]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[44]  J. Goodman Some fundamental properties of speckle , 1976 .

[45]  Charles Kervrann,et al.  Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularization and Representation , 2008, International Journal of Computer Vision.

[46]  William A. Pearlman,et al.  Speckle filtering of SAR images based on adaptive windowing , 1999 .

[47]  Jérôme Darbon,et al.  SAR Image Regularization With Fast Approximate Discrete Minimization , 2009, IEEE Transactions on Image Processing.

[48]  Alin Achim,et al.  SAR image denoising via Bayesian wavelet shrinkage based on heavy-tailed modeling , 2003, IEEE Trans. Geosci. Remote. Sens..

[49]  Nikos Paragios,et al.  Uniform and Textured Regions Separation in Natural Images Towards MPM Adaptive Denoising , 2007, SSVM.

[50]  T. Chan,et al.  Edge-preserving and scale-dependent properties of total variation regularization , 2003 .

[51]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..

[52]  Gabriel Vasile,et al.  Intensity-driven adaptive-neighborhood technique for polarimetric and interferometric SAR parameters estimation , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[54]  Fabrizio Argenti,et al.  Speckle removal from SAR images in the undecimated wavelet domain , 2002, IEEE Trans. Geosci. Remote. Sens..