Real-Time Nonlocal Means-Based Despeckling

In this paper, we propose a multiscale nonlocal means-based despeckling method for medical ultrasound. The multiscale approach leads to large computational savings and improves despeckling results over single-scale iterative approaches. We present two variants of the method. The first, denoted multiscale nonlocal means (MNLM), yields uniform robust filtering of speckle both in structured and homogeneous regions. The second, denoted unnormalized MNLM (UMNLM), is more conservative in regions of structure assuring minimal disruption of salient image details. Due to the popularity of anisotropic diffusion-based methods in the despeckling literature, we review the connection between anisotropic diffusion and iterative variants of NLM. These iterative variants in turn relate to our multiscale variant. As part of our evaluation, we conduct a simulation study making use of ground truth phantoms generated from clinical B-mode ultrasound images. We evaluate our method against a set of popular methods from the despeckling literature on both fine and coarse speckle noise. In terms of computational efficiency, our method outperforms the other considered methods. Quantitatively on simulations and on a tissue-mimicking phantom, our method is found to be competitive with the state-of-the-art. On clinical B-mode images, our method is found to effectively smooth speckle while preserving low-contrast and highly localized salient image detail.

[1]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  T. Loupas,et al.  An adaptive weighted median filter for speckle suppression in medical ultrasonic images , 1989 .

[4]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[6]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[7]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[8]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[9]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[10]  Andrew F. Laine,et al.  Speckle reduction and contrast enhancement of echocardiograms via multiscale nonlinear processing , 1998, IEEE Transactions on Medical Imaging.

[11]  X. Hao,et al.  A novel multiscale nonlinear thresholding method for ultrasonic speckle suppressing. , 1999, IEEE transactions on medical imaging.

[12]  Alin Achim,et al.  Novel Bayesian multiscale method for speckle removal in medical ultrasound images , 2001, IEEE Transactions on Medical Imaging.

[13]  P. Shankar Ultrasonic tissue characterization using a generalized Nakagami model , 2001, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[15]  Yasser M. Kadah,et al.  Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion , 2002, IEEE Transactions on Biomedical Engineering.

[16]  Yvan G. Leclerc,et al.  Constructing simple stable descriptions for image partitioning , 1989, International Journal of Computer Vision.

[17]  Sant Longowal,et al.  Wavelet-based statistical approach for speckle reduction in medical ultrasound images , 2004 .

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[20]  Oleg V. Michailovich,et al.  A novel approach to the 2-D blind deconvolution problem in medical ultrasound , 2005, IEEE Transactions on Medical Imaging.

[21]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Carl-Fredrik Westin,et al.  Speckle-constrained filtering of ultrasound images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  John W. Clark,et al.  Nonlinear multiscale wavelet diffusion for speckle suppression and edge enhancement in ultrasound images , 2006, IEEE Transactions on Medical Imaging.

[24]  Santiago Aja-Fernández,et al.  On the estimation of the coefficient of variation for anisotropic diffusion speckle filtering , 2006, IEEE Transactions on Image Processing.

[25]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[26]  A. Tannenbaum,et al.  Despeckling of medical ultrasound images , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[27]  Hemant D. Tagare,et al.  Evaluation of Four Probability Distribution Models for Speckle in Clinical Cardiac Ultrasound Images , 2006, IEEE Transactions on Medical Imaging.

[28]  Fan Zhang,et al.  Nonlinear Diffusion in Laplacian Pyramid Domain for Ultrasonic Speckle Reduction , 2007, IEEE Transactions on Medical Imaging.

[29]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[30]  Carl-Fredrik Westin,et al.  Oriented Speckle Reducing Anisotropic Diffusion , 2007, IEEE Transactions on Image Processing.

[31]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[32]  Maneesh Agrawala,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, SIGGRAPH 2007.

[33]  Pierrick Coupé,et al.  Bayesian Non-local Means Filter, Image Redundancy and Adaptive Dictionaries for Noise Removal , 2007, SSVM.

[34]  M. Omair Ahmad,et al.  Wavelet-Based Despeckling of Medical Ultrasound Images with the Symmetric Normal Inverse Gaussian Prior , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[35]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[36]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[37]  Purang Abolmaesumi,et al.  Speckle Noise Reduction of Medical Ultrasound Images in Complex Wavelet Domain Using Mixture Priors , 2008, IEEE Transactions on Biomedical Engineering.

[38]  Aleksandra Pizurica,et al.  An improved non-local denoising algorithm , 2008 .

[39]  Xi Chen,et al.  A Robust and Fast Non-Local Means Algorithm for Image Denoising , 2008, Journal of Computer Science and Technology.

[40]  Mohamed Cheriet,et al.  Robust NL-Means Filter With Optimal Pixel-Wise Smoothing Parameter for Statistical Image Denoising , 2009, IEEE Transactions on Signal Processing.

[41]  Yoel Shkolnisky,et al.  Diffusion Interpretation of Nonlocal Neighborhood Filters for Signal Denoising , 2009, SIAM J. Imaging Sci..

[42]  Tolga Tasdizen,et al.  Principal Neighborhood Dictionaries for Nonlocal Means Image Denoising , 2009, IEEE Transactions on Image Processing.

[43]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[44]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[45]  Sean Finn,et al.  Speckle Reduction and Edge Detection in Ultrasound Imagery , 2010 .

[46]  Scott T. Acton,et al.  Ultrasound Despeckling for Contrast Enhancement , 2010, IEEE Transactions on Image Processing.

[47]  J A Noble,et al.  Ultrasound image segmentation and tissue characterization , 2010, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[48]  Pierrick Coupé,et al.  Real time ultrasound image denoising , 2011, Journal of Real-Time Image Processing.

[49]  G. Cloutier,et al.  A critical review and uniformized representation of statistical distributions modeling the ultrasound echo envelope. , 2010, Ultrasound in medicine & biology.

[50]  Jean-Michel Morel,et al.  Image Denoising Methods. A New Nonlocal Principle , 2010, SIAM Rev..

[51]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Generalised Nonlocal Image Smoothing Generalised Nonlocal Image Smoothing , 2022 .

[52]  Manish Khare,et al.  Despeckling of medical ultrasound images using Daubechies complex wavelet transform , 2010, Signal Process..

[53]  M Glavin,et al.  Echocardiographic speckle reduction comparison , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[54]  Carl-Fredrik Westin,et al.  Efficient and robust nonlocal means denoising of MR data based on salient features matching , 2012, Comput. Methods Programs Biomed..

[55]  Matthias Zwicker,et al.  Adaptive rendering with non-local means filtering , 2012, ACM Trans. Graph..

[56]  Michal Irani,et al.  Separating Signal from Noise Using Patch Recurrence across Scales , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Sten Roar Snare,et al.  Multiscale nonlocal means method for ultrasound despeckling , 2014, 2014 IEEE International Ultrasonics Symposium.

[58]  Xuming Zhang,et al.  Nonlocal means method using weight refining for despeckling of ultrasound images , 2014, Signal Process..

[59]  Subhasis Chaudhuri,et al.  Novel Speed-Up Strategies for Non-Local Means Denoising With Patch and Edge Patch Based Dictionaries , 2014, IEEE Transactions on Image Processing.

[60]  Frédo Durand,et al.  Fast Local Laplacian Filters , 2014, ACM Trans. Graph..