Guided trilateral filter and its application to ultrasound image despeckling

Abstract Speckle reduction has been a hot research topic in ultrasound imaging community. However, designing a method with better despeckling performance and lower algorithm complexity is still an active pursuit. In this paper, we propose a novel local spatial filtering framework named as the guided trilateral filter (GTF) to implement restoration of a noisy image with a well-fitting statistical distribution model. The GTF is derived as the local maximum likelihood estimation from the probabilities of the residuals between the filtered/guided image and the noisy image. The resulting iteration algorithm is essentially a local weighted filtering whose weights come from the guided image, including spatial distance, range discrepancy and statistical distribution. Choosing specific functions for these trilateral weights can direct to some classical local spatial filters, such as classical bilateral filter, robust bilateral filter, joint/cross bilateral filter, speckle reduction bilateral filter, etc. As a despeckling application of the GTF, we embed the Fisher-Tippett distribution model of ultrasound image into the GTF and thereby present the guided trilateral despeckling filter (GTDF). Experimental results on synthetic and real ultrasound images have demonstrated that the GTDF not only can achieve superior performance against state of the art methods, but also has fast and robust convergence and parameter setting insensitivity.

[1]  Silvana G. Dellepiane,et al.  Quality Assessment of Despeckled SAR Images , 2014, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[2]  Hemant D. Tagare,et al.  Tunneling Descent Level Set Segmentation of Ultrasound Images , 2005, IPMI.

[3]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[4]  Petia Radeva,et al.  SRBF: Speckle reducing bilateral filtering. , 2010, Ultrasound in medicine & biology.

[5]  Alin Achim,et al.  Novel Bayesian multiscale method for speckle removal in medical ultrasound images , 2001, IEEE Transactions on Medical Imaging.

[6]  Martin D. Fox,et al.  Ultrasound image enhancement: A review , 2012, Biomed. Signal Process. Control..

[7]  Marcos Martin-Fernandez,et al.  Anisotropic Diffusion Filter With Memory Based on Speckle Statistics for Ultrasound Images , 2015, IEEE Transactions on Image Processing.

[8]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[9]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Yingtao Zhang,et al.  A novel approach to speckle reduction in ultrasound imaging. , 2009, Ultrasound in medicine & biology.

[11]  Jianing Shi,et al.  A Nonlinear Inverse Scale Space Method for a Convex Multiplicative Noise Model , 2008, SIAM J. Imaging Sci..

[12]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[13]  A. Tannenbaum,et al.  Despeckling of medical ultrasound images , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Florence Tupin,et al.  MuLoG, or How to Apply Gaussian Denoisers to Multi-Channel SAR Speckle Reduction? , 2017, IEEE Transactions on Image Processing.

[15]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[16]  Ajay Gupta,et al.  Speckle reduction in medical ultrasound images using an unbiased non-local means method , 2016, Biomed. Signal Process. Control..

[17]  Chen Wang,et al.  Wavelet and fast bilateral filter based de-speckling method for medical ultrasound images , 2015, Biomed. Signal Process. Control..

[18]  Jin Ho Chang,et al.  Speckle reduction techniques in medical ultrasound imaging , 2014 .

[19]  Xuming Zhang,et al.  Nonlocal means method using weight refining for despeckling of ultrasound images , 2014, Signal Process..

[20]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Qinghua Huang,et al.  Systematic Evaluation on Speckle Suppression Methods in Examination of Ultrasound Breast Images , 2016 .

[22]  Michael K. Ng,et al.  A New Total Variation Method for Multiplicative Noise Removal , 2009, SIAM J. Imaging Sci..

[23]  Haixian Wang,et al.  Image Denoising Using Trivariate Shrinkage Filter in the Wavelet Domain and Joint Bilateral Filter in the Spatial Domain , 2009, IEEE Transactions on Image Processing.

[24]  R S Anand,et al.  Speckle reduction in ultrasound medical images using adaptive filter based on second order statistics , 2007, Journal of medical engineering & technology.

[25]  Santiago Aja-Fernández,et al.  On the estimation of the coefficient of variation for anisotropic diffusion speckle filtering , 2006, IEEE Transactions on Image Processing.

[26]  Shu-Tao Xia,et al.  Entropy-based bilateral filtering with a new range kernel , 2017, Signal Process..

[27]  Carl-Fredrik Westin,et al.  Oriented Speckle Reducing Anisotropic Diffusion , 2007, IEEE Transactions on Image Processing.

[28]  S. Akselrod,et al.  A lognormal approximation for the gray level statistics in ultrasound images , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[29]  Hemant D. Tagare,et al.  Evaluation of Four Probability Distribution Models for Speckle in Clinical Cardiac Ultrasound Images , 2006, IEEE Transactions on Medical Imaging.

[30]  Kenneth E. Barner,et al.  Rayleigh-Maximum-Likelihood Filtering for Speckle Reduction of Ultrasound Images , 2007, IEEE Transactions on Medical Imaging.

[31]  José M. Bioucas-Dias,et al.  Multiplicative Noise Removal Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[32]  Antonios Perperidis,et al.  Postprocessing Approaches for the Improvement of Cardiac Ultrasound B-Mode Images: A Review , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[33]  Göran Salomonsson,et al.  Image enhancement based on a nonlinear multiscale method , 1997, IEEE Trans. Image Process..

[34]  Nelson D. A. Mascarenhas,et al.  Ultrasound Image Despeckling Using Stochastic Distance-Based BM3D , 2017, IEEE Transactions on Image Processing.

[35]  Pierre Charbonnier,et al.  The Guided Bilateral Filter: When the Joint/Cross Bilateral Filter Becomes Robust , 2015, IEEE Transactions on Image Processing.

[36]  T. Loupas,et al.  An adaptive weighted median filter for speckle suppression in medical ultrasonic images , 1989 .

[37]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[39]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[40]  Manish Khare,et al.  Despeckling of medical ultrasound images using Daubechies complex wavelet transform , 2010, Signal Process..

[41]  Zong-Guo Xia,et al.  A comprehensive evaluation of filters for radar speckle suppression , 1996, IGARSS '96. 1996 International Geoscience and Remote Sensing Symposium.

[42]  Y. Wang,et al.  Speckle filtering of ultrasonic images using a modified non local-based algorithm , 2011, Biomed. Signal Process. Control..

[43]  Aleksandra Pizurica,et al.  A versatile wavelet domain noise filtration technique for medical imaging , 2003, IEEE Transactions on Medical Imaging.

[44]  Tong Fang,et al.  Statistical region-based segmentation of ultrasound images. , 2009, Ultrasound in medicine & biology.

[45]  Lili Wu,et al.  Speckle filtering of medical ultrasonic images using wavelet and guided filter. , 2016, Ultrasonics.

[46]  Rudy Lauwereins,et al.  Constant Time Joint Bilateral Filtering Using Joint Integral Histograms , 2012, IEEE Transactions on Image Processing.

[47]  Matthias Zwicker,et al.  Dual-domain image denoising , 2013, 2013 IEEE International Conference on Image Processing.

[48]  C. Lamberti,et al.  Maximum likelihood segmentation of ultrasound images with Rayleigh distribution , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[49]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[50]  Jie Huang,et al.  Fast reduction of speckle noise in real ultrasound images , 2013, Signal Process..