Phase Asymmetry Ultrasound Despeckling With Fractional Anisotropic Diffusion and Total Variation

We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regions and 1 at the idea step edge, while also taking intermediate values at slowly varying ramp edges. By leveraging the PAS metric in designing weighting coefficients to maintain a balance between fractional-order anisotropic diffusion and total variation (TV) filters in TV cost function, we propose a new fractional TV framework to not only achieve the best despeckling performance with ramp edge preservation but also reduce the staircase effect produced by integral-order filters. Then, we exploit the PAS metric in designing a new fractional-order diffusion coefficient to properly preserve low-contrast edges in diffusion filtering. Finally, different from fixed fractional-order diffusion filters, an adaptive fractional order is introduced based on the PAS metric to enhance various weak edges in the spatially transitional areas between objects. The proposed fractional TV model is minimized using the gradient descent method to obtain the final denoised image. The experimental results and real application of ultrasound breast image segmentation show that the proposed method outperforms other state-of-the-art ultrasound despeckling filters for both speckle reduction and feature preservation in terms of visual evaluation and quantitative indices. The best scores on feature similarity indices have achieved 0.867, 0.844 and 0.834 under three different levels of noise, while the best breast ultrasound segmentation accuracy in terms of the mean and median dice similarity coefficient are 96.25% and 96.15%, respectively.

[1]  E. R. Love,et al.  Fractional Derivatives of Imaginary Order , 1971 .

[2]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[3]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[4]  Jian Bai,et al.  Fractional-Order Anisotropic Diffusion for Image Denoising , 2007, IEEE Transactions on Image Processing.

[5]  D. Burr,et al.  Mach bands are phase dependent , 1986, Nature.

[6]  L. Shao,et al.  From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms , 2014, IEEE Transactions on Cybernetics.

[7]  Kenneth E. Barner,et al.  Rayleigh-Maximum-Likelihood Filtering for Speckle Reduction of Ultrasound Images , 2007, IEEE Transactions on Medical Imaging.

[8]  Qiang Chen,et al.  Ramp preserving Perona-Malik model , 2010, Signal Process..

[9]  Antonio Fernando Catelli Infantosi,et al.  Breast ultrasound despeckling using anisotropic diffusion guided by texture descriptors. , 2014, Ultrasound in medicine & biology.

[10]  K. B. Oldham,et al.  The Fractional Calculus: Theory and Applications of Differentiation and Integration to Arbitrary Order , 1974 .

[11]  A. Bovik,et al.  Image Quality Assessment , 2012 .

[12]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[13]  Valérie Perrier,et al.  The Monogenic Synchrosqueezed Wavelet Transform: A tool for the Decomposition/Demodulation of AM-FM images , 2012, ArXiv.

[14]  Andrey S. Krylov,et al.  Ultrasound despeckling by anisotropic diffusion and total variation methods for liver fibrosis diagnostics , 2017, Signal Process. Image Commun..

[15]  Yan Jin,et al.  An image denoising approach based on adaptive nonlocal total variation , 2019, J. Vis. Commun. Image Represent..

[16]  Binjie Qin,et al.  Ultrasound Imaging Technologies for Breast Cancer Detection and Management: A Review. , 2018, Ultrasound in medicine & biology.

[17]  Nelson D. A. Mascarenhas,et al.  Geodesic Distances in Probabilistic Spaces for Patch-Based Ultrasound Image Processing , 2019, IEEE Transactions on Image Processing.

[18]  Binjie Qin,et al.  Reducing Poisson noise and baseline drift in x-ray spectral images with bootstrap Poisson regression and robust nonparametric regression , 2013, Physics in medicine and biology.

[19]  F. M. Cardoso,et al.  Edge-preserving speckle texture removal by interference-based speckle filtering followed by anisotropic diffusion. , 2012, Ultrasound in medicine & biology.

[20]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.

[21]  Guna Seetharaman,et al.  Multiscale Structure Tensor for Improved Feature Extraction and Image Regularization , 2019, IEEE Transactions on Image Processing.

[22]  Zhang Yi,et al.  A Fractional-Order Variational Framework for Retinex: Fractional-Order Partial Differential Equation-Based Formulation for Multi-Scale Nonlocal Contrast Enhancement with Texture Preserving , 2018, IEEE Transactions on Image Processing.

[23]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[24]  Binjie Qin,et al.  Texture Variation Adaptive Image Denoising With Nonlocal PCA , 2018, IEEE Transactions on Image Processing.

[25]  Marios S. Pattichis,et al.  Multiscale AM-FM Demodulation and Image Reconstruction Methods With Improved Accuracy , 2010, IEEE Transactions on Image Processing.

[26]  Yongtian Wang,et al.  Automatic 2-D/3-D Vessel Enhancement in Multiple Modality Images Using a Weighted Symmetry Filter , 2018, IEEE Transactions on Medical Imaging.

[27]  Yong-Ping Zheng,et al.  Automatic Measurement of Spine Curvature on 3-D Ultrasound Volume Projection Image With Phase Features , 2017, IEEE Transactions on Medical Imaging.

[28]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jinghuai Gao,et al.  Adaptive Variable Time Fractional Anisotropic Diffusion Filtering for Seismic Data Noise Attenuation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Zhenyu Zhou,et al.  A Doubly Degenerate Diffusion Model Based on the Gray Level Indicator for Multiplicative Noise Removal , 2015, IEEE Transactions on Image Processing.

[31]  Marcos Martin-Fernandez,et al.  Anisotropic Diffusion Filter With Memory Based on Speckle Statistics for Ultrasound Images , 2015, IEEE Transactions on Image Processing.

[32]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[33]  Nelson D. A. Mascarenhas,et al.  Ultrasound Image Despeckling Using Stochastic Distance-Based BM3D , 2017, IEEE Transactions on Image Processing.

[34]  Jinsong Bao,et al.  Joint-Saliency Structure Adaptive Kernel Regression with Adaptive-Scale Kernels for Deformable Registration of Challenging Images , 2018, IEEE Access.

[35]  Weixing Wang,et al.  Fractional differential approach to detecting textural features of digital image and its fractional differential filter implementation , 2008, Science in China Series F: Information Sciences.

[36]  Xiangchu Feng,et al.  FOCNet: A Fractional Optimal Control Network for Image Denoising , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  R. F. Wagner,et al.  Statistics of Speckle in Ultrasound B-Scans , 1983, IEEE Transactions on Sonics and Ultrasonics.

[39]  Purang Abolmaesumi,et al.  Nonlocal means filter-based speckle tracking , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[40]  K. F. Riley,et al.  Mathematical Methods for Physics and Engineering: A Comprehensive Guide , 1998 .

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Rajendra K. Ray,et al.  Non-linear Diffusion Models for Despeckling of Images: Achievements and Future Challenges , 2020, IETE Technical Review.

[43]  J. Alison Noble,et al.  2D+T Acoustic Boundary Detection in Echocardiography , 1998, MICCAI.

[44]  R. S. Anand,et al.  Speckle filtering of ultrasound images using a modified non-linear diffusion model in non-subsampled shearlet domain , 2015, IET Image Process..

[45]  Henrique Mohallem Paiva,et al.  A new wavelet family for speckle noise reduction in medical ultrasound images , 2019, Measurement.

[46]  Scott T. Acton,et al.  Ultrasound Despeckling for Contrast Enhancement , 2010, IEEE Transactions on Image Processing.

[47]  Xuming Zhang,et al.  Nonlocal means method using weight refining for despeckling of ultrasound images , 2014, Signal Process..

[48]  Ahror Belaid,et al.  Phase based level set segmentation of ultrasound images , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[49]  Michael Brady,et al.  On the Choice of Band-Pass Quadrature Filters , 2004, Journal of Mathematical Imaging and Vision.

[50]  Chen Wang,et al.  Wavelet and fast bilateral filter based de-speckling method for medical ultrasound images , 2015, Biomed. Signal Process. Control..

[51]  Jinghuai Gao,et al.  A new method for random noise attenuation in seismic data based on anisotropic fractional-gradient operators , 2014 .

[52]  Hongsen He,et al.  An iterative speckle filtering algorithm for ultrasound images based on bayesian nonlocal means filter model , 2019, Biomed. Signal Process. Control..

[53]  Jayaram K. Udupa,et al.  Methodology for evaluating image-segmentation algorithms , 2002, SPIE Medical Imaging.

[54]  Binjie Qin,et al.  Detail-Preserving Image Denoising via Adaptive Clustering and Progressive PCA Thresholding , 2018, IEEE Access.

[55]  Zhihui Wei,et al.  Fractional Variational Model and Algorithm for Image Denoising , 2008, 2008 Fourth International Conference on Natural Computation.

[56]  Gang Wang,et al.  Tree Filtering: Efficient Structure-Preserving Smoothing With a Minimum Spanning Tree , 2014, IEEE Transactions on Image Processing.

[57]  Binjie Qin,et al.  Structure matching driven by joint-saliency-structure adaptive kernel regression , 2016, Appl. Soft Comput..

[58]  Sunil Agrawal,et al.  Image denoising review: From classical to state-of-the-art approaches , 2020, Inf. Fusion.

[59]  Armando Manduca,et al.  Improved Super-Resolution Ultrasound Microvessel Imaging With Spatiotemporal Nonlocal Means Filtering and Bipartite Graph-Based Microbubble Tracking , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[60]  Santiago Aja-Fernández,et al.  On the estimation of the coefficient of variation for anisotropic diffusion speckle filtering , 2006, IEEE Transactions on Image Processing.

[61]  Li Bai,et al.  Speckle Noise Removal Convex Method Using Higher-Order Curvature Variation , 2019, IEEE Access.

[62]  QinBinjie,et al.  Structure matching driven by joint-saliency-structure adaptive kernel regression , 2016 .

[63]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[64]  R. Sivakumar,et al.  An extensive review on Despeckling of medical ultrasound images using various transformation techniques , 2018, Applied Acoustics.

[65]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[66]  Ronen Basri,et al.  On Detection of Faint Edges in Noisy Images , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Kup-Sze Choi,et al.  Fast feature-preserving speckle reduction for ultrasound images via phase congruency , 2017, Signal Process..

[68]  Carl-Fredrik Westin,et al.  Oriented Speckle Reducing Anisotropic Diffusion , 2007, IEEE Transactions on Image Processing.

[69]  Skand Vishwanath Peri,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2017 .

[70]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[71]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[72]  Jiebao Sun,et al.  Multiplicative Noise Removal Based on the Smooth Diffusion Equation , 2019, Journal of Mathematical Imaging and Vision.

[73]  Daniel S Weller,et al.  Content-Aware Enhancement of Images With Filamentous Structures , 2019, IEEE Transactions on Image Processing.

[74]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[75]  Jimin Yu,et al.  Image Denoising Algorithm Based on Entropy and Adaptive Fractional Order Calculus Operator , 2017, IEEE Access.

[76]  西本 勝之,et al.  Fractional calculus : integrations and differentiations of arbitrary order , 1984 .

[77]  Houman Borouchaki,et al.  A new Edge Detector Based on Parametric Surface Model: Regression Surface Descriptor , 2019, ArXiv.

[78]  W. Adams,et al.  Mathematical Methods for Physics and Engineering: A Comprehensive Guide, 2nd Edition , 2003 .

[79]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[80]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[81]  Michael S. Brown,et al.  A Non-local Low-Rank Framework for Ultrasound Speckle Reduction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Santanu Chaudhury,et al.  Edge Probability and Pixel Relativity-Based Speckle Reducing Anisotropic Diffusion , 2018, IEEE Transactions on Image Processing.

[83]  Marios S. Pattichis,et al.  Recent multiscale AM-FM methods in emerging applications in medical imaging , 2012, EURASIP J. Adv. Signal Process..

[84]  Lei Yang,et al.  A New Feature-preserving Nonlinear Anisotropic Diffusion Method for Image Denoising , 2011, BMVC.

[85]  Marios S. Pattichis,et al.  Multiscale Amplitude-Modulation Frequency-Modulation (AM–FM) Texture Analysis of Ultrasound Images of the Intima and Media Layers of the Carotid Artery , 2011, IEEE Transactions on Information Technology in Biomedicine.

[86]  Joseph P. Havlicek,et al.  AM-FM Image Models: Fundamental Techniques and Emerging Trends , 2005 .