Segmentation of Ultrasound Images based on Scatterer Density using U-Net

Quantitative ultrasound can provide an objective estimation of different tissue properties, which may be used for tissue characterization and detection of abnormal tissue. The effective number of scatterers in different parts of a tissue is one of the important tissue properties that can be estimated by quantitative ultrasound techniques. The envelope echo is the signal which is usually used to estimate the scatterer density. In this study, we proposed using deep learning to estimate the effective number of scatterers. We generated 2000 simulated phantom data containing randomly distributed inclusions with three different values for number of scatterers per resolution cell. We used U-Net to segment the envelope data and to distinguish three different values of scatterer densities. We show that U-Net can discriminate different scattering regimes, particularly, when the difference between the number of scatterers is substantial. The overall accuracy of the network is 83.9%, and the average sensitivity and specificity among the three classes are 83.1% and 92.3% respectively. This study confirms the potential of deep learning framework in quantitative ultrasound and estimation of tissue properties using ultrasound images.

[1]  J F Greenleaf,et al.  Speckle analysis using signal to noise ratios based on fractional order moments. , 1995, Ultrasonic imaging.

[2]  J Alison Noble,et al.  Modeling of errors in Nakagami imaging: illustration on breast mass characterization. , 2014, Ultrasound in medicine & biology.

[3]  G. Fichtinger,et al.  P3E-9 Ultrasound Speckle Detection Using Low Order Moments , 2006, 2006 IEEE Ultrasonics Symposium.

[4]  Timothy J. Hall,et al.  Analysis of Coherent and Diffuse Scattering Using a Reference Phantom , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[5]  Hassan Rivaz,et al.  Ultrasound segmentation using U-Net: learning from simulated data and testing on real data , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Timothy J Hall,et al.  Simultaneous backscatter and attenuation estimation using a least squares method with constraints. , 2011, Ultrasound in medicine & biology.

[7]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.

[8]  Rupert Brooks,et al.  Fine Tuning U-Net for Ultrasound Image Segmentation: Which Layers? , 2019, DART/MIL3ID@MICCAI.

[9]  H. Rivaz Ultrasound Speckle Detection Using Low Order Moments , 2009 .

[10]  Amir Asif,et al.  Multi-Focus Ultrasound Imaging Using Generative Adversarial Networks , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[11]  Frederic Cervenansky,et al.  Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography , 2019, IEEE Transactions on Medical Imaging.

[12]  R. F. Wagner,et al.  Describing small-scale structure in random media using pulse-echo ultrasound. , 1990, The Journal of the Acoustical Society of America.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  P. Fitzgerald,et al.  Non-Rayleigh first-order statistics of ultrasonic backscatter from normal myocardium. , 1993, Ultrasound in medicine & biology.

[15]  Hassan Rivaz,et al.  Two-stage ultrasound image segmentation using U-Net and test time augmentation , 2020, International Journal of Computer Assisted Radiology and Surgery.

[16]  Guy Cloutier,et al.  Estimation Method of the Homodyned K-Distribution Based on the Mean Intensity and Two Log-Moments , 2013, SIAM J. Imaging Sci..

[17]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.

[18]  Hassan Rivaz,et al.  Low Variance Estimation of Backscatter Quantitative Ultrasound Parameters Using Dynamic Programming , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[19]  Hassan Rivaz,et al.  Displacement Estimation in Ultrasound Elastography Using Pyramidal Convolutional Neural Network , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[20]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[21]  B. Goldberg,et al.  Classification of ultrasonic B-mode images of breast masses using Nakagami distribution , 2001, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[22]  Richard W Prager,et al.  Analysis of speckle in ultrasound images using fractional order statistics and the homodyned k-distribution. , 2002, Ultrasonics.