DSWE-Net: A deep learning approach for shear wave elastography and lesion segmentation using single push acoustic radiation force.

Ultrasound-based non-invasive elasticity imaging modalities have received significant consideration for tissue characterization over the last few years. Though substantial advances have been made, the conventional Shear Wave Elastography (SWE) methods still suffer from poor image quality in regions far from the push location, particularly those which rely on single focused ultrasound push beam to generate shear waves. In this study, we propose DSWE-Net, a novel deep learning-based approach that is able to construct Young's modulus maps from ultrasonically tracked tissue velocity data resulting from a single acoustic radiation force (ARF) push. The proposed network employs a 3D convolutional encoder, followed by a recurrent block consisting of several Convolutional Long Short-Term Memory (ConvLSTM) layers to extract high-level spatio-temporal features from different time-frames of the input velocity data. Finally, a pair of coupled 2D convolutional decoder blocks reconstructs the modulus image and additionally performs inclusion segmentation by generating a binary mask. We also propose a multi-task learning loss function for end-to-end training of the network with 1260 data samples obtained from a simulation environment which include both bi-level and multi-level phantom structures. The performance of the proposed network is evaluated on 140 synthetic test data and the results are compared both qualitatively and quantitatively with that of the current state of the art method, Local Phase Velocity Based Imaging (LPVI). With an average SSIM of 0.90, RMSE of 0.10 and 20.69 dB PSNR, DSWE-Net performs much better on the imaging task compared to LPVI. Our method also achieves an average IoU score of 0.81 for the segmentation task which makes it suitable for localizing inclusions as well. In this initial study, we also show that our method gains an overall improvement of 0.09 in SSIM, 4.81 dB in PSNR, 2.02 dB in CNR, and 0.09 in RMSE over LPVI on a completely unseen set of CIRS tissue mimicking phantom data. This proves its better generalization capability and shows its potential for use in real-world clinical practice.

[1]  David Larsson,et al.  Arterial Stiffness Estimation by Shear Wave Elastography: Validation in Phantoms with Mechanical Testing. , 2016, Ultrasound in medicine & biology.

[2]  M. Giger,et al.  Automatic segmentation of breast lesions on ultrasound. , 2001, Medical physics.

[3]  K. Nightingale,et al.  On the precision of time-of-flight shear wave speed estimation in homogeneous soft solids: initial results using a matrix array transducer , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[4]  A. Gefen,et al.  Mechanics of the normal woman's breast. , 2007, Technology and health care : official journal of the European Society for Engineering and Medicine.

[5]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[6]  G. Ferraioli,et al.  Accuracy of real‐time shear wave elastography for assessing liver fibrosis in chronic hepatitis C: A pilot study , 2012, Hepatology.

[7]  G. Trahey,et al.  Shear-wave generation using acoustic radiation force: in vivo and ex vivo results. , 2003, Ultrasound in medicine & biology.

[8]  Matthew W. Urban,et al.  Local Phase Velocity Based Imaging: A New Technique Used for Ultrasound Shear Wave Elastography , 2019, IEEE Transactions on Medical Imaging.

[9]  K. An,et al.  Quantitative assessment of rotator cuff muscle elasticity: Reliability and feasibility of shear wave elastography. , 2015, Journal of biomechanics.

[10]  Thomas J. Fuchs,et al.  DeepPET: A deep encoder–decoder network for directly solving the PET image reconstruction inverse problem , 2018, Medical Image Anal..

[11]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[12]  R. Real,et al.  The Probabilistic Basis of Jaccard's Index of Similarity , 1996 .

[13]  M. Fink,et al.  Supersonic shear imaging: a new technique for soft tissue elasticity mapping , 2004, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Jacob Scharcanski,et al.  Macroscopic Pigmented Skin Lesion Segmentation and Its Influence on Lesion Classification and Diagnosis , 2013 .

[15]  K. Nightingale,et al.  On the thermal effects associated with radiation force imaging of soft tissue , 2004, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[16]  Hairong Zheng,et al.  Comparative study on shear wave speed estimation algorithms in ARFI for improving its reliability , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Mark L. Palmeri,et al.  Guidelines for Finite-Element Modeling of Acoustic Radiation Force-Induced Shear Wave Propagation in Tissue-Mimicking Media , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[18]  P. Malliaras,et al.  “Soft, hard, or just right?” Applications and limitations of axial-strain sonoelastography and shear-wave elastography in the assessment of tendon injuries , 2013, Skeletal Radiology.

[19]  Mark Palmeri,et al.  Parameters affecting the resolution and accuracy of 2-D quantitative shear wave images , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[20]  F. Sebag,et al.  Shear wave elastography: a new ultrasound imaging mode for the differential diagnosis of benign and malignant thyroid nodules. , 2010, The Journal of clinical endocrinology and metabolism.

[21]  Hui-Xiong Xu,et al.  Qualitative and quantitative analysis with a novel shear wave speed imaging for differential diagnosis of breast lesions , 2017, Scientific Reports.

[22]  J. Greenleaf,et al.  Material property estimation for tubes and arteries using ultrasound radiation force and analysis of propagating modes. , 2011, The Journal of the Acoustical Society of America.

[23]  R. Martí,et al.  Breast-lesion Segmentation Combining B-Mode and Elastography Ultrasound , 2016, Ultrasonic imaging.

[24]  John B Weaver,et al.  Initial in vivo experience with steady‐state subzone‐based MR elastography of the human breast , 2003, Journal of magnetic resonance imaging : JMRI.

[25]  Tsuyoshi Shiina,et al.  WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: basic principles and terminology. , 2015, Ultrasound in medicine & biology.

[26]  Cynthia A. Reinhart-King,et al.  Tensional homeostasis and the malignant phenotype. , 2005, Cancer cell.

[27]  D. Rubens,et al.  Tissue elasticity properties as biomarkers for prostate cancer. , 2008, Cancer biomarkers : section A of Disease markers.

[28]  Marvin M. Doyley,et al.  Plane-Wave Imaging Improves Single-Track Location Shear Wave Elasticity Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[29]  M. O’Donnell,et al.  Internal displacement and strain imaging using ultrasonic speckle tracking , 1994, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[30]  K. Nightingale,et al.  Quantifying hepatic shear modulus in vivo using acoustic radiation force. , 2008, Ultrasound in medicine & biology.

[31]  Mostafa Fatemi,et al.  Quantifying elasticity and viscosity from measurement of shear wave speed dispersion. , 2004, The Journal of the Acoustical Society of America.

[32]  Dinggang Shen,et al.  Super-resolution reconstruction of neonatal brain magnetic resonance images via residual structured sparse representation , 2019, Medical Image Anal..

[33]  Henning Müller,et al.  Fusing learned representations from Riesz Filters and Deep CNN for lung tissue classification , 2019, Medical Image Anal..

[34]  Armando Manduca,et al.  Comb-Push Ultrasound Shear Elastography (CUSE): A Novel Method for Two-Dimensional Shear Elasticity Imaging of Soft Tissues , 2012, IEEE Transactions on Medical Imaging.

[35]  Juvenal Ormachea,et al.  Shear Wave Speed Estimation Using Reverberant Shear Wave Fields: Implementation and Feasibility Studies. , 2018, Ultrasound in medicine & biology.

[36]  Ulas Bagci,et al.  Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning , 2017, IPMI.

[37]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[38]  R. Barr Elastography in clinical practice. , 2014, Radiologic clinics of North America.

[39]  W. Cleveland LOWESS: A Program for Smoothing Scatterplots by Robust Locally Weighted Regression , 1981 .

[40]  D. Noh,et al.  Clinical application of shear wave elastography (SWE) in the diagnosis of benign and malignant breast diseases , 2011, Breast Cancer Research and Treatment.