GLUENet: Ultrasound Elastography Using Convolutional Neural Network

Displacement estimation is a critical step in ultrasound elastography and failing to estimate displacement correctly can result in large errors in strain images. As conventional ultrasound elastography techniques suffer from decorrelation noise, they are prone to fail in estimating displacement between echo signals obtained during tissue deformations. This study proposes a novel elastography technique which addresses the decorrelation in estimating displacement field. We call our method GLUENet (GLobal Ultrasound Elastography Network) which uses deep Convolutional Neural Network (CNN) to get a coarse but robust time-delay estimation between two ultrasound images. This displacement is later used for formulating a nonlinear cost function which incorporates similarity of RF data intensity and prior information of estimated displacement [3]. By optimizing this cost function, we calculate the finer displacement exploiting all the information of all the samples of RF data simultaneously. The coarse displacement estimate generated by CNN is substantially more robust than the Dynamic Programming (DP) technique used in GLUE for finding the coarse displacement estimates. Our results validate that GLUENet outperforms GLUE in simulation, phantom and in-vivo experiments.

[1]  Hassan Rivaz,et al.  Global Time-Delay Estimation in Ultrasound Elastography , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[2]  Chloé Audigier,et al.  Ultrasound thermal monitoring with an external ultrasound source for customized bipolar RF ablation shapes , 2018, International Journal of Computer Assisted Radiology and Surgery.

[3]  M. Insana,et al.  An information-based machine learning approach to elasticity imaging , 2017, Biomechanics and modeling in mechanobiology.

[4]  Md Kamrul Hasan,et al.  A class of kernel based real-time elastography algorithms. , 2015, Ultrasonics.

[5]  Gregory D. Hager,et al.  Real-Time Regularized Ultrasound Elastography , 2011, IEEE Transactions on Medical Imaging.

[6]  A. Støylen,et al.  Noninvasive myocardial strain measurement by speckle tracking echocardiography: validation against sonomicrometry and tagged magnetic resonance imaging. , 2006, Journal of the American College of Cardiology.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  H. Ermert,et al.  A time-efficient and accurate strain estimation concept for ultrasonic elastography using iterative phase zero estimation , 1999, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[10]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  J. Ophir,et al.  Elastography: A Quantitative Method for Imaging the Elasticity of Biological Tissues , 1991, Ultrasonic imaging.

[12]  Mohammad Arafat Hussain,et al.  Direct and gradient-based average strain estimation by using weighted nearest neighbor cross-correlation peaks , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[13]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[14]  Septimiu E. Salcudean,et al.  Motion Estimation in Ultrasound Images Using Time Domain Cross Correlation With Prior Estimates , 2006, IEEE Transactions on Biomedical Engineering.

[15]  T. Varghese Quasi-Static Ultrasound Elastography. , 2009, Ultrasound clinics.

[16]  Jonathan Ophir,et al.  Elastography: Imaging the elastic properties of soft tissues with ultrasound , 2002, Journal of Medical Ultrasonics.

[17]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.