A Convolution Neural Network-Based Speckle Tracking Method for Ultrasound Elastography

Accurate tracking of tissue motion is critically important for several ultrasound elastography methods including strain elastography and shear wave elastography. In this study, we investigate the feasibility of using a convolution neural network (CNN)-based speckle tracking method for elastographic applications. Additional data sets produced by finite element simulations were used to train an existing Flownet 2.0 model. After training, the improved network was evaluated using computer-simulated and tissue-mimicking phantoms, and in vivo breast ultrasound data. Our preliminary results were compared to a published 2D high-quality speckle tracking method by our group. Our preliminary results showed that the improved CNN outperformed the original Flownet 2.0. More specifically, in a tissue-mimicking phantom and one set of in vivo breast ultrasound data, the proposed CNN-based method achieved higher contrast-to-noise ratios (0.64 vs 1.05 and 1.16 vs. 1.40, respectively), as compared with the original Flownet 2.0 model. However, the improved CNN was still inferior to the coupled tracking algorithm. Currently, the inference process after the training of the proposed CNN can achieve approximately 60 frames/second for 2D speckle tracking under the NVIDIA TensorRT™ framework. Overall, we conclude that applying the proposed CNN-based speckle tracking method is feasible and good-quality strain elastography data can be obtained in TM phantoms and in vivo breast data. Our future work includes applying this technique to in vivo 3D whole breast ultrasound data.

[1]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jingfeng Jiang,et al.  A coupled subsample displacement estimation method for ultrasound-based strain elastography , 2015, Physics in medicine and biology.

[4]  Jianwen Luo,et al.  A two-step optical flow method for strain estimation in elastography: Simulation and phantom study. , 2014, Ultrasonics.

[5]  C. S. Spalding,et al.  In vivo real-time freehand palpation imaging. , 2003, Ultrasound in medicine & biology.

[6]  Tsuyoshi Shiina,et al.  WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: basic principles and terminology. , 2015, Ultrasound in medicine & biology.

[7]  Yuqi Wang,et al.  Three-dimensional Ultrasound Elasticity Imaging on an Automated Breast Volume Scanning System , 2017, Ultrasonic imaging.

[8]  Bo Peng,et al.  A GPU-Accelerated 3-D Coupled Subsample Estimation Algorithm for Volumetric Breast Strain Elastography , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[9]  Jingfeng Jiang,et al.  Building a virtual simulation platform for quasistatic breast ultrasound elastography using open source software: A preliminary investigation. , 2015, Medical physics.