Fast ultrasonic imaging using end-to-end deep learning

Ultrasonic imaging algorithms used in many clinical and industrial applications consist of three steps: A data pre-processing, an image formation and an image post-processing step. For efficiency, image formation often relies on an approximation of the underlying wave physics. A prominent example is the Delay-And-Sum (DAS) algorithm used in reflectivity-based ultrasonic imaging. Recently, deep neural networks (DNNs) are being used for the data pre-processing and the image postprocessing steps separately. In this work, we propose a novel deep learning architecture that integrates all three steps to enable end-to-end training. We examine turning the DAS image formation method into a network layer that connects data pre-processing layers with image post-processing layers that perform segmentation. We demonstrate that this integrated approach clearly outperforms sequential approaches that are trained separately. While network training and evaluation is performed only on simulated data, we also showcase the potential of our approach on real data from a non-destructive testing scenario.

[1]  Yonina C. Eldar,et al.  Deep Learning for Fast Adaptive Beamforming , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Muyinatu A. Lediju Bell,et al.  Deep Learning to Obtain Simultaneous Image and Segmentation Outputs From a Single Input of Raw Ultrasound Channel Data , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[3]  Jong Chul Ye,et al.  Adaptive and Compressive Beamforming Using Deep Learning for Medical Ultrasound , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Nassir Navab,et al.  End-to-End Learning-Based Ultrasound Reconstruction , 2019, ArXiv.

[6]  Wei Shen,et al.  Weight Standardization , 2019, ArXiv.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  P. Wilcox,et al.  Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation , 2005 .

[9]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[10]  Jean-Philippe Thiran,et al.  Deep Learning Based Ultrasound Image Reconstruction Method: A Time Coherence Study , 2019, 2019 IEEE International Ultrasonics Symposium (IUS).

[11]  Simon R. Arridge,et al.  Solving inverse problems using data-driven models , 2019, Acta Numerica.

[12]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[13]  Alexandros G. Dimakis,et al.  Deep Learning Techniques for Inverse Problems in Imaging , 2020, IEEE Journal on Selected Areas in Information Theory.

[14]  Mickael Tanter,et al.  Ultrafast imaging in biomedical ultrasound , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[15]  G. Blacquière,et al.  Inverse wave field extrapolation: a different NDI approach to imaging defects , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[16]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.