Single Plane-Wave Imaging using Physics-Based Deep Learning

In plane-wave imaging, multiple unfocused ultrasound waves are transmitted into a medium of interest from different angles and an image is formed from the recorded reflections. The number of plane waves used leads to a tradeoff between frame-rate and image quality, with single-plane-wave (SPW) imaging being the fastest possible modality with the worst image quality. Recently, deep learning methods have been proposed to improve ultrasound imaging. One approach is to use image-to-image networks that work on the formed image and another is to directly learn a mapping from data to an image. Both approaches utilize purely data-driven models and require deep, expressive network architectures, combined with large numbers of training samples to obtain good results. Here, we propose a data-to-image architecture that incorporates a wave-physics-based image formation algorithm in-between deep convolutional neural networks. To achieve this, we implement the Fourier (FK) migration method as network layers and train the whole network end-to-end. We compare our proposed data-to-image network with an image-to-image network in simulated data experiments, mimicking a medical ultrasound application. Experiments show that it is possible to obtain high-quality SPW images, almost similar to an image formed using 75 plane waves over an angular range of ±16°. This illustrates the great potential of combining deep neural networks with physics-based image formation algorithms for SPW imaging.

[1]  N. de Jong,et al.  Plane-wave ultrasound beamforming using a nonuniform fast fourier transform , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[2]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[3]  Kees Joost Batenburg,et al.  Deep data compression for approximate ultrasonic image formation , 2020, 2020 IEEE International Ultrasonics Symposium (IUS).

[4]  Chris L. de Korte,et al.  Improved Plane-Wave Ultrasound Beamforming by Incorporating Angular Weighting and Coherent Compounding in Fourier Domain , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[5]  Muyinatu A. Lediju Bell,et al.  Deep Learning to Obtain Simultaneous Image and Segmentation Outputs From a Single Input of Raw Ultrasound Channel Data , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[6]  M. Fink,et al.  Coherent plane-wave compounding for very high frame rate ultrasonography and transient elastography , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Jean-Philippe Thiran,et al.  Deep Learning Based Ultrasound Image Reconstruction Method: A Time Coherence Study , 2019, 2019 IEEE International Ultrasonics Symposium (IUS).

[9]  Jong Chul Ye,et al.  Adaptive and Compressive Beamforming Using Deep Learning for Medical Ultrasound , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[10]  Kees Joost Batenburg,et al.  Fast ultrasonic imaging using end-to-end deep learning , 2020, 2020 IEEE International Ultrasonics Symposium (IUS).

[11]  Wei Shen,et al.  Weight Standardization , 2019, ArXiv.

[12]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.

[13]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[14]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[15]  Mickael Tanter,et al.  Ultrafast imaging in biomedical ultrasound , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[16]  G. Cloutier,et al.  Stolt's f-k migration for plane wave ultrasound imaging , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.