Adaptive Ultrasound Beamforming Using Deep Learning

Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance imaging to ultrasound imaging. While advanced data-adaptive reconstruction methods can recover much higher image quality than traditional approaches, their implementation often poses a high computational burden. In ultrasound imaging, this burden is significant, especially when striving for low-cost systems, and has motivated the development of high-resolution and high-contrast adaptive beamforming methods. Here we show that deep neural networks, that adopt the algorithmic structure and constraints of adaptive signal processing techniques, can efficiently learn to perform fast high-quality ultrasound beamforming using very little training data. We apply our technique to two distinct ultrasound acquisition strategies (plane wave, and synthetic aperture), and demonstrate that high image quality can be maintained when measuring at low data-rates, using undersampled array designs. Beyond biomedical imaging, we expect that the proposed deep learning based adaptive processing framework can benefit a variety of array and signal processing applications, in particular when data-efficiency and robustness are of importance.

[1]  Yonina C. Eldar,et al.  Super-Resolution Ultrasound Localization Microscopy Through Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[2]  Denis Friboulet,et al.  High-Quality Plane Wave Compounding Using Convolutional Neural Networks , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[3]  Yonina C. Eldar,et al.  Sparse Convolutional Beamforming for Ultrasound Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Ran Raz,et al.  On the complexity of matrix product , 2002, STOC '02.

[5]  Yonina C. Eldar,et al.  iMAP Beamforming for High-Quality High Frame Rate Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[6]  MooHo Bae,et al.  Fast Minimum Variance Beamforming Based on Legendre Polynomials , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[7]  Babak Mohammadzadeh Asl,et al.  An improved minimum variance beamforming applied to plane-wave imaging in medical ultrasound , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[8]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.

[9]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[10]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[11]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[12]  Jong Chul Ye,et al.  Deep Learning for Accelerated Ultrasound Imaging , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Sverre Holm,et al.  Wiener beamforming and the coherence factor in ultrasound imaging , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[15]  Brett Byram,et al.  Deep neural networks for ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  F. Gran,et al.  Adaptive spectral doppler estimation , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[18]  Raoul Mallart,et al.  Adaptive focusing in scattering media through sound‐speed inhomogeneities: The van Cittert Zernike approach and focusing criterion , 1994 .

[19]  Johan-Fredrik Synnevåg Adaptive Beamforming for Medical Ultrasound Imaging , 2009 .

[20]  V. Strassen Gaussian elimination is not optimal , 1969 .

[21]  O. Bernard,et al.  Plane-Wave Imaging Challenge in Medical Ultrasound , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[26]  J. Capon High-resolution frequency-wavenumber spectrum analysis , 1969 .

[27]  Yonina C. Eldar,et al.  Deep Learning for Fast Adaptive Beamforming , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Suhyun Park,et al.  A fast minimum variance beamforming method using principal component analysis , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[29]  Jong Chul Ye,et al.  Deep Learning-based Universal Beamformer for Ultrasound Imaging , 2019, MICCAI.

[30]  Austin Reiter,et al.  A Deep Learning Based Alternative to Beamforming Ultrasound Images , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Stephen P. Boyd,et al.  Robust minimum variance beamforming , 2005, IEEE Transactions on Signal Processing.

[32]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.

[33]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.