Training improvements for ultrasound beamforming with deep neural networks

This paper investigates practical considerations of training ultrasound deep neural network (DNN) beamformers. First, we studied training DNNs using the combination of multiple point target responses instead of single point target responses. Next, we demonstrated the effect of different hyperparameter settings on ultrasound image quality for simulated scans. This study also showed that DNN beamforming was robust to electronic noise. Next, we showed that mean squared error validation loss was not a good predictor for image quality for simulation, phantom, and in vivo scans. As an alternative to validation loss for selecting DNN beamformers, we studied image quality in physical phantom and in vivo scans and demonstrated that DNN beamformer image quality in these settings was correlated to DNN beamformer image quality in simulated images. These findings suggest that simulated image quality can be used to select DNN beamformers. Finally, we studied the effect of dataset size on DNN beamformer image quality in simulation, physical phantom, and in vivo scans. We interpret the results in terms of recent work on the scaling of deep learning. Overall, the results in this paper show that DNN beamforming has significant potential for improving B-mode image quality.

[1]  Pai-Chi Li,et al.  Performance Evaluation of Coherence-Based Adaptive Imaging Using Clinical Breast Data , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.

[3]  Brett Byram,et al.  Suppressing off-axis scattering using deep neural networks , 2018, Medical Imaging.

[4]  J A Jensen,et al.  A model for the propagation and scattering of ultrasound in tissue. , 1991, The Journal of the Acoustical Society of America.

[5]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[6]  M. O’Donnell,et al.  Phase-aberration correction using signals from point reflectors and diffuse scatterers: basic principles , 1988, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[7]  Yang Yang,et al.  Deep Learning Scaling is Predictable, Empirically , 2017, ArXiv.

[8]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[10]  M S Patterson,et al.  The improvement and quantitative assessment of B-mode images produced by an annular array/cone hybrid. , 1983, Ultrasonic imaging.

[11]  Pai-Chi Li,et al.  Adaptive imaging using the generalized coherence factor. , 2003, IEEE transactions on ultrasonics, ferroelectrics, and frequency control.

[12]  Gregg E. Trahey,et al.  Blocked Elements in 1-D and 2-D Arrays—Part I: Detection and Basic Compensation on Simulated and In Vivo Targets , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[13]  Don H. Johnson,et al.  Array Signal Processing: Concepts and Techniques , 1993 .

[14]  Bin Yang A study of inverse short-time fourier transform , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Brett Byram,et al.  Contrast ratio dynamic range: A new beamformer performance metric , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[16]  Brett Byram,et al.  The Impact of Model-Based Clutter Suppression on Cluttered, Aberrated Wavefronts , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[17]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[18]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[19]  B. Friemel,et al.  Speckle decorrelation due to two-dimensional flow gradients , 1998, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[22]  Brett Byram,et al.  Deep Neural Networks for Ultrasound Beamforming , 2018, IEEE Transactions on Medical Imaging.

[23]  M. Nikoonahad,et al.  Medical ultrasound imaging using neural networks , 1990 .

[24]  Denis Friboulet,et al.  High-Quality Plane Wave Compounding Using Convolutional Neural Networks , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[25]  Denis Friboulet,et al.  Accelerating plane wave imaging through deep learning-based reconstruction: An experimental study , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[26]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[27]  Jean-Philippe Thiran,et al.  A deep learning approach to ultrasound image recovery , 2017 .

[28]  R. F. Wagner,et al.  Low Contrast Detectability and Contrast/Detail Analysis in Medical Ultrasound , 1983, IEEE Transactions on Sonics and Ultrasonics.

[29]  G.E. Trahey,et al.  Adaptive imaging on a diagnostic ultrasound scanner at quasi real-time rates , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[30]  J. Jensen,et al.  Calculation of pressure fields from arbitrarily shaped, apodized, and excited ultrasound transducers , 1992, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[31]  Brett Byram,et al.  A model and regularization scheme for ultrasonic beamforming clutter reduction , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[32]  E.S. Ebbini,et al.  Blocked element compensation in phased array imaging , 1993, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[33]  R. F. Wagner,et al.  Ultrasound speckle size and lesion signal to noise ratio: verification of theory. , 1984, Ultrasonic imaging.

[34]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[35]  Louis B. Rall,et al.  Automatic differentiation , 1981 .

[36]  G. Trahey,et al.  A heterogeneous nonlinear attenuating full- wave model of ultrasound , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[37]  Ole Marius Hoel Rindal,et al.  The dark region artifact in adaptive ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[38]  Dongwoon Hyun,et al.  Real-time high-framerate in vivo cardiac SLSC imaging with a GPU-based beamformer , 2015, 2015 IEEE International Ultrasonics Symposium (IUS).

[39]  Brett Byram,et al.  Deep neural networks for ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[40]  F. Gran,et al.  Broadband minimum variance beamforming for ultrasound imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[41]  F. Foster,et al.  The Improvement and Quantitative Assessment of B-Mode Images Produced by an Annular Array/Cone Hybrid , 1983 .

[42]  Brett Byram,et al.  Ultrasonic multipath and beamforming clutter reduction: a chirp model approach , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.