Assessing the Robustness of Frequency-Domain Ultrasound Beamforming Using Deep Neural Networks

We study training deep neural network (DNN) frequency-domain beamformers using simulated and phantom anechoic cysts and compare to training with simulated point target responses. Using simulation, physical phantom, and in vivo scans, we find that training DNN beamformers using anechoic cysts provided comparable or improved image quality compared with training DNN beamformers using simulated point targets. The proposed method could also be adapted to generate training data from in vivo scans. Finally, we evaluated the robustness of DNN beamforming to common sources of image degradation, including gross sound speed errors, phase aberration, and reverberation. We found that DNN beamformers maintained their ability to improve image quality even in the presence of the studied sources of image degradation. Overall, the results show the potential of using DNN beamforming to improve ultrasound image quality.

[1]  Giovanni Magenes,et al.  The Delay Multiply and Sum Beamforming Algorithm in Ultrasound B-Mode Medical Imaging , 2015, IEEE Transactions on Medical Imaging.

[2]  Denis Friboulet,et al.  Accelerating plane wave imaging through deep learning-based reconstruction: An experimental study , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[3]  Brett Byram,et al.  Deep neural networks for ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[4]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[5]  Adam C. Luchies,et al.  Training improvements for ultrasound beamforming with deep neural networks , 2019, Physics in medicine and biology.

[6]  Muyinatu A. Lediju Bell,et al.  Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[7]  F. Gran,et al.  Broadband minimum variance beamforming for ultrasound imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[8]  F. Foster,et al.  The Improvement and Quantitative Assessment of B-Mode Images Produced by an Annular Array/Cone Hybrid , 1983 .

[9]  Denis Friboulet,et al.  High-Quality Plane Wave Compounding Using Convolutional Neural Networks , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[10]  Jeremy J Dahl,et al.  Reverberation clutter from subcutaneous tissue layers: simulation and in vivo demonstrations. , 2014, Ultrasound in medicine & biology.

[11]  Dongwoon Hyun,et al.  Lesion Detectability in Diagnostic Ultrasound with Short-Lag Spatial Coherence Imaging , 2011, Ultrasonic imaging.

[12]  M S Patterson,et al.  The improvement and quantitative assessment of B-mode images produced by an annular array/cone hybrid. , 1983, Ultrasonic imaging.

[13]  R C Waag,et al.  Measurements of ultrasonic pulse distortion produced by human chest wall , 1995 .

[14]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.

[15]  Brett Byram,et al.  A Robust Method for Ultrasound Beamforming in the Presence of Off‐Axis Clutter and Sound Speed Variation , 2018, Ultrasonics.

[16]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[17]  Mustafa Kurt,et al.  Impact of contrast echocardiography on evaluation of ventricular function and clinical management in a large prospective cohort. , 2009, Journal of the American College of Cardiology.

[18]  Alexander M. Bronstein,et al.  High frame-rate cardiac ultrasound imaging with deep learning , 2018, MICCAI.

[19]  Jong Chul Ye,et al.  Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[20]  J. Jensen,et al.  Calculation of pressure fields from arbitrarily shaped, apodized, and excited ultrasound transducers , 1992, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[21]  Jean-Philippe Thiran,et al.  A deep learning approach to ultrasound image recovery , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[22]  G. Trahey,et al.  Sources of image degradation in fundamental and harmonic ultrasound imaging using nonlinear, full-wave simulations , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[23]  J. Camacho,et al.  Phase Coherence Imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Brett Byram,et al.  A model and regularization scheme for ultrasonic beamforming clutter reduction , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[26]  Brett Byram,et al.  Ultrasonic multipath and beamforming clutter reduction: a chirp model approach , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[27]  Yang Yang,et al.  Deep Learning Scaling is Predictable, Empirically , 2017, ArXiv.

[28]  Orcun Goksel,et al.  Inverse Problem of Ultrasound Beamforming With Sparsity Constraints and Regularization , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[29]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[30]  Pai-Chi Li,et al.  Adaptive imaging using the generalized coherence factor , 2003, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[31]  M. O'Donnell,et al.  Coherence factor of speckle from a multi-row probe , 1999, 1999 IEEE Ultrasonics Symposium. Proceedings. International Symposium (Cat. No.99CH37027).

[32]  Dongwoon Hyun,et al.  Reverberation Noise Suppression in the Aperture Domain Using 3D Fully Convolutional Neural Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[33]  H. Torp,et al.  The Generalized Contrast-to-Noise Ratio: A Formal Definition for Lesion Detectability , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[34]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Brett Byram,et al.  High dynamic range ultrasound beamforming using deep neural networks , 2019, Medical Imaging.

[36]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[37]  A. Austeng,et al.  Adaptive Beamforming Applied to Medical Ultrasound Imaging , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[38]  Brett Byram,et al.  DNN Beamforming for High Contrast Targets in the Presence of Reverberation Clutter , 2019, 2019 IEEE International Ultrasonics Symposium (IUS).

[39]  Brett Byram,et al.  Evaluating the Robustness of Ultrasound Beamforming with Deep Neural Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[40]  John A. Hossack,et al.  The Singular Value Filter: A General Filter Design Strategy for PCA-Based Signal Separation in Medical Ultrasound Imaging , 2011, IEEE Transactions on Medical Imaging.

[41]  G.E. Trahey,et al.  Adaptive imaging and spatial compounding in the presence of aberration , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[42]  W.F. Walker,et al.  A constrained adaptive beamformer for medical ultrasound: initial results , 2002, 2002 IEEE Ultrasonics Symposium, 2002. Proceedings..

[43]  Denis Friboulet,et al.  Pre-beamformed RF signal reconstruction in medical ultrasound using compressive sensing. , 2013, Ultrasonics.

[44]  Jan D'hooge,et al.  The Generalized Contrast-to-Noise Ratio , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[45]  Brett Byram,et al.  Suppressing off-axis scattering using deep neural networks , 2018, Medical Imaging.

[46]  Ali Fatemi,et al.  Studying the Origin of Reverberation Clutter in Echocardiography: In Vitro Experiments and In Vivo Demonstrations. , 2019, Ultrasound in medicine & biology.

[47]  Dongwoon Hyun,et al.  Beamforming and Speckle Reduction Using Neural Networks , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[48]  G. E. Trahey,et al.  Short-lag spatial coherence of backscattered echoes: imaging characteristics , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[49]  F. Dunn,et al.  Comprehensive compilation of empirical ultrasonic properties of mammalian tissues. , 1978, The Journal of the Acoustical Society of America.

[50]  Bin Yang A study of inverse short-time fourier transform , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[51]  Junseob Shin,et al.  Spatial Prediction Filtering of Acoustic Clutter and Random Noise in Medical Ultrasound Imaging , 2017, IEEE Transactions on Medical Imaging.

[52]  R. F. Wagner,et al.  Low Contrast Detectability and Contrast/Detail Analysis in Medical Ultrasound , 1983, IEEE Transactions on Sonics and Ultrasonics.

[53]  Brett Byram,et al.  A pseudo non-linear method for fast simulations of ultrasonic reverberation , 2016, SPIE Medical Imaging.

[54]  Brett Byram,et al.  The Impact of Model-Based Clutter Suppression on Cluttered, Aberrated Wavefronts , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[55]  Raoul Mallart,et al.  Adaptive focusing in scattering media through sound‐speed inhomogeneities: The van Cittert Zernike approach and focusing criterion , 1994 .