A Deep Learning Based Alternative to Beamforming Ultrasound Images

Deep learning methods are capable of performing sophisticated tasks when applied to a myriad of artificial intelligent (AI) research fields. In this paper, we introduce a novel approach to replace the inherently flawed beamforming step during ultrasound image formation by applying deep learning directly to RF channel data. Specifically, we pose the ultrasound beamforming process as a segmentation problem and apply a fully convolutional neural network architecture to segment anechoic cysts from surrounding tissue. We train our network on a dataset created using the Field II ultrasound simulation software to simulate plane wave imaging with a single insonification angle. We demonstrate the success of our architecture in extracting tissue information directly from the raw channel data, which completely bypasses the beamforming step that would otherwise require multiple insonifi-cation angles for plane wave imaging. Our simulated results produce mean Dice coefficient of 0.98 ± 0.02, when measuring the overlap between ground truth cyst locations and cyst locations determined by the network. The proposed approach is promising for developing dedicated deep-learning networks to improve the real-time ultrasound image formation process.

[1]  Muyinatu A. Lediju Bell,et al.  A machine learning method to identify and remove reflection artifacts in photoacoustic channel data , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Mickael Tanter,et al.  Ultrafast imaging in biomedical ultrasound , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[5]  Gustavo Carneiro,et al.  Combining Multiple Dynamic Models and Deep Learning Architectures for Tracking the Left Ventricle Endocardium in Ultrasound Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[7]  Muyinatu A. Lediju Bell,et al.  A machine learning approach to identifying point source locations in photoacoustic data , 2017, BiOS.

[8]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[9]  Palmer Pe Manual of Diagnostic Ultrasound , 1995 .

[10]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Wendie A Berg,et al.  Cystic breast masses and the ACRIN 6666 experience. , 2010, Radiologic clinics of North America.

[13]  Muyinatu A. Lediju Bell,et al.  Photoacoustic based visual servoing of needle tips to improve biopsy on obese patients , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Hao Chen,et al.  Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[18]  K. Thomenius,et al.  Accelerated focused ultrasound imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[19]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[20]  S. Huber,et al.  Real-time spatial compound imaging in breast ultrasound. , 2002, Ultrasound in medicine & biology.

[21]  O Somphone,et al.  The 2014 liver ultrasound tracking benchmark , 2015, Physics in medicine and biology.

[22]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[23]  Jean-Philippe Thiran,et al.  A deep learning approach to ultrasound image recovery , 2017 .

[24]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[25]  Gregg E. Trahey,et al.  Quantitative Assessment of the Magnitude, Impact and Spatial Extent of Ultrasonic Clutter , 2008, Ultrasonic imaging.

[26]  Etta D Pisano,et al.  Detection of breast cancer with addition of annual screening ultrasound or a single screening MRI to mammography in women with elevated breast cancer risk. , 2012, JAMA.

[27]  Brett Byram,et al.  Deep Neural Networks for Ultrasound Beamforming , 2018, IEEE Transactions on Medical Imaging.

[28]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[29]  Thomas L. Szabo,et al.  Diagnostic Ultrasound Imaging: Inside Out , 2004 .

[30]  Mingyue Ding,et al.  Deep learning based classification of focal liver lesions with contrast-enhanced ultrasound , 2014 .

[31]  J. Salonen,et al.  Ultrasound B-mode imaging in observational studies of atherosclerotic progression. , 1993, Circulation.