Plane-Wave Ultrasound Beamforming: A Deep Learning Approach

Medical ultrasound provides images which are the spatial map of the tissue echogenicity. Unfortunately, an ultrasound image is a low-quality version of the expected Tissue Reflectivity Function (TRF) mainly due to the non-ideal Point Spread Function (PSF) of the imaging system. This paper presents a novel beamforming approach based on deep learning to get closer to the ideal PSF in Plane-Wave Imaging (PWI). The proposed approach is designed to reconstruct the desired TRF from echo traces acquired by transducer elements using only a single plane-wave transmission. In this approach, first, an ideal model for the TRF is introduced by setting the imaging PSF as a sharp Gaussian function. Then, a mapping function between the pre-beamformed Radio-Frequency (RF) channel data and the proposed TRF is constructed using deep learning. Network architecture contains multi-resolution decomposition and reconstruction using wavelet transform for effective recovery of high-frequency content of the desired TRF. Inspired by curriculum learning, we exploit step by step training from coarse (mean square error) to fine (`0.2) loss functions. The proposed method is trained on a large number of simulation ultrasound data with the ground-truth echogenicity map extracted from real photographic images. The performance of the trained network is evaluated on the publicly available simulation and in vivo test data without any further fine-tuning. Simulation ∗Corresponding author Email address: sobhan.goudarzi@concordia.ca (Sobhan Goudarzi) Preprint submitted to Ultrasonics September 28, 2021 ar X iv :2 10 9. 13 11 9v 1 [ ee ss .I V ] 2 7 Se p 20 21 test results confirm that the proposed method reconstructs images with a high quality in terms of resolution and contrast, which are also visually similar to the proposed ground-truth image. Furthermore, in vivo results show that the trained mapping function preserves its performance in the new domain. Therefore, the proposed approach maintains high resolution, contrast, and framerate simultaneously.

[1]  G. E. Trahey,et al.  Short-lag spatial coherence of backscattered echoes: imaging characteristics , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Jong Chul Ye,et al.  Unpaired Deep Learning for Accelerated MRI Using Optimal Transport Driven CycleGAN , 2020, IEEE Transactions on Computational Imaging.

[4]  M. Fink,et al.  Coherent plane-wave compounding for very high frame rate ultrasonography and transient elastography , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[5]  Adam C Luchies,et al.  Assessing the Robustness of Frequency-Domain Ultrasound Beamforming Using Deep Neural Networks , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[6]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[7]  Jong Chul Ye,et al.  Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[8]  Yuanyuan Wang,et al.  Image Quality Enhancement Using a Deep Neural Network for Plane Wave Medical Ultrasound Imaging , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[9]  O. Bernard,et al.  Plane-Wave Imaging Challenge in Medical Ultrasound , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[10]  Amir Asif,et al.  Fast Multi-Focus Ultrasound Image Recovery Using Generative Adversarial Networks , 2020, IEEE Transactions on Computational Imaging.

[11]  Massimo Mischi,et al.  Adaptive Ultrasound Beamforming Using Deep Learning , 2019, IEEE Transactions on Medical Imaging.

[12]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[13]  H Lopez,et al.  Frequency independent ultrasound contrast-detail analysis. , 1985, Ultrasound in medicine & biology.

[14]  Denis Friboulet,et al.  Reconstruction for Diverging-Wave Imaging Using Deep Convolutional Neural Networks , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[15]  Jian Lu,et al.  An End-to-End Deep Network for Reconstructing CT Images Directly From Sparse Sinograms , 2020, IEEE Transactions on Computational Imaging.

[16]  A. Austeng,et al.  Benefits of minimum-variance beamforming in medical ultrasound imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[17]  Jong Chul Ye,et al.  Adaptive and Compressive Beamforming Using Deep Learning for Medical Ultrasound , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[18]  J. Jensen,et al.  Calculation of pressure fields from arbitrarily shaped, apodized, and excited ultrasound transducers , 1992, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[19]  Jeremy J Dahl,et al.  Reverberation clutter from subcutaneous tissue layers: simulation and in vivo demonstrations. , 2014, Ultrasound in medicine & biology.

[20]  Amir Asif,et al.  Ultrasound Beamforming using MobileNetV2 , 2020, 2020 IEEE International Ultrasonics Symposium (IUS).

[21]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[22]  Brett Byram,et al.  Deep neural networks for ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[23]  Dongwoon Hyun,et al.  Beamforming and Speckle Reduction Using Neural Networks , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[24]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[25]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[26]  Ole Marius Hoel Rindal,et al.  The ultrasound toolbox , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[27]  Gregg E. Trahey,et al.  UltraNet: Deep Learning Tools for Modeling Acoustic Wall Clutter , 2020, 2020 IEEE International Ultrasonics Symposium (IUS).

[28]  Yonina C. Eldar,et al.  Deep Learning in Ultrasound Imaging , 2019, Proceedings of the IEEE.

[29]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[30]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[31]  G. Trahey,et al.  Sources of image degradation in fundamental and harmonic ultrasound imaging using nonlinear, full-wave simulations , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[32]  Ronald M. Summers,et al.  A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises , 2020, Proceedings of the IEEE.

[33]  J. Arendt Paper presented at the 10th Nordic-Baltic Conference on Biomedical Imaging: Field: A Program for Simulating Ultrasound Systems , 1996 .

[34]  Jinhua Yu,et al.  High Spatial–Temporal Resolution Reconstruction of Plane-Wave Ultrasound Images With a Multichannel Multiscale Convolutional Neural Network , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[35]  Hannah Strohm,et al.  Improving Image Quality of Single Plane Wave Ultrasound via Deep Learning Based Channel Compounding , 2020, 2020 IEEE International Ultrasonics Symposium (IUS).

[36]  Neil D. Lawrence,et al.  Dataset Shift in Machine Learning , 2009 .

[37]  Muyinatu A. Lediju Bell,et al.  Deep Learning to Obtain Simultaneous Image and Segmentation Outputs From a Single Input of Raw Ultrasound Channel Data , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[38]  J A Jensen,et al.  Deconvolution of in-vivo ultrasound B-mode images. , 1993, Ultrasonic imaging.

[39]  Bolei Zhou,et al.  Places: A 10 Million Image Database for Scene Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[41]  H. Torp,et al.  The Generalized Contrast-to-Noise Ratio: A Formal Definition for Lesion Detectability , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.