Reverberation Noise Suppression in Ultrasound Channel Signals Using a 3D Fully Convolutional Neural Network

Diffuse reverberation is ultrasound image noise caused by multiple reflections of the transmitted pulse before returning to the transducer, which degrades image quality and impedes the estimation of displacement or flow in techniques such as elastography and Doppler imaging. Diffuse reverberation appears as spatially incoherent noise in the channel signals, where it also degrades the performance of adaptive beamforming methods, sound speed estimation, and methods that require measurements from channel signals. In this paper, we propose a custom 3D fully convolutional neural network (3DCNN) to reduce diffuse reverberation noise in the channel signals. The 3DCNN was trained with channel signals from simulations of random targets that include models of reverberation and thermal noise. It was then evaluated both on phantom and in-vivo experimental data. The 3DCNN showed improvements in image quality metrics such as generalized contrast to noise ratio (GCNR), lag one coherence (LOC) contrast-to-noise ratio (CNR) and contrast for anechoic regions in both phantom and in-vivo experiments. Visually, the contrast of anechoic regions was greatly improved. The CNR was improved in some cases, however the 3DCNN appears to strongly remove uncorrelated and low amplitude signal. In images of in-vivo carotid artery and thyroid, the 3DCNN was compared to short-lag spatial coherence (SLSC) imaging and spatial prediction filtering (FXPF) and demonstrated improved contrast, GCNR, and LOC, while FXPF only improved contrast and SLSC only improved CNR.

[1]  Brett Byram,et al.  Ultrasonic multipath and beamforming clutter reduction: a chirp model approach , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[2]  G. E. Trahey,et al.  Short-lag spatial coherence of backscattered echoes: imaging characteristics , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[3]  Austin Reiter,et al.  A Deep Learning Based Alternative to Beamforming Ultrasound Images , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Gregg E. Trahey,et al.  Quantitative Assessment of the Magnitude, Impact and Spatial Extent of Ultrasonic Clutter , 2008, Ultrasonic imaging.

[5]  Junseob Shin,et al.  Spatial Prediction Filtering of Acoustic Clutter and Random Noise in Medical Ultrasound Imaging , 2017, IEEE Transactions on Medical Imaging.

[6]  B. Angelsen,et al.  Methods for reverberation suppression utilizing dual frequency band imaging. , 2013, The Journal of the Acoustical Society of America.

[7]  Gregg E. Trahey,et al.  Erratum: Sources of image degradation in fundamental and harmonic ultrasound imaging: A nonlinear, full-wave, simulation study (IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control) , 2011 .

[8]  Tal Klap,et al.  An Open Source GPU-Based Beamformer for Real-Time Ultrasound Imaging and Applications , 2019, 2019 IEEE International Ultrasonics Symposium (IUS).

[9]  Ned C. Rouze,et al.  Noninvasive evaluation of hepatic fibrosis using acoustic radiation force-based shear stiffness in patients with nonalcoholic fatty liver disease. , 2011, Journal of hepatology.

[10]  Dongwoon Hyun,et al.  Efficient Strategies for Estimating the Spatial Coherence of Backscatter , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Dongwoon Hyun,et al.  Reverberation Noise Suppression in the Aperture Domain Using 3D Fully Convolutional Neural Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[14]  Armando Manduca,et al.  Improved Shear Wave Motion Detection Using Pulse-Inversion Harmonic Imaging With a Phased Array Transducer , 2013, IEEE Transactions on Medical Imaging.

[15]  Junseob Shin,et al.  Spatial Prediction Filtering for Medical Ultrasound in Aberration and Random Noise , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[16]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[17]  Sverre Holm,et al.  Capon Beamforming for Active Ultrasound Imaging Systems , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[18]  Jeremy J Dahl,et al.  Reverberation clutter from subcutaneous tissue layers: simulation and in vivo demonstrations. , 2014, Ultrasound in medicine & biology.

[19]  Brett Byram,et al.  Deep neural networks for ultrasound beamforming , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[20]  S. Teefey,et al.  Factors affecting image quality and diagnostic efficacy in abdominal sonography: A prospective study of 140 patients , 1993, Journal of clinical ultrasound : JCU.

[21]  Dongwoon Hyun,et al.  Beamforming and Speckle Reduction Using Neural Networks , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[22]  B. Angelsen,et al.  Transmit beams adapted to reverberation noise suppression using dual-frequency SURF imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[23]  Junseob Shin,et al.  Ultrasonic Reverberation Clutter Suppression Using Multiphase Apodization With Cross Correlation , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[24]  Raul N Uppot,et al.  Impact of obesity on radiology. , 2007, Radiologic clinics of North America.

[25]  G. Trahey,et al.  A heterogeneous nonlinear attenuating full- wave model of ultrasound , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[26]  Brett Byram,et al.  A model and regularization scheme for ultrasonic beamforming clutter reduction , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[27]  Gianmarco Pinton,et al.  Spatial coherence in human tissue: implications for imaging and measurement , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[28]  Nick Bottenus Recovery of the Complete Data Set From Focused Transmit Beams , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[29]  M. Averkiou,et al.  A new imaging technique based on the nonlinear properties of tissues , 1997, 1997 IEEE Ultrasonics Symposium Proceedings. An International Symposium (Cat. No.97CH36118).

[30]  A. Ijspeert The Handbook of Brain Theory and Neural Networks , 2015 .

[31]  T. D. Mast,et al.  Simulation of ultrasonic pulse propagation through the abdominal wall. , 1997, The Journal of the Acoustical Society of America.

[32]  G. E. Trahey,et al.  Harmonic spatial coherence imaging: an ultrasonic imaging method based on backscatter coherence , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[33]  Raul N Uppot,et al.  Effect of obesity on image quality: fifteen-year longitudinal study for evaluation of dictated radiology reports. , 2006, Radiology.

[34]  Jeff Wood,et al.  Super‐resolution musculoskeletal MRI using deep learning , 2018, Magnetic resonance in medicine.

[35]  Dongwoon Hyun,et al.  Local speed of sound estimation in tissue using pulse-echo ultrasound: Model-based approach. , 2018, The Journal of the Acoustical Society of America.

[36]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[37]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Thomas Brox,et al.  What Do Single-View 3D Reconstruction Networks Learn? , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Dongwoon Hyun,et al.  Extending Retrospective Encoding for Robust Recovery of the Multistatic Data Set , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[40]  Jorgen Arendt Jensen,et al.  A multi-threaded version of Field II , 2014, 2014 IEEE International Ultrasonics Symposium.

[41]  Viacheslav V. Voronin,et al.  Medical Image Inpainting Using Multi-Scale Patches and Neural Networks Concepts , 2019, IOP Conference Series: Materials Science and Engineering.

[42]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[43]  Gregg E. Trahey,et al.  Lag-One Coherence as a Metric for Ultrasonic Image Quality , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[44]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[45]  Dongwoon Hyun,et al.  Improved Visualization in Difficult-to-Image Stress Echocardiography Patients Using Real-Time Harmonic Spatial Coherence Imaging , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[46]  Craig M. Hales,et al.  Trends in Obesity and Severe Obesity Prevalence in US Youth and Adults by Sex and Age, 2007-2008 to 2015-2016 , 2018, JAMA.

[47]  G.E. Trahey,et al.  Rapid tracking of small displacements with ultrasound , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[48]  H. Torp,et al.  The Generalized Contrast-to-Noise Ratio: A Formal Definition for Lesion Detectability , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.