A unified deep network for beamforming and speckle reduction in plane wave imaging: A simulation study.

Plane Wave Imaging is a fast imaging method used in ultrasound, which allows a high frame rate, but with compromised image quality when a single wave is used. In this work a learning-based approach was used to obtain improved image quality. The entire process of beamforming and speckle reduction was embedded in a single deep convolutional network, and trained with two types of simulated data. The network architecture was designed based on traditional physical considerations of the ultrasonic image formation pipe. As such, it includes beamforming with spatial matched filters, envelope detection, and a speckle reduction stage done in log-signal representation, with all stages containing trainable parameters. The approach was tested on the publicly available PICMUS datasets, achieving axial and lateral full-width-half-maximum (FWHM) resolution values of 0.22 mm and 0.35 mm respectively, and a Contrast to Noise Ratio (CNR) metric of 16.75 on the experimental datasets.

[1]  Jørgen Arendt Jensen,et al.  Computer Phantoms for Simulating Ultrasound B-Mode and CFM Images , 1997 .

[2]  Brett Byram,et al.  Deep Neural Networks for Ultrasound Beamforming , 2018, IEEE Transactions on Medical Imaging.

[3]  Pierrick Coupé,et al.  Nonlocal Means-Based Speckle Filtering for Ultrasound Images , 2009, IEEE Transactions on Image Processing.

[4]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yong-Ping Zheng,et al.  Subarray coherence based postfilter for eigenspace based minimum variance beamformer in ultrasound plane-wave imaging. , 2016, Ultrasonics.

[7]  K. Boone,et al.  Effect of skin impedance on image quality and variability in electrical impedance tomography: a model study , 1996, Medical and Biological Engineering and Computing.

[8]  Orcun Goksel,et al.  Inverse Problem of Ultrasound Beamforming With Sparsity Constraints and Regularization , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[9]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[10]  Dongwoon Hyun,et al.  Beamforming and Speckle Reduction Using Neural Networks , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[11]  Jørgen Arendt Jensen,et al.  Synthetic aperture ultrasound imaging. , 2006, Ultrasonics.

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[13]  Ole Marius Hoel Rindal,et al.  Double Adaptive Plane-wave Imaging , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[14]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  J. Capon.  High-resolution frequency-wavenumber spectrum analysis , 1969 .

[17]  Adrian Basarab,et al.  Beamforming Through Regularized Inverse Problems in Ultrasound Medical Imaging , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[18]  Michael S. Brown,et al.  A Non-local Low-Rank Framework for Ultrasound Speckle Reduction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  K. Thomenius,et al.  Accelerated focused ultrasound imaging , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[21]  Sverre Holm,et al.  Wiener beamforming and the coherence factor in ultrasound imaging , 2010, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[22]  Santiago Aja-Fernández,et al.  On the estimation of the coefficient of variation for anisotropic diffusion speckle filtering , 2006, IEEE Transactions on Image Processing.

[23]  Hiroshi Kanai,et al.  Effect of subaperture beamforming on phase coherence imaging , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  J. Yen,et al.  A Novel Envelope Detector for High-Frame Rate, High-Frequency Ultrasound Imaging , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[26]  G.E. Trahey,et al.  Rapid tracking of small displacements with ultrasound , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[27]  Yuling Chen,et al.  Dynamic Transmit–Receive Beamforming by Spatial Matched Filtering for Ultrasound Imaging with Plane Wave Transmission , 2017, Ultrasonic imaging.

[28]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[29]  Pierrick Coupé,et al.  Bayesian Non-local Means Filter, Image Redundancy and Adaptive Dictionaries for Noise Removal , 2007, SSVM.

[30]  M. O'Donnell,et al.  Synthetic aperture imaging for small scale systems , 1995, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[31]  Jean-Philippe Thiran,et al.  A deep learning approach to ultrasound image recovery , 2017 .

[32]  Santanu Chaudhury,et al.  Ultrasound Image Enhancement Using Structure Oriented Adversarial Network , 2018, IEEE Signal Processing Letters.

[33]  Giovanni Magenes,et al.  The Delay Multiply and Sum Beamforming Algorithm in Ultrasound B-Mode Medical Imaging , 2015, IEEE Transactions on Medical Imaging.

[34]  John W. Clark,et al.  Nonlinear multiscale wavelet diffusion for speckle suppression and edge enhancement in ultrasound images , 2006, IEEE Transactions on Medical Imaging.

[35]  M. Fink,et al.  Coherent plane-wave compounding for very high frame rate ultrasonography and transient elastography , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[36]  Denis Friboulet,et al.  High-Quality Plane Wave Compounding Using Convolutional Neural Networks , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[37]  Steven A. Tretter.  Communication System Design Using Dsp Algorithms: With Laboratory Experiments For The Tms320c30 , 1995 .

[38]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Babak Mohammadzadeh Asl,et al.  An improved minimum variance beamforming applied to plane-wave imaging in medical ultrasound , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[40]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[41]  Marcos Martin-Fernandez,et al.  Anisotropic Diffusion Filter With Memory Based on Speckle Statistics for Ultrasound Images , 2015, IEEE Transactions on Image Processing.

[42]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[43]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[44]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[45]  P. Shankar.  A general statistical model for ultrasonic backscattering from tissues , 2000 .

[46]  Jørgen Arendt Jensen,et al.  Spatial filters for focusing ultrasound images , 2001, 2001 IEEE Ultrasonics Symposium. Proceedings. An International Symposium (Cat. No.01CH37263).

[47]  Jie Liu,et al.  Efficient array beam forming by spatial filtering for ultrasound B-mode imaging. , 2006, The Journal of the Acoustical Society of America.

[48]  O. Bernard,et al.  Plane-Wave Imaging Challenge in Medical Ultrasound , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[49]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Manish Khare,et al.  Despeckling of medical ultrasound images using Daubechies complex wavelet transform , 2010, Signal Process..

[51]  A. Tannenbaum,et al.  Despeckling of medical ultrasound images , 2006, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[52]  Erik Smistad,et al.  Ultrasound Speckle Reduction Using Generative Adversial Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[53]  Bastien Denarie,et al.  Coherent Plane Wave Compounding for Very High Frame Rate Ultrasonography of Rapidly Moving Targets , 2013, IEEE Transactions on Medical Imaging.

[54]  Sevan Harput,et al.  Enhancement of contrast and resolution of B-mode plane wave imaging (PWI) with non-linear filtered delay multiply and sum (FDMAS) beamforming , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).

[55]  Meng-Lin Li,et al.  Improved plane wave imaging with retrospective transmit focusing and weighting based post filtering , 2016, 2016 IEEE International Ultrasonics Symposium (IUS).