Channel Count Reduction for Plane Wave Ultrasound Through Convolutional Neural Network Interpolation

Plane wave ultrasound imaging has helped to achieve high frame rate ultrasound, however the data required to achieve frames rates over 1000 fps remains challenging to handle, as the transfer of large amounts of data represents a bottleneck for image reconstruction. This paper presents a novel method of using a fully convolutional encoder-decoder deep neural network to interpolate pre-beamformed raw RF data from ultrasound transducer elements. The network is trained on in vivo human carotid data, then tested on both carotid data and a standard ultrasound phantom. The neural network outputs are compared to linear interpolation and the proposed method captures more meaningful patterns in the signal; the output channels are then combined with the non-interpolated channels and beamformed to form an image, showing not only significant improvement in mean-squared error compared to the alternatives, but also 10–15 dB reduction in grating lobe artifacts. The proposed method has implications for current ultrasound research directions, with applications to real-time high frame rate ultrasound and 3D ultrasound imaging.

[1]  R. Carotenuto,et al.  Spatial resolution enhancement of ultrasound images using neural networks , 2002, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Piero Tortoli,et al.  Ultrasound Open Platforms for Next-Generation Imaging Technique Development , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[3]  G. Cloutier,et al.  Stolt's f-k migration for plane wave ultrasound imaging , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  M. Fink,et al.  Coherent plane-wave compounding for very high frame rate ultrasonography and transient elastography , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[6]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[7]  Jong Chul Ye,et al.  Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[8]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[9]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Denis Friboulet,et al.  Pre-beamformed RF signal reconstruction in medical ultrasound using compressive sensing. , 2013, Ultrasonics.

[11]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[12]  B. Y. S. Yiu,et al.  GPU-based beamformer: Fast realization of plane wave compounding and synthetic aperture imaging , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.