Deep data compression for approximate ultrasonic image formation

In many ultrasonic imaging systems, data acquisition and image formation are performed on separate computing devices. Data transmission is becoming a bottleneck, thus, efficient data compression is essential. Compression rates can be improved by considering the fact that many image formation methods rely on approximations of wave-matter interactions, and only use the corresponding part of the data. Tailored data compression could exploit this, but extracting the useful part of the data efficiently is not always trivial. In this work, we tackle this problem using deep neural networks, optimized to preserve the image quality of a particular image formation method. The Delay-And-Sum (DAS) algorithm is examined which is used in reflectivity-based ultrasonic imaging. We propose a novel encoder-decoder architecture with vector quantization and formulate image formation as a network layer for end-to-end training. Experiments demonstrate that our proposed data compression tailored for a specific image formation method obtains significantly better results as opposed to compression agnostic to subsequent imaging. We maintain high image quality at much higher compression rates than the theoretical lossless compression rate derived from the rank of the linear imaging operator. This demonstrates the great potential of deep ultrasonic data compression tailored for a specific image formation method.

[1]  P. Wilcox,et al.  Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation , 2005 .

[2]  Muyinatu A. Lediju Bell,et al.  Deep Learning to Obtain Simultaneous Image and Segmentation Outputs From a Single Input of Raw Ultrasound Channel Data , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[3]  Yonina C. Eldar,et al.  Fourier-domain beamforming: the path to compressed ultrasound imaging , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Wei Shen,et al.  Weight Standardization , 2019, ArXiv.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[7]  Massimo Mischi,et al.  Learning Sub-Sampling and Signal Recovery With Applications in Ultrasound Imaging , 2020, IEEE Transactions on Medical Imaging.

[8]  Jong Chul Ye,et al.  Adaptive and Compressive Beamforming Using Deep Learning for Medical Ultrasound , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[9]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[10]  Jean-Philippe Thiran,et al.  A deep learning approach to ultrasound image recovery , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[11]  Yonina C. Eldar,et al.  Deep Learning for Fast Adaptive Beamforming , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Oriol Vinyals,et al.  Neural Discrete Representation Learning , 2017, NIPS.

[13]  G. Blacquière,et al.  Inverse wave field extrapolation: a different NDI approach to imaging defects , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Jianwen Luo,et al.  A Compressed Sensing Strategy for Synthetic Transmit Aperture Ultrasound Imaging , 2017, IEEE Transactions on Medical Imaging.

[15]  Mickael Tanter,et al.  Ultrafast imaging in biomedical ultrasound , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[16]  Denis Friboulet,et al.  Compressed Sensing Reconstruction of 3D Ultrasound Data Using Dictionary Learning and Line-Wise Subsampling , 2015, IEEE Transactions on Medical Imaging.