qULM-DL: Quantitative Ultrasound Localization Microscopy via Deep Learning

Ultrasound localization microscopy (ULM) has been developed in recent years to significantly improve the spatial resolution of ultrasound imaging by localizing the microbubbles (MBs) flowing in microvasculature. Nevertheless, challenges remain in ULM. In our previous work (IEEE Trans. Med. Imaging, 10.1109/TMI.2020.2986781), by using a modified sub-pixel convolutional neural network (CNN), we have implemented ULM with fast data-processing speed, high imaging accuracy, short data-acquisition time, and high flexibility characteristics. However, the signal intensities of MBs are not quantitatively recovered, as similar to many other ULM techniques. To overcome this limitation, in this work, we propose a new deep-learning (DL) method, termed as qULM-DL, to recover the true distributions (positions and intensities) of the MBs in ULM. A series of numerical simulations and in vivo experiment are performed to evaluate the performance of qULM-DL. The results show that qULM-DL can not only super-resolve the complex structures but also quantitatively recover MBs intensities in these structures.

[1]  Yonina C. Eldar,et al.  Super-Resolution Ultrasound Localization Microscopy Through Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[2]  Mickael Tanter,et al.  Super-resolution Ultrasound Imaging. , 2020, Ultrasound in medicine & biology.

[3]  Armando Manduca,et al.  Improved Super-Resolution Ultrasound Microvessel Imaging With Spatiotemporal Nonlocal Means Filtering and Bipartite Graph-Based Microbubble Tracking , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[4]  Jun Hong Park,et al.  Deep Learning-Based Super-resolution Ultrasound Speckle Tracking Velocimetry. , 2020, Ultrasound in medicine & biology.

[5]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[6]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  D. Reeve.  Diagnostic Ultrasound: Physics and Equipment , 2012, The Journal of Nuclear Medicine.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  M. Tanter,et al.  Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging , 2015, Nature.

[10]  Yonina C. Eldar,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[11]  C Dunsby,et al.  Acoustic super-resolution with ultrasound and microbubbles , 2013, Physics in medicine and biology.

[12]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[13]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[14]  Leslie Ying,et al.  Artificial Neural Network Enhanced Bayesian PET Image Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[15]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[16]  Yonina C. Eldar,et al.  SUSHI: Sparsity-Based Ultrasound Super-Resolution Hemodynamic Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[19]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[20]  Jianwen Luo,et al.  Deep Learning for Ultrasound Localization Microscopy , 2020, IEEE Transactions on Medical Imaging.