Deep Learning for Super-resolution Vascular Ultrasound Imaging

Based on the intravascular infusion of gas microbubbles, which act as ultrasound contrast agents, ultrasound localization microscopy has enabled super resolution vascular imaging through precise detection of individual microbubbles across numerous imaging frames. However, analysis of high-density regions with significant overlaps among the microbubble point spread functions typically yields high localization errors, constraining the technique to low-concentration conditions. As such, long acquisition times are required for sufficient coverage of the vascular bed. Algorithms based on sparse recovery have been developed specifically to cope with the overlapping point-spread-functions of multiple microbubbles. While successful localization of densely-spaced emitters has been demonstrated, even highly optimized fast sparse recovery techniques involve a time-consuming iterative procedure. In this work, we used deep learning to improve upon standard ultrasound localization microscopy (Deep-ULM), and obtain super-resolution vascular images from high-density contrast-enhanced ultrasound data. Deep-ULM is suitable for real-time applications, resolving about 1250 high-resolution patches (128×128 pixels) per second using GPU acceleration.

[1]  Yonina C. Eldar,et al.  Exploiting Flow Dynamics for Superresolution in Contrast-Enhanced Ultrasound , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[2]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[3]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[4]  M. Tanter,et al.  Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging , 2015, Nature.

[5]  J. Folkman Role of angiogenesis in tumor growth and metastasis. , 2002, Seminars in oncology.

[6]  Robert J. Eckersley,et al.  In Vivo Acoustic Super-Resolution and Super-Resolved Velocity Mapping Using Microbubbles , 2015, IEEE Transactions on Medical Imaging.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  C Dunsby,et al.  Acoustic super-resolution with ultrasound and microbubbles , 2013, Physics in medicine and biology.

[9]  Yonina C. Eldar,et al.  Sparsity-driven super-resolution in clinical contrast-enhanced ultrasound , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[13]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[14]  Yonina C. Eldar,et al.  SUSHI: Sparsity-Based Ultrasound Super-Resolution Hemodynamic Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[15]  Georg Schmitz,et al.  Detection and Tracking of Multiple Microbubbles in Ultrasound B-Mode Images , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[16]  Yonina C. Eldar,et al.  Sparsity-driven super-localization in clinical contrast-enhanced ultrasound , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[17]  Matthew Bruce,et al.  Contrast-enhanced ultrasound to visualize hemodynamic changes after rodent spinal cord injury. , 2018, Journal of neurosurgery. Spine.