Exploiting Flow Dynamics for Superresolution in Contrast-Enhanced Ultrasound

Ultrasound (US) localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles (MBs) with low concentration within the bloodstream reveals the vasculature with capillary resolution. Despite its high spatial resolution, low MB concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single superresolved image. Such long acquisition times and stringent constraints on MB concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable MB overlap. Here, we further improve the spatial resolution and visual vascular reconstruction quality of sparsity-based superresolution US imaging from low-frame rate acquisitions, by exploiting the inherent flow of MBs and utilize their motion kinematics. We also provide quantitative measurements of MB velocities and show that our approach achieves higher MB recall rate than the state-of-the-art techniques, while increasing contrast agents concentration. Our method relies on simultaneous tracking and sparsity-based detection of individual MBs in a frame-by-frame manner, and as such, may be suitable for real-time implementation. The effectiveness of the proposed approach is demonstrated on both simulations and an in vivo contrast-enhanced human prostate scan, acquired with a clinically approved scanner operating at a 10-Hz frame rate.

[1]  Massimo Mischi,et al.  Entropy of Ultrasound-Contrast-Agent Velocity Fields for Angiogenesis Imaging in Prostate Cancer , 2017, IEEE Trans. Medical Imaging.

[2]  S. Shankar Sastry,et al.  Markov Chain Monte Carlo Data Association for Multi-Target Tracking , 2009, IEEE Transactions on Automatic Control.

[3]  James M. Rehg,et al.  Multiple Hypothesis Tracking Revisited , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Alexandre Bernardino,et al.  Multiple Hypothesis Tracking in camera networks , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[5]  Panos M. Pardalos,et al.  An algorithm for finding a maximum weighted independent set in an arbitrary graph , 1991, Int. J. Comput. Math..

[6]  O REN S OLOMON,et al.  Sparsity-based super-resolution microscopy from correlation information , 2018 .

[7]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[8]  Yonina C. Eldar,et al.  SPARCOM: Sparsity Based Super-resolution Correlation Microscopy , 2017, SIAM J. Imaging Sci..

[9]  Paul A. Dayton,et al.  3-D Ultrasound Localization Microscopy for Identifying Microvascular Morphology Features of Tumor Angiogenesis at a Resolution Beyond the Diffraction Limit of Conventional Ultrasound , 2017, Theranostics.

[10]  Yonina C. Eldar,et al.  Sparsity-driven super-resolution in clinical contrast-enhanced ultrasound , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[11]  N de Jong,et al.  Principles and recent developments in ultrasound contrast agents. , 1991, Ultrasonics.

[12]  F. Calliada,et al.  Ultrasound contrast agents: basic principles. , 1998, European journal of radiology.

[13]  M. Tanter,et al.  Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging , 2015, Nature.

[14]  David Miguel Antunes,et al.  A Library for Implementing the Multiple Hypothesis Tracking Algorithm , 2011, ArXiv.

[15]  G. Giannakis,et al.  Compressed sensing of time-varying signals , 2009, 2009 16th International Conference on Digital Signal Processing.

[16]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[17]  Georg Schmitz,et al.  Detection and Tracking of Multiple Microbubbles in Ultrasound B-Mode Images , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[18]  Marc Teboulle,et al.  A fast Iterative Shrinkage-Thresholding Algorithm with application to wavelet-based image deblurring , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Massimo Mischi,et al.  Contrast-Ultrasound Diffusion Imaging for Localization of Prostate Cancer , 2011, IEEE Transactions on Medical Imaging.

[20]  A. Ignee,et al.  Ultrasound contrast agents , 2016, Endoscopic ultrasound.

[21]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[22]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[23]  Yonina C. Eldar,et al.  SUSHI: Sparsity-Based Ultrasound Super-Resolution Hemodynamic Imaging , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[24]  Robert J. Eckersley,et al.  In Vivo Acoustic Super-Resolution and Super-Resolved Velocity Mapping Using Microbubbles , 2015, IEEE Transactions on Medical Imaging.

[25]  S. Feinstein,et al.  The powerful microbubble: from bench to bedside, from intravascular indicator to therapeutic delivery system, and beyond. , 2004, American journal of physiology. Heart and circulatory physiology.

[26]  J. Jensen Estimation of Blood Velocities Using Ultrasound: A Signal Processing Approach , 1996 .

[27]  Ayache Bouakaz,et al.  Development of a Fluid Dynamic Model for Quantitative Contrast-Enhanced Ultrasound Imaging , 2018, IEEE Transactions on Medical Imaging.

[28]  David Cosgrove,et al.  Ultrasound contrast agents: an overview. , 2006, European journal of radiology.

[29]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[30]  Stergios I. Roumeliotis,et al.  Lasso-Kalman smoother for tracking sparse signals , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[31]  Charles Tremblay-Darveau,et al.  Sparsity-based Ultrasound Super-resolution Hemodynamic Imaging , 2017 .

[32]  Katherine W Ferrara,et al.  Ultrasound localization microscopy to image and assess microvasculature in a rat kidney , 2017, Scientific Reports.

[33]  Wei Lu,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, 2009 IEEE International Symposium on Information Theory.

[34]  Yaakov Bar-Shalom,et al.  Multi-target tracking using joint probabilistic data association , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[35]  Massimo Mischi,et al.  Ultrasound‐contrast‐agent dispersion and velocity imaging for prostate cancer localization , 2017, Medical Image Anal..

[36]  George Cybenko,et al.  What is trackable? , 2006, SPIE Defense + Commercial Sensing.

[37]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[38]  Yonina C. Eldar,et al.  Sparsity-driven super-localization in clinical contrast-enhanced ultrasound , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[39]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[40]  Guy M. Hagen,et al.  ThunderSTORM: a comprehensive ImageJ plug-in for PALM and STORM data analysis and super-resolution imaging , 2014, Bioinform..

[41]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[42]  T. Blumensath,et al.  Theory and Applications , 2011 .

[43]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[44]  R M Lang,et al.  Combined Assessment of Myocardial Perfusion and Regional Left Ventricular Function by Analysis of Contrast-Enhanced Power Modulation Images , 2001, Circulation.

[45]  Charles Tremblay-Darveau,et al.  Dynamic contrast enhanced ultrasound for therapy monitoring. , 2015, European journal of radiology.

[46]  Meaghan A. O'Reilly,et al.  A super-resolution ultrasound method for brain vascular mapping. , 2013, Medical physics.

[47]  Yonina C. Eldar,et al.  Sparsity-based super-resolution microscopy from correlation information. , 2018, Optics express.

[48]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[49]  Yonina C. Eldar Sampling Theory: Beyond Bandlimited Systems , 2015 .

[50]  Yonina C. Eldar,et al.  Fast and background free super-resolution ultrasound angiography , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[51]  Carlo Magno,et al.  Contrast-enhanced second-harmonic sonography in the detection of pseudocapsule in renal cell carcinoma. , 2004, AJR. American journal of roentgenology.

[52]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[53]  Yonina C. Eldar,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[54]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[55]  Fabian Kiessling,et al.  Motion model ultrasound localization microscopy for preclinical and clinical multiparametric tumor characterization , 2018, Nature Communications.

[56]  N de Jong,et al.  Detection procedures of ultrasound contrast agents. , 2000, Ultrasonics.