Modelling and extraction of pulsatile radial distension and compression motion for automatic vessel segmentation from video

HighlightsWe automatically segment blood vessels by extracting and modelling motion from video.Our method works on pulsating vessels imaged along transverse and longitudinal axes.Our low‐level approach is fast and does not rely on complex appearance modelling.We implement our proposed pipeline using 4 different motion estimation techniques.Our implementations are validated on 2 ultrasound datasets containing 8+35 sequences. Graphical abstract Figure. No caption available. &NA; Identification of vascular structures from medical images is integral to many clinical procedures. Most vessel segmentation techniques ignore the characteristic pulsatile motion of vessels in their formulation. In a recent effort to automatically segment vessels that are hidden under fat, we motivated the use of the magnitude of local pulsatile motion extracted from surgical endoscopic video. In this article we propose a new approach that leverages the local orientation, in addition to magnitude of motion, and demonstrate that the extended computation and utilization of motion vectors can improve the segmentation of vascular structures. We implement our approach using four alternatives to magnitude‐only motion estimation by using traditional optical flow and by exploiting the monogenic signal for fast flow estimation. Our evaluations are conducted on both synthetic phantoms as well as two real ultrasound datasets showing improved segmentation results with negligible change in computational performance compared to the previous magnitude only approach.

[1]  Vincent Lepetit,et al.  Accurate and Efficient Linear Structure Segmentation by Leveraging Ad Hoc Features with Learned Filters , 2012, MICCAI.

[2]  Andreas Raabe,et al.  Three-dimensional rotational angiography guidance for aneurysm surgery. , 2006, Journal of neurosurgery.

[3]  Dongmei Fu,et al.  Detection of artery section area using artificial immune system algorithm , 2008 .

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[6]  R. Klein,et al.  Retinal microvascular abnormalities and incident stroke: the Atherosclerosis Risk in Communities Study , 2001, The Lancet.

[7]  S. C. Johnston,et al.  Evaluation of carotid stenosis using CT angiography in the initial evaluation of stroke and TIA , 2004, Neurology.

[8]  Stefan Klein,et al.  Automatic carotid artery distensibility measurements from CTA using nonrigid registration , 2013, Medical Image Anal..

[9]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[10]  Peter Kovesi,et al.  Invariant measures of image features from phase information , 1996 .

[11]  S. Laurent,et al.  Aortic Stiffness Is an Independent Predictor of Fatal Stroke in Essential Hypertension , 2003, Stroke.

[12]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[13]  Bjarne K. Ersbøll,et al.  Quantitative measurement of changes in retinal vessel diameter in ocular fundus images , 2000, Pattern Recognit. Lett..

[14]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[16]  Marleen de Bruijne,et al.  Robust Shape Regression for Supervised Vessel Segmentation and its Application to Coronary Segmentation in CTA , 2011, IEEE Transactions on Medical Imaging.

[17]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[18]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[19]  Frans Vos,et al.  A model based method for retinal blood vessel detection , 2004, Comput. Biol. Medicine.

[20]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[21]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[22]  N. Thakor,et al.  Contrast-enhanced imaging of cerebral vasculature with laser speckle. , 2007, Applied optics.

[23]  J. Kastelein,et al.  In Vivo Quantification of Carotid Artery Wall Dimensions: 3.0-Tesla MRI Versus B-Mode Ultrasound Imaging , 2009, Circulation. Cardiovascular imaging.

[24]  Kamil Říha,et al.  The sequential detection of artery sectional area using optical flow technique , 2009 .

[25]  R. Cobbold,et al.  A viscoelastic model of arterial wall motion in pulsatile flow: implications for Doppler ultrasound clutter assessment , 2008, Physiological measurement.

[26]  Frédéric Precioso,et al.  Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography , 2013, Medical Image Anal..

[27]  Hani Rashid,et al.  Near infrared fluorescence imaging with robotic assisted laparoscopic partial nephrectomy: initial clinical experience for renal cortical tumors. , 2011, The Journal of urology.

[28]  A. Folsom,et al.  Carotid wall thickness is predictive of incident clinical stroke: the Atherosclerosis Risk in Communities (ARIC) study. , 2000, American journal of epidemiology.

[29]  Michael Brady,et al.  On the Choice of Band-Pass Quadrature Filters , 2004, Journal of Mathematical Imaging and Vision.

[30]  Alban Redheuil,et al.  Aortic stiffness: current understanding and future directions. , 2011, Journal of the American College of Cardiology.

[31]  Joachim Weickert,et al.  Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods , 2005, International Journal of Computer Vision.

[32]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[33]  J. Izatt,et al.  In vivo bidirectional color Doppler flow imaging of picoliter blood volumes using optical coherence tomography. , 1997, Optics letters.

[34]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[35]  Arno W. Hoes,et al.  Common carotid intima-media thickness and risk of stroke and myocardial infarction: the Rotterdam Study. , 1997, Circulation.

[36]  G. Sommer,et al.  The geometry of 2D image signals , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Hisashi Adachi,et al.  Inflammation, atherosclerosis, and coronary artery disease. , 2005, The New England journal of medicine.

[38]  Konstantina S. Nikita,et al.  Graph-Based Motion-Driven Segmentation of the Carotid Atherosclerotique Plaque in 2D Ultrasound Sequences , 2015, MICCAI.

[39]  Terry M. Peters,et al.  Stereoscopic Motion Magnification in Minimally-Invasive Robotic Prostatectomy , 2015, CARE@MICCAI.

[40]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[41]  Michael Unser,et al.  3D steerable wavelets and monogenic analysis for bioimaging , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[42]  Ghassan Hamarneh,et al.  Automatic Vessel Segmentation from Pulsatile Radial Distension , 2015, MICCAI.

[43]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[44]  Michael Felsberg,et al.  The Monogenic Scale-Space: A Unifying Approach to Phase-Based Image Processing in Scale-Space , 2004, Journal of Mathematical Imaging and Vision.

[45]  Olivier Bernard,et al.  Myocardial Motion Estimation From Medical Images Using the Monogenic Signal , 2013, IEEE Transactions on Image Processing.

[46]  I. Kamel,et al.  Impact of multidetector CT on donor selection and surgical planning before living adult right lobe liver transplantation. , 2001, AJR. American journal of roentgenology.

[47]  Radim Burget,et al.  Novel method for localization of common carotid artery transverse section in ultrasound images using modified Viola-Jones detector. , 2013, Ultrasound in medicine & biology.

[48]  Aart J. Nederveen,et al.  In Vivo Quantification of Carotid Artery Wall Dimensions: 3.0 Tesla MRI Versus B-Mode Ultrasound Imaging , 2010 .

[49]  Ghassan Hamarneh,et al.  Vessel Crawlers: 3D Physically-based Deformable Organisms for Vasculature Segmentation and Analysis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[50]  Ghassan Hamarneh,et al.  Automatic segmentation of occluded vasculature via pulsatile motion analysis in endoscopic robot-assisted partial nephrectomy video , 2015, Medical Image Anal..

[51]  Francis K. H. Quek,et al.  Vessel extraction techniques and algorithms: a survey , 2003, Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings..

[52]  Theo van Walsum,et al.  Bayesian Tracking of Elongated Structures in 3D Images , 2007, IPMI.

[53]  Michiel Schaap,et al.  Robust CTA lumen segmentation of the atherosclerotic carotid artery bifurcation in a large patient population , 2010, Medical Image Anal..

[54]  Ghassan Hamarneh,et al.  Auto Localization and Segmentation of Occluded Vessels in Robot-Assisted Partial Nephrectomy , 2014, MICCAI.

[55]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[56]  Rafeef Abugharbieh,et al.  Real-time extraction of local phase features from volumetric medical image data , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[57]  Nassir Navab,et al.  Multi-Scale Tubular Structure Detection in Ultrasound Imaging , 2015, IEEE Transactions on Medical Imaging.

[58]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[59]  Nassir Navab,et al.  The 2D Analytic Signal on RF and B-Mode Ultrasound Images , 2011, IPMI.

[60]  William Grossman,et al.  Cardiac catheterization and angiography , 1974 .

[61]  Michael Felsberg,et al.  Optical Flow Estimation from Monogenic Phase , 2004, IWCM.

[62]  Roberto Marcondes Cesar Junior,et al.  Retinal Vessel Segmentation Using the 2-D Morlet Wavelet and Supervised Classification , 2005, ArXiv.

[63]  T. Maecken,et al.  Ultrasound imaging in vascular access , 2007, Critical care medicine.

[64]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[65]  Ben Glocker,et al.  Graphical Models and Deformable Diffeomorphic Population Registration Using Global and Local Metrics , 2009, MICCAI.

[66]  Olivier D. Faugeras,et al.  CURVES: Curve evolution for vessel segmentation , 2001, Medical Image Anal..

[67]  Kecheng Liu,et al.  A review on MR vascular image processing: skeleton versus nonskeleton approaches: part II , 2002, IEEE Transactions on Information Technology in Biomedicine.

[68]  Kamil Riha,et al.  Circle detection in pulsative medical video sequence , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[69]  D G Mitchell,et al.  Preoperative evaluation of living renal donors: comparison of CT angiography and MR angiography. , 2000, Radiology.

[70]  Marc M. Van Hulle,et al.  Realtime phase-based optical flow on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[71]  Olivier Bernard,et al.  Monogenic Phase Based Optical Flow Computation for Myocardial Motion Analysis in 3D Echocardiography , 2012, STACOM.

[72]  Ronald van 't Klooster,et al.  Quantification of common carotid artery and descending aorta vessel wall thickness from MR vessel wall imaging using a fully automated processing pipeline , 2017, Journal of magnetic resonance imaging : JMRI.

[73]  Terry M. Peters,et al.  Detection and visualization of dural pulsation for spine needle interventions , 2015, International Journal of Computer Assisted Radiology and Surgery.