Automated Artery Localization and Vessel Wall Segmentation Using Tracklet Refinement and Polar Conversion

Quantitative analysis of blood vessel wall structures is important to study atherosclerotic diseases and assess cardiovascular event risks. To achieve this, accurate identification of vessel luminal and outer wall contours is needed. Computer-assisted tools exist, but manual preprocessing steps, such as region of interest identification and/or boundary initialization, are still needed. In addition, prior knowledge of the ring shape of vessel walls has not been fully explored in designing segmentation methods. In this work, a fully automated artery localization and vessel wall segmentation system is proposed. A tracklet refinement algorithm was adapted to robustly identify the artery of interest from a neural network-based artery centerline identification architecture. Image patches were extracted from the centerlines and converted in a polar coordinate system for vessel wall segmentation. The segmentation method used 3D polar information and overcame problems such as contour discontinuity, complex vessel geometry, and interference from neighboring vessels. Verified by a large (>32000 images) carotid artery dataset collected from multiple sites, the proposed system was shown to better automatically segment the vessel wall than traditional vessel wall segmentation methods or standard convolutional neural network approaches. In addition, a segmentation uncertainty score was estimated to effectively identify slices likely to have errors and prompt manual confirmation of the segmentation. This robust vessel wall segmentation system has applications in different vascular beds and will facilitate vessel wall feature extraction and cardiovascular risk assessment.

[1]  Jenq-Neng Hwang,et al.  Development of a quantitative intracranial vascular features extraction tool on 3D MRA using semiautomated open‐curve active contour vessel tracing , 2017, Magnetic resonance in medicine.

[2]  Ronald van 't Klooster,et al.  Automatic lumen and outer wall segmentation of the carotid artery using deformable three‐dimensional models in MR angiography and vessel wall images , 2012, Journal of magnetic resonance imaging : JMRI.

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Chun Yuan,et al.  In vivo semi-automatic segmentation of multicontrast cardiovascular magnetic resonance for prospective cohort studies on plaque tissue composition: initial experience , 2015, The International Journal of Cardiovascular Imaging.

[5]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[6]  Yuning Jiang,et al.  UnitBox: An Advanced Object Detection Network , 2016, ACM Multimedia.

[7]  John A. Carrino,et al.  3T MR Imaging of Cartilage using 3D Dual Echo Steady State (DESS) , 2011 .

[8]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[9]  Theo van Walsum,et al.  Segmentation of the Outer Vessel Wall of the Common Carotid Artery in CTA , 2010, IEEE Transactions on Medical Imaging.

[10]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Matthew D. Robson,et al.  Arterial Effects of Canakinumab in Patients With Atherosclerosis and Type 2 Diabetes or Glucose Intolerance , 2016, Journal of the American College of Cardiology.

[13]  R van 't Klooster,et al.  Carotid wall volume quantification from magnetic resonance images using deformable model fitting and learning-based correction of systematic errors , 2013, Physics in medicine and biology.

[14]  Chun Yuan,et al.  Carotid Artery Remodeling Is Segment Specific: An In Vivo Study by Vessel Wall Magnetic Resonance Imaging , 2018, Arteriosclerosis, thrombosis, and vascular biology.

[15]  Joel D. Morrisett,et al.  Algorithm for quantifying advanced carotid artery atherosclerosis in humans using MRI and active contours , 2002, SPIE Medical Imaging.

[16]  Ronald van 't Klooster,et al.  Quantification of common carotid artery and descending aorta vessel wall thickness from MR vessel wall imaging using a fully automated processing pipeline , 2017, Journal of magnetic resonance imaging : JMRI.

[17]  Max A. Viergever,et al.  A Recurrent CNN for Automatic Detection and Classification of Coronary Artery Plaque and Stenosis in Coronary CT Angiography , 2018, IEEE Transactions on Medical Imaging.

[18]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Yefeng Zheng,et al.  Robust and Accurate Coronary Artery Centerline Extraction in CTA by Combining Model-Driven and Data-Driven Approaches , 2013, MICCAI.

[20]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Chunhua Shen,et al.  PolarMask: Single Shot Instance Segmentation With Polar Representation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  B. Lacey,et al.  Epidemiology of Atherosclerosis and the Potential to Reduce the Global Burden of Atherothrombotic Disease. , 2016, Circulation research.

[23]  Marleen de Bruijne,et al.  Maximization of regional probabilities using Optimal Surface Graphs: Application to carotid artery segmentation in MRI , 2018, Medical physics.

[24]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[25]  C Yuan,et al.  Closed contour edge detection of blood vessel lumen and outer wall boundaries in black-blood MR images. , 1999, Magnetic resonance imaging.

[26]  J. Bartko Measurement and reliability: statistical thinking considerations. , 1991, Schizophrenia bulletin.

[27]  Chun Yuan,et al.  Understanding Atherosclerosis Through an Osteoarthritis Data Set. , 2019, Arteriosclerosis, thrombosis, and vascular biology.

[28]  Yoshiro Kitamura,et al.  Automatic coronary extraction by supervised detection and shape matching , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Gador Canton,et al.  Fully automated and robust analysis technique for popliteal artery vessel wall evaluation (FRAPPE) using neural network models from standardized knee MRI , 2020, Magnetic resonance in medicine.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Jenq-Neng Hwang,et al.  Automatic Segmentation of Carotid Vessel Wall Using Convolutional Neural Network , 2017 .

[33]  Jeroen J. Bax,et al.  Automatic centerline extraction of coronary arteries in coronary computed tomographic angiography , 2011, The International Journal of Cardiovascular Imaging.

[34]  Chun Yuan,et al.  Carotid magnetic resonance imaging for monitoring atherosclerotic plaque progression: a multicenter reproducibility study , 2014, The International Journal of Cardiovascular Imaging.

[35]  Mohammad H. Jafari,et al.  Segmentation of vessels in angiograms using convolutional neural networks , 2018, Biomed. Signal Process. Control..

[36]  Rui Li,et al.  Chinese Atherosclerosis Risk Evaluation (CARE II) study: a novel cross-sectional, multicentre study of the prevalence of high-risk atherosclerotic carotid plaque in Chinese patients with ischaemic cerebrovascular events—design and rationale , 2017, Stroke and Vascular Neurology.

[37]  Chun Yuan,et al.  Subclinical carotid atherosclerosis: short-term natural history of lipid-rich necrotic core--a multicenter study with MR imaging. , 2013, Radiology.

[38]  Thomas S. Hatsukami,et al.  3D intracranial artery segmentation using a convolutional autoencoder , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[39]  Masako Nishikawa,et al.  Atorvastatin, Etidronate, or Both in Patients at High Risk for Atherosclerotic Aortic Plaques: A Randomized, Controlled Trial , 2013, Circulation.

[40]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[41]  Marleen de Bruijne,et al.  Increasing Accuracy of Optimal Surfaces Using Min-Marginal Energies , 2019, IEEE Transactions on Medical Imaging.

[42]  Richard D. White,et al.  Automated coronary artery atherosclerosis detection and weakly supervised localization on coronary CT angiography with a deep 3-dimensional convolutional neural network , 2019, Comput. Medical Imaging Graph..

[43]  Boudewijn P F Lelieveldt,et al.  Automated Contour Detection in Cardiac MRI Using Active Appearance Models: The Effect of the Composition of the Training Set , 2007, Investigative radiology.

[44]  Chun Yuan,et al.  Automated measurement of mean wall thickness in the common carotid artery by MRI: A comparison to intima‐media thickness by B‐mode ultrasound , 2006, Journal of magnetic resonance imaging : JMRI.

[45]  Cory Swingen,et al.  MRI measurements of carotid plaque in the atherosclerosis risk in communities (ARIC) study: Methods, reliability and descriptive statistics , 2010, Journal of magnetic resonance imaging : JMRI.

[46]  Chun Yuan,et al.  Three-Dimensional Carotid Plaque MR Imaging. , 2016, Neuroimaging clinics of North America.

[47]  Peter R Luijten,et al.  Imaging Intracranial Vessel Wall Pathology With Magnetic Resonance Imaging: Current Prospects and Future Directions , 2014, Circulation.

[48]  Arna van Engelen,et al.  Carotid Artery Wall Segmentation in Multispectral MRI by Coupled Optimal Surface Graph Cuts , 2016, IEEE Transactions on Medical Imaging.