AI-based Aortic Vessel Tree Segmentation for Cardiovascular Diseases Treatment: Status Quo

The aortic vessel tree is composed of the aorta and its branching arteries, and plays a key role in supplying the whole body with blood. Aortic diseases, like aneurysms or dissections, can lead to an aortic rupture, whose treatment with open surgery is highly risky. Therefore, patients commonly undergo drug treatment under constant monitoring, which requires regular inspections of the vessels through imaging. The standard imaging modality for diagnosis and monitoring is computed tomography (CT), which can provide a detailed picture of the aorta and its branching vessels if combined with a contrast agent, resulting in a CT angiography (CTA). Optimally, the whole aortic vessel tree geometry from consecutive CTAs, are overlaid and compared. This allows to not only detect changes in the aorta, but also more peripheral vessel tree changes, caused by the primary pathology or newly developed. When performed manually, this reconstruction requires slice by slice contouring, which could easily take a whole day for a single aortic vessel tree and, hence, is not feasible in clinical practice. Automatic or semi-automatic vessel tree segmentation algorithms, on the other hand, can complete this task in a fraction of the manual execution time and run in parallel to the clinical routine of the clinicians. In this paper, we systematically review computing techniques for the automatic and semi-automatic segmentation of the aortic vessel tree. The review concludes with an in-depth discussion on how close these state-of-the-art approaches are to an application in clinical practice and how active this research field is, taking into account the number of publications, datasets and challenges.

[1]  Max A. Viergever,et al.  Model-based segmentation of abdominal aortic aneurysms in CTA images , 2003, SPIE Medical Imaging.

[2]  Gerard J. Tortora,et al.  Principles of Human Anatomy , 1977 .

[3]  Laurent D. Cohen,et al.  Vessel tree extraction using radius-lifted keypoints searching scheme and anisotropic fast marching method , 2016 .

[4]  Pierre-Marc Jodoin,et al.  3D segmentation of abdominal aorta from CT-scan and MR images , 2012, Comput. Medical Imaging Graph..

[5]  Dinggang Shen,et al.  Segmentation of Organs at Risk in thoracic CT images using a SharpMask architecture and Conditional Random Fields , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[6]  Antonio Pepe,et al.  Detection, segmentation, simulation and visualization of aortic dissections: A review , 2020, Medical Image Anal..

[7]  Paulo Amorim,et al.  InVesalius: An Interactive Rendering Framework for Health Care Support , 2015, ISVC.

[8]  David M. Williams,et al.  Sensitivity of the Aortic Dissection Detection Risk Score, a Novel Guideline-Based Tool for Identification of Acute Aortic Dissection at Initial Presentation: Results From the International Registry of Acute Aortic Dissection , 2011, Circulation.

[9]  Horst Bischof,et al.  Segmentation of interwoven 3d tubular tree structures utilizing shape priors and graph cuts , 2010, Medical Image Anal..

[10]  Wang Jianming,et al.  Segmentation of the Aortic Dissection from CT Images Based on Spatial Continuity Prior Model , 2016, 2016 8th International Conference on Information Technology in Medicine and Education (ITME).

[11]  H. Tengg-Kobligk,et al.  Finite element analysis in asymptomatic, symptomatic, and ruptured abdominal aortic aneurysms: in search of new rupture risk predictors. , 2015, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[12]  Max A. Viergever,et al.  Active-shape-model-based segmentation of abdominal aortic aneurysms in CTA images , 2002, SPIE Medical Imaging.

[13]  Hongkun Zhang,et al.  Multi-stage learning for segmentation of aortic dissections using a prior aortic anatomy simplification , 2020, Medical Image Anal..

[14]  A. Bharath,et al.  Automated analysis and detection of abnormalities in transaxial anatomical cardiovascular magnetic resonance images: a proof of concept study with potential to optimize image acquisition , 2020, The International Journal of Cardiovascular Imaging.

[15]  D. Alexander,et al.  A Computationally Efficient Approach to Segmentation of the Aorta and Coronary Arteries Using Deep Learning , 2021, IEEE Access.

[16]  A. Hager,et al.  Coarctation Long-term Assessment (COALA): significance of arterial hypertension in a cohort of 404 patients up to 27 years after surgical repair of isolated coarctation of the aorta, even in the absence of restenosis and prosthetic material. , 2007, The Journal of thoracic and cardiovascular surgery.

[17]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[18]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ronan Collobert,et al.  Learning to Refine Object Segments , 2016, ECCV.

[21]  S. Lemaire,et al.  Epidemiology of thoracic aortic dissection , 2011, Nature Reviews Cardiology.

[22]  Yang Gao,et al.  A Three-Dimensional Deep Convolutional Neural Network for Automatic Segmentation and Diameter Measurement of Type B Aortic Dissection , 2020, Korean journal of radiology.

[23]  Su-Lin Lee,et al.  Intravascular Imaging and Computer Assisted Stenting, and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis , 2017, Lecture Notes in Computer Science.

[24]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[25]  Ronald M. Summers,et al.  A large annotated medical image dataset for the development and evaluation of segmentation algorithms , 2019, ArXiv.

[26]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[27]  H.C. Kim,et al.  A Study of AAA Image Segmentation Technique using Geometric Active Contour Model with Morphological Gradient Edge Function , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Daniel Rueckert,et al.  Automatic tracking of the aorta in cardiovascular MR images using deformable models , 1997, IEEE Transactions on Medical Imaging.

[29]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[30]  David Cai,et al.  Outflow Boundary Conditions for Blood Flow in Arterial Trees , 2015, PloS one.

[31]  Frédérique Frouin,et al.  Automated segmentation of the aorta from phase contrast MR images: Validation against expert tracing in healthy volunteers and in patients with a dilated aorta , 2010, Journal of magnetic resonance imaging : JMRI.

[32]  Marcel Breeuwer,et al.  Segmentation of thrombus in abdominal aortic aneurysms from CTA with nonparametric statistical grey level appearance modeling , 2005, IEEE Transactions on Medical Imaging.

[33]  J. Reiber,et al.  Automatic detection of aorto-femoral vessel trajectory from whole-body computed tomography angiography data sets , 2016, The International Journal of Cardiovascular Imaging.

[34]  Bernd Freisleben,et al.  A Fast Vessel Centerline Extraction Algorithm for Catheter Simulation , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[35]  Jan D'hooge,et al.  A competitive strategy for atrial and aortic tract segmentation based on deformable models , 2017, Medical Image Anal..

[36]  Rifki Kosasih,et al.  Automatic Segmentation of Abdominal Aortic Aneurism (AAA) By Using Active Contour Models , 2020, Scientific Journal of Informatics.

[37]  E Sorantin,et al.  3-D image analysis of abdominal aortic aneurysm. , 2000, Studies in health technology and informatics.

[38]  Martin Auer,et al.  Reconstruction and Finite Element Mesh Generation of Abdominal Aortic Aneurysms From Computerized Tomography Angiography Data With Minimal User Interactions , 2010, IEEE Transactions on Medical Imaging.

[39]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[40]  H P Meinzer,et al.  Statistical tracking of tree-like tubular structures with efficient branching detection in 3D medical image data , 2012, Physics in medicine and biology.

[41]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[42]  Michele Conti,et al.  3D Automatic Segmentation of Aortic Computed Tomography Angiography Combining Multi-View 2D Convolutional Neural Networks , 2020, Cardiovascular Engineering and Technology.

[43]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Sven Loncaric,et al.  3-D deformable model for abdominal aortic aneurysm segmentation from CT images , 2000, IWISPA 2000. Proceedings of the First International Workshop on Image and Signal Processing and Analysis. in conjunction with 22nd International Conference on Information Technology Interfaces. (IEEE.

[45]  Leo Joskowicz,et al.  Carotid vasculature modeling from patient CT angiography studies for interventional procedures simulation , 2012, International Journal of Computer Assisted Radiology and Surgery.

[46]  Bernd Freisleben,et al.  Aorta Segmentation for Stent Simulation , 2011, ArXiv.

[47]  Marleen de Bruijne,et al.  Automated 3D segmentation and diameter measurement of the thoracic aorta on non-contrast enhanced CT , 2019, European Radiology.

[48]  Zhangxing Bian,et al.  Segmentation of the thoracic aorta using an attention-gated U-Net , 2021, Medical Imaging.

[49]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[50]  Yang Gao,et al.  Lumen Segmentation of Aortic Dissection with Cascaded Convolutional Network , 2018, STACOM@MICCAI.

[51]  Mikhail Belyaev,et al.  Segthor: Segmentation of Thoracic Organs at Risk in CT Images , 2019, SegTHOR@ISBI.

[52]  Elena De Momi,et al.  Blood vessel segmentation algorithms - Review of methods, datasets and evaluation metrics , 2018, Comput. Methods Programs Biomed..

[53]  Karl Rohr,et al.  Model-Based Segmentation and Motion Analysis of the Thoracic Aorta from 4D ECG-Gated CTA Images , 2011, MICCAI.

[54]  Paul Suetens,et al.  Segmentation of liver portal veins by global optimization , 2010, Medical Imaging.

[55]  C. Nair,et al.  Clinical, diagnostic, and management perspectives of aortic dissection. , 2002, Chest.

[56]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[57]  K. Nikolaou,et al.  Fully Automated Segmentation and Shape Analysis of the Thoracic Aorta in Non–contrast-enhanced Magnetic Resonance Images of the German National Cohort Study , 2020, Journal of thoracic imaging.

[58]  Anthony P. Reeves,et al.  Automated aorta segmentation in low-dose chest CT images , 2014, International Journal of Computer Assisted Radiology and Surgery.

[59]  Karl Rohr,et al.  3D segmentation of vessels by incremental implicit polynomial fitting and convex optimization , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[60]  Antonio Pepe,et al.  A patch-based-approach for aortic landmarking , 2021 .

[61]  J. Sethian,et al.  Fast methods for the Eikonal and related Hamilton- Jacobi equations on unstructured meshes. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[63]  Lei Xing,et al.  Fully automatic segmentation of type B aortic dissection from CTA images enabled by deep learning. , 2019, European journal of radiology.

[64]  Jorge Juan Suárez-Cuenca,et al.  A hybrid method based on level set and 3D region growing for segmentation of the thoracic aorta , 2013, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[65]  Antonio Pepe,et al.  Deep learning and particle filter-based aortic dissection vessel tree segmentation , 2021 .

[66]  T van Walsum,et al.  Evaluation of a multi-atlas based method for segmentation of cardiac CTA data: a large-scale, multicenter, and multivendor study. , 2010, Medical physics.

[67]  Leo Grady,et al.  Semi-automatic aortic aneurysm analysis , 2007, SPIE Medical Imaging.

[68]  Mario Ceresa,et al.  Fully automatic detection and segmentation of abdominal aortic thrombus in post‐operative CTA images using Deep Convolutional Neural Networks , 2018, Medical Image Anal..

[69]  C. Nienaber The role of imaging in acute aortic syndromes. , 2013, European heart journal cardiovascular Imaging.

[70]  Yue Zhang,et al.  Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black‐blood MRI with a registration based geodesic active contour model , 2017, Medical Image Anal..

[71]  Krishna Subramanyan,et al.  Automatic aortic vessel tree extraction and thrombus detection in multislice CT , 2003, SPIE Medical Imaging.

[72]  Petter Dyverfeldt,et al.  Atlas-based analysis of 4D flow CMR: Automated vessel segmentation and flow quantification , 2015, Journal of Cardiovascular Magnetic Resonance.

[73]  G. Koutouzi,et al.  3D Image Fusion to Localise Intercostal Arteries During TEVAR , 2017, EJVES short reports.

[74]  Raúl San José Estépar,et al.  Automated quantitative 3D analysis of aorta size, morphology, and mural calcification distributions. , 2015, Medical physics.

[75]  T. Boskamp,et al.  New vessel analysis tool for morphometric quantification and visualization of vessels in CT and MR imaging data sets. , 2004, Radiographics : a review publication of the Radiological Society of North America, Inc.

[76]  Cheng Wang,et al.  Towards Automatic Measurement of Type B Aortic Dissection Parameters: Methods, Applications and Perspective , 2018, CVII-STENT/LABELS@MICCAI.

[77]  B. Das,et al.  Aortic Thrombus Segmentation using Narrow Band Active Contour Model , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[78]  M. M. Kristein Human Biology & Health , 1990, The Quarterly Review of Biology.

[79]  Stefan Klein,et al.  Semiautomatic carotid lumen segmentation for quantification of lumen geometry in multispectral MRI , 2012, Medical Image Anal..

[80]  M. Cadioli,et al.  Automatic extraction of three‐dimensional thoracic aorta geometric model from phase contrast MRI for morphometric and hemodynamic characterization , 2016, Magnetic resonance in medicine.

[81]  Michael B. Scott,et al.  Fully automated 3D aortic segmentation of 4D flow MRI for hemodynamic analysis using deep learning , 2020, Magnetic resonance in medicine.

[82]  Sanghoon Lee,et al.  Enhanced particle-filtering framework for vessel segmentation and tracking , 2017, Comput. Methods Programs Biomed..

[83]  K. Eagle,et al.  Acute Aortic Intramural Hematoma: An Analysis From the International Registry of Acute Aortic Dissection , 2012, Circulation.

[84]  Gabriel Mistelbauer,et al.  CT-based True- and False-Lumen Segmentation in Type B Aortic Dissection Using Machine Learning. , 2020, Radiology. Cardiothoracic imaging.

[85]  A. Aletras,et al.  A new vessel segmentation algorithm for robust blood flow quantification from two‐dimensional phase‐contrast magnetic resonance images , 2019, Clinical physiology and functional imaging.

[86]  Karl Krissian,et al.  Semi-automatic segmentation and detection of aorta dissection wall in MDCT angiography , 2014, Medical Image Anal..

[87]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[88]  M. Alper Selver,et al.  Implementation and use of 3D pairwise geodesic distance fields for seeding abdominal aortic vessels , 2016, International Journal of Computer Assisted Radiology and Surgery.

[89]  Daniel Santana-Cedrés,et al.  Automatic estimation of the aortic lumen geometry by ellipse tracking , 2018, International Journal of Computer Assisted Radiology and Surgery.

[90]  A. Bolger Aortic intramural haematoma , 2008, Heart.

[91]  Gernot Brockmann,et al.  Automatic Aorta Segmentation and Valve Landmark Detection in C-Arm CT: Application to Aortic Valve Implantation , 2010, MICCAI.

[92]  S. Napel,et al.  An abdominal aortic aneurysm segmentation method: level set with region and statistical information. , 2006, Medical physics.

[93]  Pascal Fua,et al.  Simultaneous segmentation and anatomical labeling of the cerebral vasculature , 2016, Medical Image Anal..

[94]  JJ Gómez de Diego Comments on the 2014 ESC guidelines on the diagnosis and treatment of aortic diseases. , 2015, Revista espanola de cardiologia.

[95]  Bernd Freisleben,et al.  PREOPERATIVE MEASUREMENT OF ANEURYSMS AND STENOSIS AND STENTSIMULATION FOR ENDOVASCULAR TREATMENT , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[96]  Proceedings of the 2019 Challenge on Segmentation of THoracic Organs at Risk in CT Images, SegTHOR@ISBI 2019, April 8, 2019 , 2019, SegTHOR@ISBI.

[97]  Christopher Nimsky,et al.  Modeling and visualization techniques for virtual stenting of aneurysms and stenoses , 2012, Comput. Medical Imaging Graph..

[98]  Horst Bischof,et al.  A Novel Robust Tube Detection Filter for 3D Centerline Extraction , 2005, SCIA.

[99]  V. K. Govindan,et al.  Improved multiscale matched filter for retina vessel segmentation using PSO algorithm , 2015 .

[100]  Eric D Morris,et al.  Cardiac Substructure Segmentation and Dosimetry Using a Novel Hybrid Magnetic Resonance and Computed Tomography Cardiac Atlas. , 2019, International journal of radiation oncology, biology, physics.

[101]  Cédric Adam,et al.  A fully automated pipeline for mining abdominal aortic aneurysm using image segmentation , 2019, Scientific Reports.