Deep learning segmentation of major vessels in X-ray coronary angiography

X-ray coronary angiography is a primary imaging technique for diagnosing coronary diseases. Although quantitative coronary angiography (QCA) provides morphological information of coronary arteries with objective quantitative measures, considerable training is required to identify the target vessels and understand the tree structure of coronary arteries. Despite the use of computer-aided tools, such as the edge-detection method, manual correction is necessary for accurate segmentation of coronary vessels. In the present study, we proposed a robust method for major vessel segmentation using deep learning models with fully convolutional networks. When angiographic images of 3302 diseased major vessels from 2042 patients were tested, deep learning networks accurately identified and segmented the major vessels in X-ray coronary angiography. The average F1 score reached 0.917, and 93.7% of the images exhibited a high F1 score > 0.8. The most narrowed region at the stenosis was distinctly captured with high connectivity. Robust predictability was validated for the external dataset with different image characteristics. For major vessel segmentation, our approach demonstrated that prediction could be completed in real time with minimal image preprocessing. By applying deep learning segmentation, QCA analysis could be further automated, thereby facilitating the use of QCA-based diagnostic methods.

[1]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[2]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  William Wijns,et al.  Fractional flow reserve calculation from 3-dimensional quantitative coronary angiography and TIMI frame count: a fast computer model to quantify the functional significance of moderately obstructed coronary arteries. , 2014, JACC. Cardiovascular interventions.

[4]  Krystian Mikolajczyk,et al.  Deep Segmentation and Registration in X-Ray Angiography Video , 2018, BMVC.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[7]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[8]  Nader Karimi,et al.  Vessel segmentation and catheter detection in X-ray angiograms using superpixels , 2018, Medical & Biological Engineering & Computing.

[9]  P. Serruys,et al.  The SYNTAX Score: an angiographic tool grading the complexity of coronary artery disease. , 2005, EuroIntervention : journal of EuroPCR in collaboration with the Working Group on Interventional Cardiology of the European Society of Cardiology.

[10]  Michail I. Papafaklis,et al.  Prediction of Progression of Coronary Artery Disease and Clinical Outcomes Using Vascular Profiling of Endothelial Shear Stress and Arterial Plaque Characteristics: The PREDICTION Study , 2012, Circulation.

[11]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Johan H. C. Reiber,et al.  In vivo comparison of arterial lumen dimensions assessed by co-registered three-dimensional (3D) quantitative coronary angiography, intravascular ultrasound and optical coherence tomography , 2012, The International Journal of Cardiovascular Imaging.

[14]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[15]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Harlan M Krumholz,et al.  Comparison of Physician Visual Assessment With Quantitative Coronary Angiography in Assessment of Stenosis Severity in China , 2018, JAMA internal medicine.

[18]  Hojin Ha,et al.  Impact of coronary lumen reconstruction on the estimation of endothelial shear stress: in vivo comparison of three-dimensional quantitative coronary angiography and three-dimensional fusion combining optical coherent tomography , 2018, European Heart Journal-Cardiovascular Imaging.

[19]  Tae Joon Jun,et al.  T-Net: Nested encoder-decoder architecture for the main vessel segmentation in coronary angiography , 2020, Neural Networks.

[20]  Rangaraj M. Rangayyan,et al.  Automatic segmentation of coronary arteries using Gabor filters and thresholding based on multiobjective optimization , 2016, Biomed. Signal Process. Control..

[21]  Mohammad H. Jafari,et al.  Segmentation of vessels in angiograms using convolutional neural networks , 2018, Biomed. Signal Process. Control..

[22]  Jaesoon Choi,et al.  Segmentation of the Main Vessel of the Left Anterior Descending Artery Using Selective Feature Mapping in Coronary Angiography , 2019, IEEE Access.

[23]  Nicholas Ayache,et al.  Preprocessing : data selection , pseudo ECG III . 3 − D centerlines reconstruction , 2011 .

[24]  Mingxin Jin,et al.  Accurate vessel extraction via tensor completion of background layer in X-ray coronary angiograms , 2019, Pattern Recognit..

[25]  Habib Samady,et al.  Comparison between visual assessment and quantitative angiography versus fractional flow reserve for native coronary narrowings of moderate severity. , 2002, The American journal of cardiology.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Uri Shaham,et al.  Automated Characterization of Stenosis in Invasive Coronary Angiography Images with Convolutional Neural Networks , 2018, ArXiv.

[28]  Heye Zhang,et al.  Direct and simultaneous estimation of cardiac four chamber volumes by multioutput sparse regression , 2017, Medical Image Anal..

[29]  Heye Zhang,et al.  Direct Quantification for Coronary Artery Stenosis Using Multiview Learning , 2019, MICCAI.