Automated Stenosis Detection and Classification in X-ray Angiography Using Deep Neural Network

This paper proposes a deep-learning based workflow for stenosis classification and localization on coronary angiography images of 194 patients from a multi-center study. Coronary stenosis severities were categorized into three groups of <25% stenosis, 25 to 99% stenosis, total occlusion as 3-CAT and two groups of <25% stenosis, >25% stenosis as 2-CAT for classification training labels; and stenosis bounding boxes were annotated in images as stenosis localization labels, based on expert physician's visual reading on right coronary artery (RCA) and left coronary artery (LCA) images with full contrast filling of the coronary artery. CNN and recurrent neural network models were employed for coronary artery view classification, candidate frame selection and stenosis classification. Furthermore, stenosis activation maps were implemented for weakly-supervised stenoses positioning. In experiments, our method achieved 0.91/0.85 AUC values for 3-CAT stenosis classification in RCA and LCA respectively; and 0.91/0.87 AUC values for 2-CAT classification in RCA and LCA respectively. For stenosis detection on most significant regions, sensitivity for RCA/LCA were 0.72/0.60 respectively; and mean square error between detection and ground-truth center points were 69.6/79.5 pixels for RCA/LCA in image with size of $512^{\ast}512$. The results show our method achieves high performance in stenosis severity classification and performs reasonably well for stenosis positioning.

[1]  Kostas Delibasis,et al.  Automatic model-based tracing algorithm for vessel segmentation and diameter estimation , 2010, Comput. Methods Programs Biomed..

[2]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Dorin Comaniciu,et al.  Robust and Fast Contrast Inflow Detection for 2D X-ray Fluoroscopy , 2011, MICCAI.

[5]  Ke Zhang,et al.  Video Summarization with Long Short-Term Memory , 2016, ECCV.

[6]  David Beymer,et al.  Automatic detection of coronary stenosis in X-ray angiography through spatio-temporal tracking , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[7]  Karen Drukker,et al.  LUNGx Challenge for computerized lung nodule classification , 2016, Journal of medical imaging.

[8]  Max A. Viergever,et al.  A Recurrent CNN for Automatic Detection and Classification of Coronary Artery Plaque and Stenosis in Coronary CT Angiography , 2018, IEEE Transactions on Medical Imaging.

[9]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[11]  Til Aach,et al.  Fast Detection and Processing of Arbitrary Contrast Agent Injections in Coronary Angiography and Fluoroscopy , 2004, Bildverarbeitung für die Medizin.

[12]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Max A. Viergever,et al.  Automatic Coronary Calcium Scoring in Cardiac CT Angiography Using Convolutional Neural Networks , 2015, MICCAI.

[14]  F. Rybicki,et al.  Diagnostic performance of combined noninvasive coronary angiography and myocardial perfusion imaging using 320 row detector computed tomography: design and implementation of the CORE320 multicenter, multinational diagnostic study. , 2011, Journal of cardiovascular computed tomography.

[15]  J. Leipsic,et al.  Coronary CT Angiography-Derived Fractional Flow Reserve , 2016, Current Radiology Reports.

[16]  Jaesoon Choi,et al.  Segmentation of the Main Vessel of the Left Anterior Descending Artery Using Selective Feature Mapping in Coronary Angiography , 2019, IEEE Access.

[17]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[18]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2019 Update: A Report From the American Heart Association , 2019, Circulation.

[19]  M. Stadius,et al.  The angiographie definitions of the Bypass Angioplasty Revascularization Investigation , 1992 .

[20]  N. Paul,et al.  Perioperative β-Blockers : Use With Caution Perioperative β Blockers in Patients Having Non-Cardiac Surgery : A Meta-Analysis , 2010 .

[21]  Mohammad H. Jafari,et al.  Vessel extraction in X-ray angiograms using deep learning , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  C. Toumoulin,et al.  Coronary extraction and stenosis quantification in X-ray angiographic imaging , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Sergio Escalera,et al.  Accurate Coronary Centerline Extraction, Caliber Estimation, and Catheter Detection in Angiographies , 2012, IEEE Transactions on Information Technology in Biomedicine.

[24]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Dorin Comaniciu,et al.  Detection, Grading and Classification of Coronary Stenoses in Computed Tomography Angiography , 2011, MICCAI.

[26]  Hua Ma,et al.  Fast Prospective Detection of Contrast Inflow in X-ray Angiograms with Convolutional Neural Network and Recurrent Neural Network , 2017, MICCAI.

[27]  Mostafa Mirhassani Seyed,et al.  Detection of Narrowed Coronary Arteries in X-ray Angiographic Images using Contour processing of Segmented Heart Vessels based on Hessian Vesselness Filter and Wavelet based Image Fusion , 2011 .

[28]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Babak Movassaghi,et al.  Determination of optimal viewing regions for X-ray coronary angiography based on a quantitative analysis of 3D reconstructed models , 2008, The International Journal of Cardiovascular Imaging.

[30]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Max A. Viergever,et al.  Deep learning analysis of the myocardium in coronary CT angiography for identification of patients with functionally significant coronary artery stenosis , 2017, Medical Image Anal..

[32]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[33]  Mohammad H. Jafari,et al.  Segmentation of vessels in angiograms using convolutional neural networks , 2018, Biomed. Signal Process. Control..