Multichannel Fully Convolutional Network for Coronary Artery Segmentation in X-Ray Angiograms

Accurate segmentation of coronary arteries in X-ray angiograms is an important step for the quantitative study of coronary artery disease. However, accurate segmentation is a challenging task because coronary arteries are thin tubular structures with relatively low contrast and the presence of artifacts. In this paper, a novel deep-learning-based method is proposed to automatically segment the coronary artery from angiograms by using multichannel fully convolutional networks. Since the artifacts appear in both live images (after the injection of contrast material) and mask images (before the injection of contrast material) and the blood vessels appear only in live images, we take the mask images into consideration to distinguish real blood vessel structures from artifacts. Therefore, both live images and mask images are used as multichannel inputs to provide enhanced vascular structure information. The hierarchical features are then automatically learned to characterize the spatial associations between vessel and background and are further used to achieve the final segmentation. In addition, a dense matching between the live image and mask image is processed for a precise initial alignment. The experimental results demonstrate that our method is effective and robust for coronary artery segmentation, compared with several state-of-the-art methods.

[1]  Hamid Soltanian-Zadeh,et al.  Local feature fitting active contour for segmenting vessels in angiograms , 2014, IET Comput. Vis..

[2]  Rong Li,et al.  Extracting contrast-filled vessels in X-ray angiography by graduated RPCA with motion coherency constraint , 2017, Pattern Recognit..

[3]  Mohamed Cheriet,et al.  A new adaptive framework for tubular structures segmentation in X-ray angiography , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[4]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Cordelia Schmid,et al.  DeepMatching: Hierarchical Deformable Dense Matching , 2015, International Journal of Computer Vision.

[7]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[9]  Jianhuang Wu,et al.  A Novel Method of Vessel Segmentation for X-ray Coronary Angiography Images , 2012, 2012 Fourth International Conference on Computational and Information Sciences.

[10]  Max W. K. Law,et al.  Efficient Implementation for Spherical Flux Computation and Its Application to Vascular Segmentation , 2009, IEEE Transactions on Image Processing.

[11]  Magnus Borga,et al.  Blood vessel segmentation using multi-scale quadrature filtering , 2010, Pattern Recognit. Lett..

[12]  Danni Ai,et al.  Quantitative Analysis of Deformable Model-Based 3-D Reconstruction of Coronary Artery From Multiple Angiograms , 2015, IEEE Transactions on Biomedical Engineering.

[13]  Huazhong Shu,et al.  Artifact Suppressed Dictionary Learning for Low-Dose CT Image Processing , 2014, IEEE Transactions on Medical Imaging.

[14]  Sonam Singh,et al.  A fully convolutional neural network based structured prediction approach towards the retinal vessel segmentation , 2016, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[15]  Mohamed Cheriet,et al.  Vesselwalker: Coronary arteries segmentation using random walks and hessian-based vesselness filter , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[16]  Yongtian Wang,et al.  Application of ICA to X-ray coronary digital subtraction angiography , 2012, Neurocomputing.

[17]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[18]  T. Poggio,et al.  Memo No . 067 June 27 , 2017 Theory of Deep Learning III : Generalization Properties of SGD , 2017 .

[19]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[20]  Yongtian Wang,et al.  Novel Approach for 3-D Reconstruction of Coronary Arteries From Two Uncalibrated Angiographic Images , 2009, IEEE Transactions on Image Processing.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Huazhong Shu,et al.  Curve-Like Structure Extraction Using Minimal Path Propagation With Backtracking , 2016, IEEE Transactions on Image Processing.

[23]  Nader Karimi,et al.  Vessel segmentation in low contrast X-ray angiogram images , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[24]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[25]  Yongtian Wang,et al.  Multiresolution Elastic Registration of X-Ray Angiography Images Using Thin-Plate Spline , 2007, IEEE Transactions on Nuclear Science.

[26]  P. Bankhead,et al.  Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement , 2012, PloS one.