Coronary angiography video segmentation method for assisting cardiovascular disease interventional treatment

Background Coronary heart disease is one of the diseases with the highest mortality rate. Due to the important position of cardiovascular disease prevention and diagnosis in the medical field, the segmentation of cardiovascular images has gradually become a research hotspot. How to segment accurate blood vessels from coronary angiography videos to assist doctors in making accurate analysis has become the goal of our research. Method Based on the U-net architecture, we use a context-based convolutional network for capturing more information of the vessel in the video. The proposed method includes three modules: the sequence encoder module, the sequence decoder module, and the sequence filter module. The high-level information of the feature is extracted in the encoder module. Multi-kernel pooling layers suitable for the extraction of blood vessels are added before the decoder module. In the filter block, we add a simple temporal filter to reducing inter-frame flickers. Results The performance comparison with other method shows that our work can achieve 0.8739 in Sen , 0.9895 in Acc . From the performance of the results, the accuracy of our method is significantly improved. The performance benefit from the algorithm architecture and our enlarged dataset. Conclusion Compared with previous methods that only focus on single image analysis, our method can obtain more coronary information through image sequences. In future work, we will extend the network to 3D networks.

[1]  Michael H. F. Wilkinson,et al.  Shape Preserving Filament Enhancement Filtering , 2001, MICCAI.

[2]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[3]  Cemal Köse,et al.  A surface-based method for detection of coronary vessel boundaries in poor quality X-ray angiogram images , 2002, Pattern Recognit. Lett..

[4]  Xiaogang Wang,et al.  Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection , 2017, MICCAI.

[5]  G Valli,et al.  An algorithm for real-time vessel enhancement and detection. , 1997, Computer methods and programs in biomedicine.

[6]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[7]  Rui Wang,et al.  Skeletal Shape Correspondence Through Entropy , 2018, IEEE Transactions on Medical Imaging.

[8]  S. Eiho,et al.  Detection of coronary artery tree using morphological operator , 1997, Computers in Cardiology 1997.

[9]  Francis K. H. Quek,et al.  Vessel extraction in medical images by wave-propagation and traceback , 2001, IEEE Transactions on Medical Imaging.

[10]  Iman Aganj,et al.  Unsupervised Medical Image Segmentation Based on the Local Center of Mass , 2018, Scientific Reports.

[11]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[12]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Tien Yin Wong,et al.  Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening , 2013, IEEE Transactions on Medical Imaging.

[14]  Nicolas Passat,et al.  Fully automatic 3D segmentation of coronary arteries based on mathematical morphology , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[15]  Gösta H. Granlund,et al.  Image Sequence Analysis , 1993, DAGM-Symposium.

[16]  Ying Sun,et al.  Recursive tracking of vascular networks in angiograms based on the detection-deletion scheme , 1993, IEEE Trans. Medical Imaging.

[17]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[18]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[21]  Daniel Rueckert,et al.  Discriminative dictionary learning for abdominal multi-organ segmentation , 2015, Medical Image Anal..

[22]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[23]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[26]  Oscar Camara,et al.  Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis , 2006, IEEE Transactions on Medical Imaging.

[27]  Amir A. Amini,et al.  Quantitative coronary angiography with deformable spline models , 1997, IEEE Transactions on Medical Imaging.

[28]  Rebecca Smith,et al.  Automated ventricular systems segmentation in brain CT images by combining low-level segmentation and high-level template matching , 2009, BMC Medical Informatics Decis. Mak..

[29]  Young H. Kwon,et al.  Automated segmentation of the optic disc from stereo color photographs using physiologically plausible features. , 2007, Investigative ophthalmology & visual science.

[30]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[31]  Yutaka Hata,et al.  Fuzzy Information Granulation on Blood Vessel Extraction from 3D TOF MRA Image , 2000, Int. J. Pattern Recognit. Artif. Intell..

[32]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.