Multi-path convolutional neural network in fundus segmentation of blood vessels

Abstract There is a close correlation between retinal vascular status and physical diseases such as eye lesions. Retinal fundus images are an important basis for diagnosing diseases such as diabetes, glaucoma, hypertension, coronary heart disease, etc. Because the thickness of the retinal blood vessels is different, the minimum diameter is only one or two pixels wide, so obtaining accurate measurement results becomes critical and challenging. In this paper, we propose a new method of retinal blood vessel segmentation that is based on a multi-path convolutional neural network, which can be used for computer-based clinical medical image analysis. First, a low-frequency image characterizing the overall characteristics of the retinal blood vessel image and a high-frequency image characterizing the local detailed features are respectively obtained by using a Gaussian low-pass filter and a Gaussian high-pass filter. Then a feature extraction path is constructed for the characteristics of the low- and high-frequency images, respectively. Finally, according to the response results of the low-frequency feature extraction path and the high-frequency feature extraction path, the whole blood vessel perception and local feature information fusion coding are realized, and the final blood vessel segmentation map is obtained. The performance of this method is evaluated and tested by DRIVE and CHASE_DB1. In the experimental results of the DRIVE database, the evaluation indexes accuracy (Acc), sensitivity (SE), and specificity (SP) are 0.9580, 0.8639, and 0.9665, respectively, and the evaluation indexes Acc, SE, and SP of the CHASE_DB1 database are 0.9601, 0.8778, and 0.9680, respectively. In addition, the method proposed in this paper could effectively suppress noise, ensure continuity after blood vessel segmentation, and provide a feasible new idea for intelligent visual perception of medical images.

[1]  S. Edward Rajan,et al.  Computerized screening of diabetic retinopathy employing blood vessel segmentation in retinal images , 2014 .

[2]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Keshab K. Parhi,et al.  Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Subimage Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[4]  Bin Sheng,et al.  Clinical Report Guided Retinal Microaneurysm Detection With Multi-Sieving Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[5]  Theocharis Theocharides,et al.  A high performance hardware architecture for portable, low-power retinal vessel segmentation , 2014, Integr..

[6]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[7]  Robert J. Gillies,et al.  Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Syamsiah Mashohor,et al.  Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier , 2017, PloS one.

[9]  Jia Zhang,et al.  A retinal vessel boundary tracking method based on Bayesian theory and multi-scale line detection , 2014, Comput. Medical Imaging Graph..

[10]  Temitope Mapayi,et al.  Retinal Vessel Segmentation: A Comparative Study of Fuzzy C-Means and Sum Entropy Information on Phase Congruency , 2015 .

[11]  Evangelos Dermatas,et al.  Multi-scale retinal vessel segmentation using line tracking , 2010, Comput. Medical Imaging Graph..

[12]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[13]  Lijie Li,et al.  Printed circuit board based memristor in adaptive lowpass filter , 2012 .

[14]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[15]  Yu Yongbin,et al.  Memristor bridge-based low pass filter for image processing , 2019, Journal of Systems Engineering and Electronics.

[16]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[17]  Seok-Bum Ko,et al.  Fast, accurate and robust retinal vessel segmentation system , 2017 .

[18]  Manoranjan Paul,et al.  Impact of ICA-Based Image Enhancement Technique on Retinal Blood Vessels Segmentation , 2018, IEEE Access.

[19]  Georg Langs,et al.  Mapping visual features to semantic profiles for retrieval in medical imaging , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jae-Ho Han,et al.  Advanced deep learning for blood vessel segmentation in retinal fundus images , 2017, 2017 5th International Winter Conference on Brain-Computer Interface (BCI).

[21]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[22]  Xiaoyi Jiang,et al.  A self-adaptive matched filter for retinal blood vessel detection , 2014, Machine Vision and Applications.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Yuan Wu,et al.  Blood Vessels Segmentation by Using CDNet , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[25]  Songhua Xie,et al.  Retinal Vascular Image Segmentation Using Genetic Algorithm Plus FCM Clustering , 2013, 2013 Third International Conference on Intelligent System Design and Engineering Applications.

[26]  Jinkai Cui,et al.  Retinal vessel segmentation in colour fundus images using Extreme Learning Machine , 2017, Comput. Medical Imaging Graph..

[27]  Salah Bourennane,et al.  Retinal vessel segmentation using a probabilistic tracking method , 2012, Pattern Recognit..

[28]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[29]  Joachim M. Buhmann,et al.  Boosting Convolutional Filters with Entropy Sampling for Optic Cup and Disc Image Segmentation from Fundus Images , 2015, MLMI.

[30]  Zhuowen Tu,et al.  Holistically-Nested Edge Detection , 2015, ICCV.

[31]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[32]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[33]  Xiaohui Liu,et al.  Segmentation of Retinal Blood Vessels Using Gaussian Mixture Models and Expectation Maximisation , 2013, HIS.

[34]  Xin Yang,et al.  Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation , 2018, IEEE Transactions on Biomedical Engineering.