Residual Connection-Based Encoder Decoder Network (RCED-Net) for Retinal Vessel Segmentation

Devising automated procedures for accurate vessel segmentation (retinal) is crucial for timely prognosis of vision-threatening eye diseases. In this paper, a novel supervised deep learning-based approach is proposed which extends a variant of the fully convolutional neural network. The existing fully convolutional neural network-based counterparts have associated critical drawbacks of involving a large number of tunable hyper-parameters and an increased end-to-end training time furnished by their decoder structure. The proposed approach addresses these intricate challenges by using a skip-connections strategy by sharing indices obtained through max-pooling to the decoder from the encoder stage (respective stages) for enhancing the resolution of the feature map. This significantly reduces the number of required tunable hyper-parameters and the computational overhead of the training as well as testing stages. Furthermore, the proposed approach particularly helps in eradicating the requirement for employing both post-processing and pre-processing steps. In the proposed approach, the retinal vessel segmentation problem is formulated as a semantic pixel-wise segmentation task which helps in spanning the gap between semantic segmentation and medical image segmentation. A prime contribution of the proposed approach is the introduction of external skip-connection for passing the preserved low-level semantic edge information in order to reliably detect tiny vessels in the retinal fundus images. The performance of the proposed scheme is analyzed based on the three publicly available notable fundus image datasets, while the widely recognized evaluation metrics of specificity, sensitivity, accuracy, and the Receiver Operating Characteristics curves are used. Based on the assessment of the images in {DRIVE, CHASE_DB1, and STARE}; datasets, the proposed approach achieves a sensitivity, specificity, accuracy, and ROC performance of {0.8252, 0.8440, and 0.8397};, {0.9787, 0.9810, and 0.9792};, {0.9649, 0.9722, and 0.9659};, and {0.9780, 0.9830, and 0.9810};, respectively. The reduced computational complexity and memory overhead along with improved segmentation performance advocates employing the proposed approach in the automated diagnostic systems for eye diseases.

[1]  Yogesan Kanagasingam,et al.  Robust optic disc and cup segmentation with deep learning for glaucoma detection , 2019, Comput. Medical Imaging Graph..

[2]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[5]  Bunyarit Uyyanonvara,et al.  An approach to localize the retinal blood vessels using bit planes and centerline detection , 2012, Comput. Methods Programs Biomed..

[6]  Robert J. Cox,et al.  Accuracy of Neural Network Classifiers as a Property of the Size of the Data Set , 2006, KES.

[7]  Ming Li,et al.  Retinal Blood Vessel Segmentation Based on Multi-Scale Deep Learning , 2018, 2018 Federated Conference on Computer Science and Information Systems (FedCSIS).

[8]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[9]  Il Dong Yun,et al.  Deep Vessel Segmentation By Learning Graphical Connectivity , 2018, Medical Image Anal..

[10]  Yuan Luo,et al.  Automated Diabetic Retinopathy Detection Based on Binocular Siamese-Like Convolutional Neural Network , 2019, IEEE Access.

[11]  I. C. Munch,et al.  Retinal oxygen saturation in patients with systemic hypoxemia. , 2011, Investigative ophthalmology & visual science.

[12]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[15]  Vasileios Megalooikonomou,et al.  Discriminative vessel segmentation in retinal images by fusing context-aware hybrid features , 2014, Machine Vision and Applications.

[16]  Yan Chen,et al.  Vessel extraction from non-fluorescein fundus images using orientation-aware detector , 2015, Medical Image Anal..

[17]  Manuel G. Penedo,et al.  Retinal vessel tree segmentation using a deformable contour model , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[19]  Eric M. Moult,et al.  Optical Coherence Tomography Angiography of Dry Age-Related Macular Degeneration. , 2016, Developments in ophthalmology.

[20]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[21]  Tuan D. Pham,et al.  DUNet: A deformable network for retinal vessel segmentation , 2018, Knowl. Based Syst..

[22]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[23]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[24]  Ronan Collobert,et al.  Recurrent Convolutional Neural Networks for Scene Parsing , 2013, ArXiv.

[25]  Adrián Colomer,et al.  Detection of Early Signs of Diabetic Retinopathy Based on Textural and Morphological Information in Fundus Images , 2020, Sensors.

[26]  Shankar M. Krishnan,et al.  Detection and measurement of retinal vessels in fundus images using amplitude modified second-order Gaussian filter , 2002, IEEE Transactions on Biomedical Engineering.

[27]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[28]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[29]  Kazuaki Miyamoto,et al.  Morphologic and functional changes in retinal vessels associated with branch retinal vein occlusion. , 2013, Ophthalmology.

[30]  Paul Y. S. Cheung,et al.  Vessel Extraction Under Non-Uniform Illumination: A Level Set Approach , 2008, IEEE Transactions on Biomedical Engineering.

[31]  S R Singh,et al.  Fundoscopy and malignant hypertension. , 2019, QJM : monthly journal of the Association of Physicians.

[32]  Xin Yang,et al.  Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation , 2018, IEEE Transactions on Biomedical Engineering.

[33]  Ali Mahlooji Far,et al.  Retinal Image Analysis Using Curvelet Transform and Multistructure Elements Morphology by Reconstruction , 2011, IEEE Transactions on Biomedical Engineering.

[34]  Manoranjan Paul,et al.  Impact of ICA-Based Image Enhancement Technique on Retinal Blood Vessels Segmentation , 2018, IEEE Access.

[35]  Alan Wee-Chung Liew,et al.  General Retinal Vessel Segmentation Using Regularization-Based Multiconcavity Modeling , 2010, IEEE Transactions on Medical Imaging.

[36]  Ganesh Naik,et al.  A supervised blood vessel segmentation technique for digital Fundus images using Zernike Moment based features , 2020, PloS one.

[37]  Manoranjan Paul,et al.  Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation , 2019, Expert Syst. Appl..

[38]  Sonam Singh,et al.  A fully convolutional neural network based structured prediction approach towards the retinal vessel segmentation , 2016, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[39]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[40]  Abdul Jalil,et al.  A robust technique based on VLM and Frangi filter for retinal vessel extraction and denoising , 2018, PloS one.

[41]  Paul Sajda,et al.  Enhancing the Accuracy of Glaucoma Detection from OCT Probability Maps using Convolutional Neural Networks , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  Hong Yan,et al.  A Novel Vessel Segmentation Algorithm for Pathological Retina Images Based on the Divergence of Vector Fields , 2008, IEEE Transactions on Medical Imaging.

[43]  G. Quellec,et al.  Automated analysis of retinal images for detection of referable diabetic retinopathy. , 2013, JAMA ophthalmology.

[44]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[45]  Ning Tan,et al.  Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network , 2019, IEEE Access.

[46]  Tariq M. Khan,et al.  An Improved Retinal Vessel Segmentation Framework Using Frangi Filter Coupled With the Probabilistic Patch Based Denoiser , 2019, IEEE Access.

[47]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[49]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[50]  N Anuradha,et al.  Role of optometry school in single day large scale school vision testing , 2015, Oman journal of ophthalmology.

[51]  Ivan Cruz-Aceves,et al.  Blood vessel segmentation in retinal fundus images using Gabor filters, fractional derivatives, and Expectation Maximization , 2018, Appl. Math. Comput..

[52]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[53]  Ning Tan,et al.  Optic Disc and Cup Segmentation Based on Deep Convolutional Generative Adversarial Networks , 2019, IEEE Access.

[54]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[55]  Roberto Cipolla,et al.  Segmentation and Recognition Using Structure from Motion Point Clouds , 2008, ECCV.

[56]  Lei Zhang,et al.  Retinal vessel extraction by matched filter with first-order derivative of Gaussian , 2010, Comput. Biol. Medicine.

[57]  Keshab K. Parhi,et al.  Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Subimage Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[58]  Syamsiah Mashohor,et al.  Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier , 2017, PloS one.

[59]  Jia Zhang,et al.  A retinal vessel boundary tracking method based on Bayesian theory and multi-scale line detection , 2014, Comput. Medical Imaging Graph..

[60]  Zhang Yi,et al.  Diagnosis of Diabetic Retinopathy Using Deep Neural Networks , 2019, IEEE Access.

[61]  Tariq Mahmood Khan,et al.  A Multi-Scale Directional Line Detector for Retinal Vessel Segmentation , 2019, Sensors.

[62]  Li Chen,et al.  Automatic Retinal Blood Vessel Segmentation Based on Fully Convolutional Neural Networks , 2019, Symmetry.

[63]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[64]  Philip H. S. Torr,et al.  What, Where and How Many? Combining Object Detectors and CRFs , 2010, ECCV.

[65]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.