A multi-level context fusion network for exudate segmentation in retinal images

Diabetic retinopathy(DR), is one of the major causes of visual loss. Exudates as the early symptoms of DR, are formed by leakage of fluid from injured retinal blood vessels. In clinic, exudate detection is mandatory for accurate analysis of progress of DR. However, because of the large intraclass variation and high interclass similarity, it is very challenging to detect exudate. To address this difficult problem, we propose a multilevel context fusion model that integrate the global abstract features and local refine spatial information simultaneously. Furthermore, the pyramid pooling module is introduced to gather the global information with varied scales. In addition, auxiliary supervision is exploited to alleviate the issue of gradient vanishing and enhance the representative capability of the lower layers of the network. The mechanism of transfer learning is employed to accelerate convergence and mitigate the problem of insufficient medical data. Moreover, compared with traditional approaches, there is no any preprocessing or postprocessing steps in our method, the network can be trained in an end-to-end way. Experiment results on the publicly available e-ophtha EX database illustrate that the proposed approach outperforms the state-of-the-art method with a fast speed, which makes it suitable for practical clinical applications.

[1]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[2]  Bunyarit Uyyanonvara,et al.  Automatic Exudate Detection from Non-dilated Diabetic Retinopathy Retinal Images Using Fuzzy C-means Clustering , 2009, Sensors.

[3]  Hamid Reza Pourreza,et al.  A novel method for retinal exudate segmentation using signal separation algorithm , 2016, Comput. Methods Programs Biomed..

[4]  Zhang Yi,et al.  Dynamical properties of background neural networks with uniform firing rate and background input , 2007 .

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Zhang Yi,et al.  Periodicity of a class of nonlinear fuzzy systems with delays , 2009 .

[7]  Zhang Yi,et al.  Trajectory Predictor by Using Recurrent Neural Networks in Visual Tracking , 2017, IEEE Transactions on Cybernetics.

[8]  Zhang Yi,et al.  Learning robust uniform features for cross-media social data by using cross autoencoders , 2016, Knowl. Based Syst..

[9]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion , 2016, Comput. Methods Programs Biomed..

[10]  Jie Chen,et al.  A location-to-segmentation strategy for automatic exudate segmentation in colour retinal fundus images , 2017, Comput. Medical Imaging Graph..

[11]  Zhang Yi,et al.  Foundations of Implementing the Competitive Layer Model by Lotka–Volterra Recurrent Neural Networks , 2010, IEEE Transactions on Neural Networks.

[12]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Vineeta Das,et al.  Tsallis entropy and sparse reconstructive dictionary learning for exudate detection in diabetic retinopathy , 2017, Journal of medical imaging.

[14]  Lei Zhang,et al.  Multi-level deep supervised networks for retinal vessel segmentation , 2017, International Journal of Computer Assisted Radiology and Surgery.

[15]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[16]  Zhang Yi,et al.  Recurrent Neural Networks With Auxiliary Memory Units , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Gwénolé Quellec,et al.  Exudate detection in color retinal images for mass screening of diabetic retinopathy , 2014, Medical Image Anal..

[20]  Huchuan Lu,et al.  A Stagewise Refinement Model for Detecting Salient Objects in Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).