Exudate-based diabetic macular edema recognition in retinal images using cascaded deep residual networks

Abstract Diabetic macular edema (DME), one of the leading causes of visual impairment and blindness, is usually diagnosed by the presence of exudates. However, exudate detection is challenging due to the large intraclass variation and high interclass similarity. To overcome these challenges, we propose the cascaded deep residual networks to recognize DME. Specifically, we first design a fully convolutional residual network that fuses multi-level hierarchical information to segment exudates accurately with a fast speed. Compared with previous methods, our approach avoids a wide range of preprocessing or postprocessing steps, reducing the impact of subjective factors. Then based on the segmentation results, the region centered on the pixel with the maximum probability is cropped and fed into the other deep residual network (for classification) to distinguish DME from its hard mimics. This makes the classification network to extract more representative features based on the segmentation results instead of the original images, further reducing the influence of complicated background. We evaluate the proposed method on two publicly available databases, the HEI-MED and e-ophtha EX databases. Extensive experiments demonstrate that our approach achieves better performance than the state-of-the-art methods with a fast processing speed, making it suitable for real-world clinical applications.

[1]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[2]  Lei Zhang,et al.  Multi-level deep supervised networks for retinal vessel segmentation , 2017, International Journal of Computer Assisted Radiology and Surgery.

[3]  Razvan Pascanu,et al.  On the Number of Linear Regions of Deep Neural Networks , 2014, NIPS.

[4]  Gwénolé Quellec,et al.  Exudate detection in color retinal images for mass screening of diabetic retinopathy , 2014, Medical Image Anal..

[5]  Kenneth W. Tobin,et al.  Exudate-based diabetic macular edema detection in fundus images using publicly available datasets , 2012, Medical Image Anal..

[6]  Jian Sun,et al.  Instance-Aware Semantic Segmentation via Multi-task Network Cascades , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Roberto Hornero,et al.  Retinal image analysis based on mixture models to detect hard exudates , 2009, Medical Image Anal..

[8]  Manuel João Oliveira Ferreira,et al.  Exudate segmentation in fundus images using an ant colony optimization approach , 2015, Inf. Sci..

[9]  C. Sinthanayothin,et al.  Automated detection of diabetic retinopathy on digital fundus images , 2002, Diabetic medicine : a journal of the British Diabetic Association.

[10]  Bunyarit Uyyanonvara,et al.  Automatic Exudate Detection from Non-dilated Diabetic Retinopathy Retinal Images Using Fuzzy C-means Clustering , 2009, Sensors.

[11]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[13]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Pascale Massin,et al.  A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina , 2002, IEEE Transactions on Medical Imaging.

[16]  Oscar J. Perdomo,et al.  A Novel Machine Learning Model Based on Exudate Localization to Detect Diabetic Macular Edema , 2016 .

[17]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[18]  Muhammad Younus Javed,et al.  Automated detection of exudates and macula for grading of diabetic macular edema , 2014, Comput. Methods Programs Biomed..

[19]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[22]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[23]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion , 2016, Comput. Methods Programs Biomed..

[24]  Vineeta Das,et al.  Tsallis entropy and sparse reconstructive dictionary learning for exudate detection in diabetic retinopathy , 2017, Journal of medical imaging.

[25]  Sharib Ali,et al.  Statistical atlas based exudate segmentation , 2013, Comput. Medical Imaging Graph..

[26]  Hamid Reza Pourreza,et al.  A novel method for retinal exudate segmentation using signal separation algorithm , 2016, Comput. Methods Programs Biomed..

[27]  Jie Chen,et al.  A location-to-segmentation strategy for automatic exudate segmentation in colour retinal fundus images , 2017, Comput. Medical Imaging Graph..