DME-Net: Diabetic Macular Edema Grading by Auxiliary Task Learning

Diabetic macular edema (DME) is a consequence of diabetic retinopathy (DR), characterized by the abnormal accumulation of fluid and protein deposits in the macular region of the retina. Early detection and grading of DME is of great clinical significance, yet remains a challenging problem. In this work, we propose a highly accurate DME grading model by exploiting macular and hard exudate detection results in an auxiliary learning manner. Specifically, we adopt XGBoost [4] as the classifier, which allows us to use different types of multi-scale features that are extracted by the multi-scale feature extraction models from the image, hard exudate mask, macula mask, and macula image. Experiments have been conducted on the IDRiD and Messidor datasets. Our model achieves a large improvement over previous methods. Our method yields an accuracy of 0.9417 on IDRiD and beats the champion method of the “Diabetic Retinopathy: Segmentation and Grading Challenge” [1]. Our method also produces a high overall performance on Messidor, obtaining scores of 0.9591, 0.9712, 0.9824 and 0.9633 in terms of sensitivity, specificity, AUC and accuracy, respectively.

[1]  Muhammad Younus Javed,et al.  Automated detection of exudates and macula for grading of diabetic macular edema , 2014, Comput. Methods Programs Biomed..

[2]  E Reichel,et al.  Topography of diabetic macular edema with optical coherence tomography. , 1998, Ophthalmology.

[3]  B. Zinman,et al.  Diabetic retinopathy and diabetic macular edema: pathophysiology, screening, and novel therapies. , 2003, Diabetes care.

[4]  Fabrice Mériaudeau,et al.  Indian Diabetic Retinopathy Image Dataset (IDRiD): A Database for Diabetic Retinopathy Screening Research , 2018, Data.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Jayanthi Sivaswamy,et al.  Automatic assessment of macular edema from color retinal images , 2012, IEEE Transactions on Medical Imaging.

[7]  F. Arcadu,et al.  Deep Learning Predicts OCT Measures of Diabetic Macular Thickening From Color Fundus Photographs. , 2019, Investigative ophthalmology & visual science.

[8]  Ling Shao,et al.  Collaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[10]  Matthew D. Davis,et al.  Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. , 2003, Ophthalmology.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[13]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[14]  Huazhu Fu,et al.  DeepAMD: Detect Early Age-Related Macular Degeneration by Applying Deep Learning in a Multiple Instance Learning Framework , 2018, ACCV.