Combining Fine- and Coarse-Grained Classifiers for Diabetic Retinopathy Detection

Visual artefacts of early diabetic retinopathy in retinal fundus images are usually small in size, inconspicuous, and scattered all over retina. Detecting diabetic retinopathy requires physicians to look at the whole image and fixate on some specific regions to locate potential biomarkers of the disease. Therefore, getting inspiration from ophthalmologist, we propose to combine coarse-grained classifiers that detect discriminating features from the whole images, with a recent breed of fine-grained classifiers that discover and pay particular attention to pathologically significant regions. To evaluate the performance of this proposed ensemble, we used publicly available EyePACS and Messidor datasets. Extensive experimentation for binary, ternary and quaternary classification shows that this ensemble largely outperforms individual image classifiers as well as most of the published works in most training setups for diabetic retinopathy detection. Furthermore, the performance of fine-grained classifiers is found notably superior than coarse-grained image classifiers encouraging the development of task-oriented fine-grained classifiers modelled after specialist ophthalmologists.

[1]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[2]  Zhuowen Tu,et al.  Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree , 2015, AISTATS.

[3]  S. Haneda,et al.  [International clinical diabetic retinopathy disease severity scale]. , 2010, Nihon rinsho. Japanese journal of clinical medicine.

[4]  Darvin Yi,et al.  Automated Detection of Diabetic Retinopathy using Deep Learning , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[5]  Geoffrey E. Hinton,et al.  Who Said What: Modeling Individual Labelers Improves Classification , 2017, AAAI.

[6]  Abhishek Verma,et al.  New Deep Neural Nets for Fine-Grained Diabetic Retinopathy Recognition on Hybrid Color Space , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[7]  Laude,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[8]  Li Fei-Fei,et al.  Progressive Neural Architecture Search , 2017, ECCV.

[9]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[10]  Xiaogang Wang,et al.  Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection , 2017, MICCAI.

[11]  Shehzad Khalid,et al.  Detection and classification of retinal lesions for grading of diabetic retinopathy , 2014, Comput. Biol. Medicine.

[12]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Wojciech Matusik,et al.  Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks , 2018, ECCV.

[16]  Jamshid Dehmeshki,et al.  Automated detection of proliferative diabetic retinopathy using a modified line operator and dual classification , 2014, Comput. Methods Programs Biomed..

[17]  F. Mériaudeau,et al.  Analysis of Retinal Vessel Segmentation with Deep Learning and its Effect on Diabetic Retinopathy Classification , 2018, 2018 International Conference on Intelligent and Advanced System (ICIAS).

[18]  Jayant V. Kulkarni,et al.  Intensity features based classification of hard exudates in retinal images , 2015, 2015 Annual IEEE India Conference (INDICON).

[19]  Nishanthan Ramachandran,et al.  Diabetic retinopathy screening using deep neural network , 2018, Clinical & experimental ophthalmology.

[20]  Muhammad Sharif,et al.  A method for the detection and classification of diabetic retinopathy using structural predictors of bright lesions , 2017, J. Comput. Sci..

[21]  A. Rakhlin Diabetic Retinopathy detection through integration of Deep Learning classification framework , 2017 .

[22]  Farida Cheriet,et al.  Red Lesion Detection Using Dynamic Shape Features for Diabetic Retinopathy Screening , 2016, IEEE Transactions on Medical Imaging.

[23]  Ana Maria Mendonça,et al.  End-to-End Adversarial Retinal Image Synthesis , 2018, IEEE Transactions on Medical Imaging.

[24]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Dong Wang,et al.  Learning to Navigate for Fine-grained Classification , 2018, ECCV.