A data-driven approach to referable diabetic retinopathy detection

Prior art on automated screening of diabetic retinopathy and direct referral decision shows promising performance; yet most methods build upon complex hand-crafted features whose performance often fails to generalize. OBJECTIVE We investigate data-driven approaches that extract powerful abstract representations directly from retinal images to provide a reliable referable diabetic retinopathy detector. METHODS We gradually build the solution based on convolutional neural networks, adding data augmentation, multi-resolution training, robust feature-extraction augmentation, and a patient-basis analysis, testing the effectiveness of each improvement. RESULTS The proposed method achieved an area under the ROC curve of 98.2% (95% CI: 97.4-98.9%) under a strict cross-dataset protocol designed to test the ability to generalize - training on the Kaggle competition dataset and testing using the Messidor-2 dataset. With a 5 × 2-fold cross-validation protocol, similar results are achieved for Messidor-2 and DR2 datasets, reducing the classification error by over 44% when compared to most published studies in existing literature. CONCLUSION Additional boost strategies can improve performance substantially, but it is important to evaluate whether the additional (computation- and implementation-) complexity of each improvement is worth its benefits. We also corroborate that novel families of data-driven methods are the state of the art for diabetic retinopathy screening. SIGNIFICANCE By learning powerful discriminative patterns directly from available training retinal images, it is possible to perform referral diagnostics without detecting individual lesions.

[1]  Jacques Wainer,et al.  Points of Interest and Visual Dictionaries for Automatic Retinal Lesion Detection , 2012, IEEE Transactions on Biomedical Engineering.

[2]  Kaushal Solanki,et al.  EyeArt + EyePACS: Automated Retinal Image Analysis For Diabetic Retinopathy Screening in a Telemedicine System , 2015 .

[3]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[4]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[8]  Gwénolé Quellec,et al.  Optimal Wavelet Transform for the Detection of Microaneurysms in Retina Photographs , 2008, IEEE Transactions on Medical Imaging.

[9]  Gwénolé Quellec,et al.  Estimating maximal measurable performance for automated decision systems from the characteristics of the reference standard. application to diabetic retinopathy screening , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[11]  Aïda Valls,et al.  Identification and Visualization of the Underlying Independent Causes of the Diagnostic of Diabetic Retinopathy made by a Deep Learning Classifier , 2018, ArXiv.

[12]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[13]  Lawrence E. Barker,et al.  Impact of Geographic Density of Eye Care Professionals on Eye Care among Adults with Diabetes , 2012, Ophthalmic epidemiology.

[14]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[15]  Gwénolé Quellec,et al.  Automatic detection of referral patients due to retinal pathologies through data mining , 2016, Medical Image Anal..

[16]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Aïda Valls,et al.  A Deep Learning Interpretable Classifier for Diabetic Retinopathy Disease Grading , 2017, Neurocomputing.

[18]  Jacques Wainer,et al.  Data fusion for multi-lesion Diabetic Retinopathy detection , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[19]  Jacques Wainer,et al.  Assessing the Need for Referral in Automatic Diabetic Retinopathy Detection , 2013, IEEE Transactions on Biomedical Engineering.

[20]  G. Quellec,et al.  Automated analysis of retinal images for detection of referable diabetic retinopathy. , 2013, JAMA ophthalmology.

[21]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[22]  Matthew D. Davis,et al.  Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. , 2003, Ophthalmology.

[23]  Jacques Wainer,et al.  Automated Multi-Lesion Detection for Referable Diabetic Retinopathy in Indigenous Health Care , 2015, PloS one.

[24]  Amparo Navea,et al.  Evaluation of automated image analysis software for the detection of diabetic retinopathy to reduce the ophthalmologists' workload , 2015, Acta ophthalmologica.

[25]  Maria A Woodward,et al.  Telemedicine and Diabetic Retinopathy: Review of Published Screening Programs. , 2015, Journal of endocrinology and diabetes.

[26]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[27]  Ihsan ul Haq,et al.  Referral system for hard exudates in eye fundus , 2015, Comput. Biol. Medicine.

[28]  Jacques Wainer,et al.  Beyond Lesion-Based Diabetic Retinopathy: A Direct Approach for Referral , 2017, IEEE Journal of Biomedical and Health Informatics.

[29]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[30]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[31]  Antonio Moreno,et al.  Learning ensemble classifiers for diabetic retinopathy assessment , 2017, Artif. Intell. Medicine.

[32]  J. Wainer,et al.  Advancing Bag-of-Visual-Words Representations for Lesion Classification in Retinal Images , 2014, PloS one.

[33]  Gwénolé Quellec,et al.  Optimal Filter Framework for Automated, Instantaneous Detection of Lesions in Retinal Images , 2011, IEEE Transactions on Medical Imaging.

[34]  B. Schmauch,et al.  Deep learning approach for diabetic retinopathy screening , 2016 .

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[37]  Dawn A Sim,et al.  Automated Retinal Image Analysis for Diabetic Retinopathy in Telemedicine , 2015, Current Diabetes Reports.

[38]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[40]  Desire Sidibé,et al.  Discrimination of retinal images containing bright lesions using sparse coded features and SVM , 2015, Comput. Biol. Medicine.

[41]  Diane M Gibson,et al.  The geographic distribution of eye care providers in the United States: Implications for a national strategy to improve vision health. , 2015, Preventive medicine.