Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset

Annotated training data insufficiency remains to be one of the challenges of applying deep learning in medical data classification problems. Transfer learning from an already trained deep convolutional network can be used to reduce the cost of training from scratch and to train with small training data for deep learning. This raises the question of whether we can use transfer learning to overcome the training data insufficiency problem in deep learning based medical data classifications. Deep convolutional networks have been achieving high performance results on the ImageNet Large Scale Visual Recognition Competition (ILSVRC) image classification challenge. One example is the Inception-V3 model that was the first runner up on the ILSVRC 2015 challenge. Inception modules that help to extract different sized features of input images in one level of convolution are the unique features of the Inception-V3. In this work, we have used a pretrained Inception-V3 model to take advantage of its Inception modules for Diabetic Retinopathy detection. In order to tackle the labelled data insufficiency problem, we sub-sampled a smaller version of the Kaggle Diabetic Retinopathy classification challenge dataset for model training, and tested the model's accuracy on a previously unseen data subset. Our technique could be used in other deep learning based medical image classification problems facing the challenge of labeled training data insufficiency.

[1]  Oscar Perdomo,et al.  Convolutional network to detect exudates in eye fundus images of diabetic subjects , 2017, Symposium on Medical Information Processing and Analysis.

[2]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[3]  B. Schmauch,et al.  Deep learning approach for diabetic retinopathy screening , 2016 .

[4]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[5]  Joachim Denzler,et al.  Deep Learning on Small Datasets without Pre-Training using Cosine Loss , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Gui-Bin Bian,et al.  Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications , 2018, IEEE Access.

[7]  Romany F Mansour,et al.  Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy , 2017, Biomedical Engineering Letters.

[8]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[9]  R P Murphy,et al.  Interval between onset of mild nonproliferative and proliferative retinopathy in type I diabetes. , 1997, Archives of ophthalmology.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Zhang Yi,et al.  Diagnosis of Diabetic Retinopathy Using Deep Neural Networks , 2019, IEEE Access.

[12]  Lei Zhang,et al.  Multi-level deep supervised networks for retinal vessel segmentation , 2017, International Journal of Computer Assisted Radiology and Surgery.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Jennifer K. Sun,et al.  Diabetic retinopathy: current understanding, mechanisms, and treatment strategies. , 2017, JCI insight.

[17]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[18]  Yan Liang,et al.  Deep convolutional neural networks for diabetic retinopathy detection by image classification , 2018, Comput. Electr. Eng..

[19]  Matthew D. Davis,et al.  Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. , 2003, Ophthalmology.

[20]  Junhao Wen,et al.  Fundus Image Classification Using VGG-19 Architecture with PCA and SVD , 2018, Symmetry.

[21]  Basant Kumar,et al.  Diabetic Retinopathy Detection by Extracting Area and Number of Microaneurysm from Colour Fundus Image , 2018, 2018 5th International Conference on Signal Processing and Integrated Networks (SPIN).

[22]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[23]  Yaser M. Roshan,et al.  Comparative Study of Fine-Tuning of Pre-Trained Convolutional Neural Networks for Diabetic Retinopathy Screening , 2017, 2017 24th National and 2nd International Iranian Conference on Biomedical Engineering (ICBME).

[24]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[25]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[26]  U. Rajendra Acharya,et al.  Algorithms for the Automated Detection of Diabetic Retinopathy Using Digital Fundus Images: A Review , 2012, Journal of Medical Systems.

[27]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[28]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[29]  R. Klein,et al.  Projection of diabetic retinopathy and other major eye diseases among people with diabetes mellitus: United States, 2005-2050. , 2008, Archives of ophthalmology.

[30]  B. Klein,et al.  Global Prevalence and Major Risk Factors of Diabetic Retinopathy , 2012, Diabetes Care.

[31]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[32]  Gernot A. Fink,et al.  Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[33]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[34]  Muhammad Hussain,et al.  Deep Learning based Computer-Aided Diagnosis Systems for Diabetic Retinopathy: A Survey , 2018, Artif. Intell. Medicine.

[35]  Anupriyaa Mukherjee,et al.  Diagnosis of Diabetic Retinopathy , 2015 .

[36]  Ronnie D. Caytiles,et al.  Classification of Diabetic Retinopathy Images by Using Deep Learning Models , 2018 .

[37]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[38]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion , 2016, Comput. Methods Programs Biomed..

[39]  Shilpa Joshi,et al.  A review on exudates detection methods for diabetic retinopathy. , 2018, Biomedicine & pharmacotherapy = Biomedecine & pharmacotherapie.

[40]  Jonathan Krause,et al.  Deep Learning vs. Human Graders for Classifying Severity Levels of Diabetic Retinopathy in a Real-World Nationwide Screening Program , 2018, ArXiv.

[41]  Shashi Jain,et al.  Diagnosis of Diabetic Retinopathy , 2006 .

[42]  L. Aiello,et al.  Retinopathy in diabetes. , 2004, Diabetes care.

[43]  Shenghua Gao,et al.  Multi-Cell Multi-Task Convolutional Neural Networks for Diabetic Retinopathy Grading , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[44]  Jasmin Zvorničanin,et al.  Imaging in Diabetic Retinopathy , 2015, Middle East African journal of ophthalmology.

[45]  U. Rajendra Acharya,et al.  Application of Higher Order Spectra for the Identification of Diabetes Retinopathy Stages , 2008, Journal of Medical Systems.