Comparative Study of Fine-Tuning of Pre-Trained Convolutional Neural Networks for Diabetic Retinopathy Screening

Diabetic retinopathy is the leading cause of blindness, engaging people in different ages. Early detection of the disease, although significantly important to control and cure it, is usually being overlooked due to the need for experienced examination. To this end, automatic diabetic retinopathy diagnostic methods are proposed to facilitate the examination process and act as the physician's helper. In this paper, automatic diagnosis of diabetic retinopathy using pre-trained convolutional neural networks is studied. Pre-trained networks are chosen to avoid the time-and resource-consuming training algorithms for designing a convolutional neural network from scratch. Each neural network is fine-tuned with the pre-processed dataset, and the fine-tuning parameters as well as the pre-trained neural networks are compared together. The result of this paper, introduces a fast approach to fine-tune pre-trained networks, by studying different tuning parameters and their effect on the overall system performance due to the specific application of diabetic retinopathy screening.

[1]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[2]  H. A. Nugroho,et al.  Gaussian Bayes classifier for medical diagnosis and grading: Application to diabetic retinopathy , 2010, 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Yaser M. Roshan,et al.  A comparative analysis of classification algorithms in diabetic retinopathy screening , 2017 .

[5]  Zhiguang Wang,et al.  Diabetic Retinopathy Detection via Deep Convolutional Networks for Discriminative Localization and Visual Explanation , 2017, AAAI Workshops.

[6]  P. Aruna,et al.  DIAGNOSIS OF DIABETIC RETINOPATHY USING MACHINE LEARNING TECHNIQUES , 2013, SOCO 2013.

[7]  N. Congdon,et al.  The worldwide epidemic of diabetic retinopathy , 2012, Indian journal of ophthalmology.

[8]  Weimin Huang,et al.  Brain tumor grading based on Neural Networks and Convolutional Neural Networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Abhishek Verma,et al.  New Deep Neural Nets for Fine-Grained Diabetic Retinopathy Recognition on Hybrid Color Space , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[10]  Amol Prataprao Bhatkar,et al.  Detection of Diabetic Retinopathy in Retinal Images Using MLP Classifier , 2015, 2015 IEEE International Symposium on Nanoelectronic and Information Systems.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[13]  Bálint Antal,et al.  An Ensemble-Based System for Microaneurysm Detection and Diabetic Retinopathy Grading , 2012, IEEE Transactions on Biomedical Engineering.

[14]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Gongping Yang,et al.  Hierarchical retinal blood vessel segmentation based on feature and ensemble learning , 2015, Neurocomputing.

[16]  Yaser M. Roshan,et al.  A comparative analysis of classification algorithms in diabetic retinopathy screening , 2017, 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE).

[17]  Alireza Osareh,et al.  A Computational-Intelligence-Based Approach for Detection of Exudates in Diabetic Retinopathy Images , 2009, IEEE Transactions on Information Technology in Biomedicine.

[18]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[19]  Pascal Vincent,et al.  The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training , 2009, AISTATS.

[20]  K. Saranya,et al.  A novel approach for the detection of new vessels in the retinal images for screening Diabetic Retinopathy , 2012, 2012 International Conference on Communication and Signal Processing.

[21]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.