Training Deep Convolutional Neural Networks with Active Learning for Exudate Classification in Eye Fundus Images

Training deep convolutional neural network for classification in medical tasks is often difficult due to the lack of annotated data samples. Deep convolutional networks (CNN) has been successfully used as an automatic detection tool to support the grading of diabetic retinopathy and macular edema. Nevertheless, the manual annotation of exudates in eye fundus images used to classify the grade of the DR is very time consuming and repetitive for clinical personnel. Active learning algorithms seek to reduce the labeling effort in training machine learning models. This work presents a label-efficient CNN model using the expected gradient length, an active learning algorithm to select the most informative patches and images, converging earlier and to a better local optimum than the usual SGD (Stochastic Gradient Descent) strategy. Our method also generates useful masks for prediction and segments regions of interest.

[1]  Tomi Kauppi,et al.  Eye Fundus Image Analysis for Automatic Detection of Diabetic Retinopathy , 2010 .

[2]  Noemi Lois,et al.  Advances in our understanding of diabetic retinopathy. , 2013, Clinical science.

[3]  Bram van Ginneken,et al.  Active Learning for an Efficient Training Strategy of Computer-Aided Diagnosis Systems: Application to Diabetic Retinopathy Screening , 2010, MICCAI.

[4]  Mark Craven,et al.  Multiple-Instance Active Learning , 2007, NIPS.

[5]  Joachim Denzler,et al.  Selecting Influential Examples: Active Learning with Expected Model Output Changes , 2014, ECCV.

[6]  Oscar J. Perdomo,et al.  A Novel Machine Learning Model Based on Exudate Localization to Detect Diabetic Macular Edema , 2016 .

[7]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[8]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[11]  Yinda Zhang,et al.  LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop , 2015, ArXiv.

[12]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[13]  Qingcai Chen,et al.  Active Semi-Supervised Learning Method with Hybrid Deep Belief Networks , 2014, PloS one.

[14]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .