Leveraging Undiagnosed Data for Glaucoma Classification with Teacher-Student Learning

Recently, deep learning has been adopted to the glaucoma classification task with performance comparable to that of human experts. However, a well trained deep learning model demands a large quantity of properly labeled data, which is relatively expensive since the accurate labeling of glaucoma requires years of specialist training. In order to alleviate this problem, we propose a glaucoma classification framework which takes advantage of not only the properly labeled images, but also undiagnosed images without glaucoma labels. To be more specific, the proposed framework is adapted from the teacher-student-learning paradigm. The teacher model encodes the wrapped information of undiagnosed images to a latent feature space, meanwhile the student model learns from the teacher through knowledge transfer to improve the glaucoma classification. For the model training procedure, we propose a novel training strategy that simulates the real-world teaching practice named as 'Learning To Teach with Knowledge Transfer (L2T-KT)', and establish a 'Quiz Pool' as the teacher's optimization target. Experiments show that the proposed framework is able to utilize the undiagnosed data effectively to improve the glaucoma prediction performance.

[1]  Jiang Liu,et al.  Integrating holistic and local deep features for glaucoma classification , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Chi-Wing Fu,et al.  Patch-Based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation , 2019, IEEE Transactions on Medical Imaging.

[3]  Alejandro F. Frangi,et al.  Retinal Image Synthesis and Semi-Supervised Learning for Glaucoma Assessment , 2019, IEEE Transactions on Medical Imaging.

[4]  Lijun Wu,et al.  Learning to Teach with Dynamic Loss Functions , 2018, NeurIPS.

[5]  Mingqi Li,et al.  Semi-supervised Transfer Learning for Convolutional Neural Networks for Glaucoma Detection , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Xiaofei Wang,et al.  Attention Based Glaucoma Detection: A Large-Scale Database and CNN Model , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  J. Stenton,et al.  Learning how to teach. , 1973, Nursing mirror and midwives journal.

[8]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[9]  T. Wong,et al.  Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. , 2014, Ophthalmology.

[10]  M. He,et al.  Efficacy of a Deep Learning System for Detecting Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. , 2018, Ophthalmology.

[11]  D. Garway-Heath,et al.  Vertical cup/disc ratio in relation to optic disc size: its value in the assessment of the glaucoma suspect , 1998, The British journal of ophthalmology.

[12]  Geoffrey E. Hinton,et al.  Similarity of Neural Network Representations Revisited , 2019, ICML.

[13]  Kaamran Raahemifar,et al.  Retinal fundus images for glaucoma analysis: the RIGA dataset , 2018, Medical Imaging.

[14]  Mariano Rincón,et al.  Identification of the optic nerve head with genetic algorithms , 2008, Artif. Intell. Medicine.

[15]  Matthew Richardson,et al.  Do Deep Convolutional Nets Really Need to be Deep and Convolutional? , 2016, ICLR.

[16]  Razvan Pascanu,et al.  Policy Distillation , 2015, ICLR.

[17]  Tien Yin Wong,et al.  Glaucoma detection based on deep convolutional neural network , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Xiaochun Cao,et al.  Disc-Aware Ensemble Network for Glaucoma Screening From Fundus Image , 2018, IEEE Transactions on Medical Imaging.

[19]  Andrew Hunter,et al.  Optic nerve head segmentation , 2004, IEEE Transactions on Medical Imaging.

[20]  Rich Caruana,et al.  Do Deep Nets Really Need to be Deep? , 2013, NIPS.