Deep Learning to Assess Glaucoma Risk and Associated Features in Fundus Images

Glaucoma is the leading cause of preventable, irreversible blindness world-wide. The disease can remain asymptomatic until severe, and an estimated 50%-90% of people with glaucoma remain undiagnosed. Thus, glaucoma screening is recommended for early detection and treatment. A cost-effective tool to detect glaucoma could expand healthcare access to a much larger patient population, but such a tool is currently unavailable. We trained a deep learning (DL) algorithm using a retrospective dataset of 58,033 images, assessed for gradability, glaucomatous optic nerve head (ONH) features, and referable glaucoma risk. The resultant algorithm was validated using 2 separate datasets. For referable glaucoma risk, the algorithm had an AUC of 0.940 (95%CI, 0.922-0.955) in validation dataset "A" (1,205 images, 1 image/patient; 19% referable where images were adjudicated by panels of fellowship-trained glaucoma specialists) and 0.858 (95% CI, 0.836-0.878) in validation dataset "B" (17,593 images from 9,643 patients; 9.2% referable where images were from the Atlanta Veterans Affairs Eye Clinic diabetic teleretinal screening program using clinical referral decisions as the reference standard). Additionally, we found that the presence of vertical cup-to-disc ratio >= 0.7, neuroretinal rim notching, retinal nerve fiber layer defect, and bared circumlinear vessels contributed most to referable glaucoma risk assessment by both glaucoma specialists and the algorithm. Algorithm AUCs ranged between 0.608-0.977 for glaucomatous ONH features. The DL algorithm was significantly more sensitive than 6 of 10 graders, including 2 of 3 glaucoma specialists, with comparable or higher specificity relative to all graders. A DL algorithm trained on fundus images alone can detect referable glaucoma risk with higher sensitivity and comparable specificity to eye care providers.

[1]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[2]  F. Massey The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[3]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[4]  J. Herschler,et al.  Baring of the circumlinear vessel. An early sign of optic nerve damage. , 1980, Archives of ophthalmology.

[5]  G. Sutton,et al.  Baring of a circumlinear vessel in glaucoma. , 1983, Archives of ophthalmology.

[6]  R. Susanna The lamina cribrosa and visual field defects in open-angle glaucoma. , 1983, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[7]  A. Sommer,et al.  Intraobserver and interobserver agreement in measurement of optic disc characteristics. , 1988, Ophthalmology.

[8]  A. Sommer Glaucoma screening , 1990, Journal of general internal medicine.

[9]  I. Scott,et al.  Expert agreement in evaluating the optic disc for glaucoma. , 1992, Ophthalmology.

[10]  E. Chihara,et al.  Retinal nerve fiber layer defect as an early manifestation of diabetic retinopathy. , 1993, Ophthalmology.

[11]  J. Jonas,et al.  Localized retinal nerve fiber layer defects in nonglaucomatous optic nerve atrophy. , 1994, Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie.

[12]  J. Jonas,et al.  Shape of the neuroretinal rim and position of the central retinal vessels in glaucoma. , 1994, The British journal of ophthalmology.

[13]  H. Quigley Number of people with glaucoma worldwide. , 1996, The British journal of ophthalmology.

[14]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[15]  George A. Williams,et al.  The Age-Related Eye Disease Study (AREDS): design implications. AREDS report no. 1. , 1999, Controlled clinical trials.

[16]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[17]  L. Zangwill,et al.  Evaluating the Optic Disc and Retinal Nerve Fiber Layer in Glaucoma I: Clinical Examination and Photographic Methods , 2000, Seminars in ophthalmology.

[18]  E. Chaum,et al.  Nerve fiber bundle visual field defect resulting from a giant peripapillary cotton-wool spot. , 2001, Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society.

[19]  A. Rotchford,et al.  Temba glaucoma study: a population-based cross-sectional survey in urban South Africa. , 2003, Ophthalmology.

[20]  F. Medeiros,et al.  Five rules to evaluate the optic disc and retinal nerve fiber layer for glaucoma. , 2005, Optometry.

[21]  H. Quigley,et al.  The number of people with glaucoma worldwide in 2010 and 2020 , 2006, British Journal of Ophthalmology.

[22]  A. Jünemann,et al.  [Healthy optic discs with large cups--a diagnostic challenge in glaucoma]. , 2006, Klinische Monatsblatter fur Augenheilkunde.

[23]  M. C. Leske,et al.  Awareness of incident open-angle glaucoma in a population study: the Barbados Eye Studies. , 2007, Ophthalmology.

[24]  Miyo Matsumura,et al.  Pathophysiology and Treatment of Glaucoma , 2010 .

[25]  David Cohn,et al.  Active Learning , 2010, Encyclopedia of Machine Learning.

[26]  F. Medeiros,et al.  Managing glaucoma in developing countries. , 2011, Arquivos brasileiros de oftalmologia.

[27]  I. Marjanovic,et al.  The Optic Nerve in Glaucoma , 2011 .

[28]  Rui Bernardes,et al.  Digital Ocular Fundus Imaging: A Review , 2011, Ophthalmologica.

[29]  Laura M. Chihara,et al.  Mathematical Statistics with Resampling and R , 2011 .

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  D. Simel,et al.  Do findings on routine examination identify patients at risk for primary open-angle glaucoma? The rational clinical examination systematic review. , 2013, JAMA.

[32]  P. Newman-Casey,et al.  Gaps in glaucoma care: a systematic review of monoscopic disc photos to screen for glaucoma , 2014, Expert review of ophthalmology.

[33]  Flavio S. Lopes,et al.  Analysis of neuroretinal rim distribution and vascular pattern in eyes with presumed large physiological cupping: a comparative study , 2014, BMC Ophthalmology.

[34]  Monali S. Malvankar-Mehta,et al.  The Effectiveness of Teleglaucoma versus In-Patient Examination for Glaucoma Screening: A Systematic Review and Meta-Analysis , 2014, PloS one.

[35]  T. Wong,et al.  Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. , 2014, Ophthalmology.

[36]  L. Shi,et al.  Telemedicine for detecting diabetic retinopathy: a systematic review and meta-analysis , 2015, British Journal of Ophthalmology.

[37]  S. Mansberger,et al.  Primary Open-Angle Glaucoma Suspect Preferred Practice Pattern(®) Guidelines. , 2016, Ophthalmology.

[38]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[40]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[41]  S. Mansberger,et al.  Primary Open-Angle Glaucoma Preferred Practice Pattern(®) Guidelines. , 2016, Ophthalmology.

[42]  D. Friedman,et al.  Primary open-angle glaucoma , 2016, Nature Reviews Disease Primers.

[43]  Angela V. Turalba,et al.  The ISNT Rule: How Often Does It Apply to Disc Photographs and Retinal Nerve Fiber Layer Measurements in the Normal Population? , 2017, American journal of ophthalmology.

[44]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[45]  Weidong (Tom) Cai,et al.  A Deep Learning-Based Algorithm Identifies Glaucomatous Discs Using Monoscopic Fundus Photographs. , 2018, Ophthalmology. Glaucoma.

[46]  Christopher Bowd,et al.  Performance of Deep Learning Architectures and Transfer Learning for Detecting Glaucomatous Optic Neuropathy in Fundus Photographs , 2018, Scientific Reports.

[47]  Jonathan Krause,et al.  Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy , 2017, Ophthalmology.

[48]  Hiroshi Murata,et al.  Development of a deep residual learning algorithm to screen for glaucoma from fundus photography , 2018, Scientific Reports.

[49]  M. He,et al.  Efficacy of a Deep Learning System for Detecting Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. , 2018, Ophthalmology.

[50]  G. Corrado,et al.  Using a Deep Learning Algorithm and Integrated Gradients Explanation to Assist Grading for Diabetic Retinopathy. , 2019, Ophthalmology.