Deep learning-based detection and classification of geographic atrophy using a deep convolutional neural network classifier

PurposeTo automatically detect and classify geographic atrophy (GA) in fundus autofluorescence (FAF) images using a deep learning algorithm.MethodsIn this study, FAF images of patients with GA, a healthy comparable group and a comparable group with other retinal diseases (ORDs) were used to train a multi-layer deep convolutional neural network (DCNN) (1) to detect GA and (2) to differentiate in GA between a diffuse-trickling pattern (dt-GA) and other GA FAF patterns (ndt-GA) in FAF images.1.For the automated detection of GA in FAF images, two classifiers were built (GA vs. healthy/GA vs. ORD). The DCNN was trained and validated with 400 FAF images in each case (GA 200, healthy 200, or ORD 200). For the subsequent testing, the built classifiers were then tested with 60 untrained FAF images in each case (AMD 30, healthy 30, or ORD 30). Hereby, both classifiers automatically determined a GA probability score and a normal FAF probability score or an ORD probability score.2.To automatically differentiate between dt-GA and ndt-GA, the DCNN was trained and validated with 200 FAF images (dt-GA 72; ndt-GA 138). Afterwards, the built classifier was tested with 20 untrained FAF images (dt-GA 10; ndt-GA 10) and a dt-GA probability score and an ndt-GA probability score was calculated.For both classifiers, the performance of the training and validation procedure after 500 training steps was measured by determining training accuracy, validation accuracy, and cross entropy.ResultsFor the GA classifiers (GA vs. healthy/GA vs. ORD), the achieved training accuracy was 99/98%, the validation accuracy 96/91%, and the cross entropy 0.062/0.100. For the dt-GA classifier, the training accuracy was 99%, the validation accuracy 77%, and the cross entropy 0.166.The mean GA probability score was 0.981 ± 0.048 (GA vs. healthy)/0.972 ± 0.439 (GA vs. ORD) in the GA image group and 0.01 ± 0.016 (healthy)/0.061 ± 0.072 (ORD) in the comparison groups (p < 0.001). The mean dt-GA probability score was 0.807 ± 0.116 in the dt-GA image group and 0.180 ± 0.100 in the ndt-GA image group (p < 0.001).ConclusionFor the first time, this study describes the use of a deep learning-based algorithm to automatically detect and classify GA in FAF. Hereby, the created classifiers showed excellent results. With further developments, this model may be a tool to predict the individual progression risk of GA and give relevant information for future therapeutic approaches.

[1]  K. Balaskas,et al.  Use of a Neural Net to Model the Impact of Optical Coherence Tomography Abnormalities on Vision in Age-related Macular Degeneration. , 2018, American journal of ophthalmology.

[2]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[3]  Mark J J P van Grinsven,et al.  Automated Staging of Age-Related Macular Degeneration Using Optical Coherence Tomography. , 2017, Investigative ophthalmology & visual science.

[4]  F. Holz,et al.  Agreement among ophthalmologists in evaluating fluorescein angiograms in patients with neovascular age-related macular degeneration for photodynamic therapy eligibility (FLAP-study). , 2003, Ophthalmology.

[5]  Philippe Burlina,et al.  Automated segmentation of geographic atrophy of the retinal epithelium via random forests in AREDS color fundus images , 2015, Comput. Biol. Medicine.

[6]  A Hofman,et al.  Risk factors for age-related macular degeneration: Pooled findings from three continents. , 2001, Ophthalmology.

[7]  P. Prahs,et al.  OCT-based deep learning algorithm for the evaluation of treatment indication with anti-vascular endothelial growth factor medications , 2017, Graefe's Archive for Clinical and Experimental Ophthalmology.

[8]  F. Holz,et al.  Ätiologie und Pathogenese der altersabhängigen Makuladegeneration , 2013, Der Ophthalmologe.

[9]  C. Keilhauer,et al.  Classification of abnormal fundus autofluorescence patterns in the junctional zone of geographic atrophy in patients with age related macular degeneration , 2005, British Journal of Ophthalmology.

[10]  N. Waheed,et al.  CLINICAL TRIAL ENDPOINTS FOR OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY IN NEOVASCULAR AGE-RELATED MACULAR DEGENERATION. , 2016, Retina.

[11]  Bianca S. Gerendas,et al.  Prediction of Anti-VEGF Treatment Requirements in Neovascular AMD Using a Machine Learning Approach. , 2017, Investigative ophthalmology & visual science.

[12]  Rishi P. Singh,et al.  Fundus Autofluorescence in Age-Related Macular Degeneration , 2007 .

[13]  Jens Dreyhaupt,et al.  Progression of geographic atrophy and impact of fundus autofluorescence patterns in age-related macular degeneration. , 2007, American journal of ophthalmology.

[14]  D. Sarraf,et al.  Clinical applications of fundus autofluorescence in retinal disease , 2016, International Journal of Retina and Vitreous.

[15]  Neil J. Joshi,et al.  Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks , 2017, JAMA ophthalmology.

[16]  Frank Eperjesi,et al.  Risk Factors for Age-related Macular Degeneration , 2011 .

[17]  F. Zhou,et al.  Machine learning based detection of age-related macular degeneration (AMD) and diabetic macular edema (DME) from optical coherence tomography (OCT) images. , 2016, Biomedical optics express.

[18]  M. Treder,et al.  Automated detection of exudative age-related macular degeneration in spectral domain optical coherence tomography using deep learning , 2018, Graefe's Archive for Clinical and Experimental Ophthalmology.

[19]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  O. Stegle,et al.  Deep learning for computational biology , 2016, Molecular systems biology.

[21]  Jens Dreyhaupt,et al.  Correlation between the area of increased autofluorescence surrounding geographic atrophy and disease progression in patients with AMD. , 2006, Investigative ophthalmology & visual science.

[22]  Anna Goldenberg,et al.  TensorFlow: Biology's Gateway to Deep Learning? , 2016, Cell systems.

[23]  Christian Wojek,et al.  Automated Retinal Image Analysis for Evaluation of Focal Hyperpigmentary Changes in Intermediate Age-Related Macular Degeneration , 2016, Translational vision science & technology.

[24]  Philippe Burlina,et al.  Comparing humans and deep learning performance for grading AMD: A study in using universal deep features and transfer learning for automated AMD analysis , 2017, Comput. Biol. Medicine.

[25]  U. Schmidt-Erfurth,et al.  Machine Learning of the Progression of Intermediate Age-Related Macular Degeneration Based on OCT Imaging. , 2017, Investigative ophthalmology & visual science.

[26]  J. Duker,et al.  The role of spectral-domain OCT in the diagnosis and management of neovascular age-related macular degeneration. , 2011, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[27]  Michael Kalloniatis,et al.  Fundus Autofluorescence in Age-related Macular Degeneration , 2017, Optometry and vision science : official publication of the American Academy of Optometry.

[28]  J. Monés,et al.  Intra and interobserver agreement in the classification of fundus autofluorescence patterns in geographic atrophy secondary to age-related macular degeneration , 2012, Graefe's Archive for Clinical and Experimental Ophthalmology.

[29]  Paul Mitchell,et al.  The Progression of Geographic Atrophy Secondary to Age-Related Macular Degeneration. , 2017, Ophthalmology.

[30]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[31]  S. Demirel,et al.  Geographic Atrophy Progression in Eyes with Age-Related Macular Degeneration: Role of Fundus Autofluorescence Patterns, Fellow Eye and Baseline Atrophy Area , 2014, Ophthalmic Research.

[32]  Zhongyang Sun,et al.  Fully automated macular pathology detection in retina optical coherence tomography images using sparse coding and dictionary learning , 2017, Journal of biomedical optics.

[33]  Usha Chakravarthy,et al.  Clinical classification of age-related macular degeneration. , 2013, Ophthalmology.

[34]  N. Bressler,et al.  Agreement of time-domain and spectral-domain optical coherence tomography with fluorescein leakage from choroidal neovascularization. , 2010, Ophthalmology.

[35]  C Bellman,et al.  Fundus autofluorescence and development of geographic atrophy in age-related macular degeneration. , 2001, Investigative ophthalmology & visual science.

[36]  J. Izatt,et al.  Spectral domain optical coherence tomography imaging of geographic atrophy margins. , 2009, Ophthalmology.