Automated detection and classification of early AMD biomarkers using deep learning

Age-related macular degeneration (AMD) affects millions of people and is a leading cause of blindness throughout the world. Ideally, affected individuals would be identified at an early stage before late sequelae such as outer retinal atrophy or exudative neovascular membranes develop, which could produce irreversible visual loss. Early identification could allow patients to be staged and appropriate monitoring intervals to be established. Accurate staging of earlier AMD stages could also facilitate the development of new preventative therapeutics. However, accurate and precise staging of AMD, particularly using newer optical coherence tomography (OCT)-based biomarkers may be time-intensive and requires expert training which may not feasible in many circumstances, particularly in screening settings. In this work we develop deep learning method for automated detection and classification of early AMD OCT biomarker. Deep convolution neural networks (CNN) were explicitly trained for performing automated detection and classification of hyperreflective foci, hyporeflective foci within the drusen, and subretinal drusenoid deposits from OCT B-scans. Numerous experiments were conducted to evaluate the performance of several state-of-the-art CNNs and different transfer learning protocols on an image dataset containing approximately 20000 OCT B-scans from 153 patients. An overall accuracy of 87% for identifying the presence of early AMD biomarkers was achieved.

[1]  B. Lujan,et al.  Spectral domain optical coherence tomography imaging of drusen in nonexudative age-related macular degeneration. , 2011, Ophthalmology.

[2]  William J Feuer,et al.  Quantitative imaging of retinal pigment epithelial detachments using spectral-domain optical coherence tomography. , 2012, American journal of ophthalmology.

[3]  Ronald Klein,et al.  A simplified severity scale for age-related macular degeneration: AREDS Report No. 18. , 2005, Archives of ophthalmology.

[4]  Christopher Bowd,et al.  Performance of Deep Learning Architectures and Transfer Learning for Detecting Glaucomatous Optic Neuropathy in Fundus Photographs , 2018, Scientific Reports.

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[7]  Q. Nguyen,et al.  Emixustat and Lampalizumab: Potential Therapeutic Options for Geographic Atrophy. , 2016, Developments in ophthalmology.

[8]  Bianca S. Gerendas,et al.  Prediction of Individual Disease Conversion in Early AMD Using Artificial Intelligence. , 2018, Investigative ophthalmology & visual science.

[9]  P. Kertes,et al.  POTENTIAL PUBLIC HEALTH IMPACT OF AGE-RELATED EYE DISEASE STUDY RESULTS: AREDS REPORT NO. 11 , 2004 .

[10]  Xinjian Chen,et al.  An automated framework for 3D serous pigment epithelium detachment segmentation in SD-OCT images , 2016, Scientific Reports.

[11]  S. Lee,et al.  Automated characterization of pigment epithelial detachment by optical coherence tomography. , 2012, Investigative ophthalmology & visual science.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  L. Ayton,et al.  Reticular pseudodrusen: a risk factor for geographic atrophy in fellow eyes of individuals with unilateral choroidal neovascularization. , 2014, Ophthalmology.

[15]  Yalin Zheng,et al.  Computerized assessment of intraretinal and subretinal fluid regions in spectral-domain optical coherence tomography images of the retina. , 2013, American journal of ophthalmology.

[16]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[17]  Sina Farsiu,et al.  Validated automatic segmentation of AMD pathology including drusen and geographic atrophy in SD-OCT images. , 2012, Investigative ophthalmology & visual science.

[18]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[19]  Thomas Schultz,et al.  Algorithms for the Automated Analysis of Age-Related Macular Degeneration Biomarkers on Optical Coherence Tomography: A Systematic Review , 2017, Translational vision science & technology.

[20]  Jennifer I. Lim,et al.  A randomized, placebo-controlled, clinical trial of high-dose supplementation with vitamins C and E, beta carotene, and zinc for age-related macular degeneration and vision loss: AREDS report no. 8. , 2001, Archives of ophthalmology.

[21]  Qiang Chen,et al.  Automated drusen segmentation and quantification in SD-OCT images , 2013, Medical Image Anal..

[22]  Pearse A Keane,et al.  Optical coherence tomography-based observation of the natural history of drusenoid lesion in eyes with dry age-related macular degeneration. , 2013, Ophthalmology.

[23]  P. Rosenfeld,et al.  Drusen Volume as a Predictor of Disease Progression in Patients With Late Age-Related Macular Degeneration in the Fellow Eye. , 2016, Investigative ophthalmology & visual science.

[24]  Zhihong Hu,et al.  Segmentation of the geographic atrophy in spectral-domain optical coherence tomography and fundus autofluorescence images. , 2013, Investigative ophthalmology & visual science.

[25]  S. Sadda,et al.  DRUSEN MEASUREMENTS COMPARISON BY FUNDUS PHOTOGRAPH MANUAL DELINEATION VERSUS OPTICAL COHERENCE TOMOGRAPHY RETINAL PIGMENT EPITHELIAL SEGMENTATION AUTOMATED ANALYSIS , 2014, Retina.

[26]  D. Rubin,et al.  Semi-automatic geographic atrophy segmentation for SD-OCT images. , 2013, Biomedical optics express.

[27]  K Bailey Freund,et al.  Association between geographic atrophy progression and reticular pseudodrusen in eyes with dry age-related macular degeneration. , 2013, Investigative ophthalmology & visual science.

[28]  S. Sadda,et al.  Quantity of Intraretinal Hyperreflective Foci in Patients With Intermediate Age-Related Macular Degeneration Correlates With 1-Year Progression. , 2018, Investigative ophthalmology & visual science.

[29]  U. Schmidt-Erfurth,et al.  Automatic segmentation in three-dimensional analysis of fibrovascular pigmentepithelial detachment using high-definition optical coherence tomography , 2007, British Journal of Ophthalmology.

[30]  Sajib Saha,et al.  Deep Learning for Automatic Detection and Classification of Microaneurysms, Hard and Soft Exudates, and Hemorrhages for Diabetic Retinopathy Diagnosis , 2016 .

[31]  Sajib Saha,et al.  Automated Quality Assessment of Colour Fundus Images for Diabetic Retinopathy Screening in Telemedicine , 2018, Journal of Digital Imaging.

[32]  Daisuke Iwama,et al.  Automated assessment of drusen using three-dimensional spectral-domain optical coherence tomography. , 2012, Investigative ophthalmology & visual science.

[33]  Sina Farsiu,et al.  Quantitative comparison of drusen segmented on SD-OCT versus drusen delineated on color fundus photographs. , 2010, Investigative ophthalmology & visual science.

[34]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[35]  William J Feuer,et al.  Comparison of geographic atrophy measurements from the OCT fundus image and the sub-RPE slab image. , 2013, Ophthalmic surgery, lasers & imaging retina.

[36]  J. J. Wang,et al.  The prevalence of age-related maculopathy: the visual impairment project. , 2000, Ophthalmology.

[37]  Xinjian Chen,et al.  Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images With Serous Pigment Epithelial Detachments , 2015, IEEE Transactions on Medical Imaging.

[38]  Matthew D. Davis,et al.  The Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration , 2015 .

[39]  Johanna M Seddon,et al.  Potential public health impact of Age-Related Eye Disease Study results: AREDS report no. 11. , 2003, Archives of ophthalmology.

[40]  Oscar Martinez,et al.  Geometric Deformable Model Driven by CoCRFs: Application to Optical Coherence Tomography , 2008, MICCAI.

[41]  G. Ying,et al.  Pseudodrusen and Incidence of Late Age-Related Macular Degeneration in Fellow Eyes in the Comparison of Age-Related Macular Degeneration Treatments Trials. , 2016, Ophthalmology.

[42]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[43]  Joel S Schuman,et al.  Documentation of intraretinal retinal pigment epithelium migration via high-speed ultrahigh-resolution optical coherence tomography. , 2010, Ophthalmology.

[44]  S. Sadda,et al.  Proposal of a simple optical coherence tomography-based scoring system for progression of age-related macular degeneration , 2017, Graefe's Archive for Clinical and Experimental Ophthalmology.

[45]  Matthäus Pilch,et al.  Automated segmentation of pathological cavities in optical coherence tomography scans. , 2013, Investigative ophthalmology & visual science.

[46]  J. Vander,et al.  The Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration: AREDS Report No 17 , 2006 .

[47]  Delia Cabrera Fernandez,et al.  Delineating fluid-filled region boundaries in optical coherence tomography images of the retina , 2005, IEEE Transactions on Medical Imaging.

[48]  J. J. Wang,et al.  Prevalence of age-related maculopathy in Australia. The Blue Mountains Eye Study. , 1995, Ophthalmology.

[49]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[50]  Sina Farsiu,et al.  Fast detection and segmentation of drusen in retinal optical coherence tomography images , 2008, SPIE BiOS.

[51]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[52]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[53]  I. Perlman,et al.  Light Modulates Ocular Complications in an Albino Rat Model of Type 1 Diabetes Mellitus , 2017, Translational vision science & technology.

[54]  Robert Tibshirani,et al.  Quantitative SD-OCT imaging biomarkers as indicators of age-related macular degeneration progression. , 2014, Investigative ophthalmology & visual science.

[55]  R. Klein,et al.  The five-year incidence and progression of age-related maculopathy: the Beaver Dam Eye Study. , 1997, Ophthalmology.

[56]  Valery Naranjo,et al.  CNNs for automatic glaucoma assessment using fundus images: an extensive validation , 2019, BioMedical Engineering OnLine.

[57]  Jae Y. Shin,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE transactions on medical imaging.