A deep learning approach to predict visual field using optical coherence tomography

We developed a deep learning architecture based on Inception V3 to predict visual field using optical coherence tomography (OCT) imaging and evaluated its performance. Two OCT images, macular ganglion cell-inner plexiform layer (mGCIPL) and peripapillary retinal nerve fibre layer (pRNFL) thicknesses, were acquired and combined. A convolutional neural network architecture was constructed to predict visual field using this combined OCT image. The root mean square error (RMSE) between the actual and predicted visual fields was calculated to evaluate the performance. Globally (the entire visual field area), the RMSE for all patients was 4.79 ± 2.56 dB, with 3.27 dB and 5.27 dB for the normal and glaucoma groups, respectively. The RMSE of the macular region (4.40 dB) was higher than that of the peripheral region (4.29 dB) for all subjects. In normal subjects, the RMSE of the macular region (2.45 dB) was significantly lower than that of the peripheral region (3.11 dB), whereas in glaucoma subjects, the RMSE was higher (5.62 dB versus 5.03 dB, respectively). The deep learning method effectively predicted the visual field 24–2 using the combined OCT image. This method may help clinicians determine visual fields, particularly for patients who are unable to undergo a physical visual field exam.

[1]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  G. Wollstein,et al.  Variation in optic nerve and macular structure with age and race with spectral-domain optical coherence tomography. , 2011, Ophthalmology.

[3]  S. Resnikoff,et al.  Global data on visual impairment in the year 2002. , 2004, Bulletin of the World Health Organization.

[4]  Samin Hong,et al.  Reproducibility of peripapillary retinal nerve fiber layer thickness with spectral domain cirrus high-definition optical coherence tomography in normal eyes , 2010, Japanese Journal of Ophthalmology.

[5]  Erik L. Greve,et al.  RESULTS OF A FLUCTUATION ANALYSIS AND DEFECT VOLUME PROGRAM FOR AUTOMATED STATIC THRESHOLD PERIMETRY WITH THE SCOPERIMETER , 1985 .

[6]  The Fast Component of Visual Field Decay Rate Correlates With Disc Rim Area Change Throughout the Entire Range of Glaucomatous Damage. , 2015, Investigative ophthalmology & visual science.

[7]  K. Hirooka,et al.  Correlation between the ganglion cell-inner plexiform layer thickness measured with cirrus HD-OCT and macular visual field sensitivity measured with microperimetry. , 2013, Investigative ophthalmology & visual science.

[8]  Milan Sonka,et al.  Optical Coherence Tomography Analysis Based Prediction of Humphrey 24-2 Visual Field Thresholds in Patients With Glaucoma , 2017, Investigative ophthalmology & visual science.

[9]  Haogang Zhu,et al.  Predicting visual function from the measurements of retinal nerve fiber layer structure. , 2010, Investigative ophthalmology & visual science.

[10]  T. Wong,et al.  Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. , 2014, Ophthalmology.

[11]  L Brigatti,et al.  Neural networks to identify glaucoma with structural and functional measurements. , 1996, American journal of ophthalmology.

[12]  Johannes F de Boer,et al.  Correlation of retinal nerve fiber layer thickness and visual fields in glaucoma: a broken stick model. , 2014, American journal of ophthalmology.

[13]  Chris A Johnson,et al.  Evaluation of the structure-function relationship in glaucoma. , 2005, Investigative ophthalmology & visual science.

[14]  Eun Suk Lee,et al.  Comparing the ganglion cell complex and retinal nerve fibre layer measurements by Fourier domain OCT to detect glaucoma in high myopia , 2010, British Journal of Ophthalmology.

[15]  Hiroshi Ishikawa,et al.  Optical coherence tomography (OCT) macular and peripapillary retinal nerve fiber layer measurements and automated visual fields. , 2004, American journal of ophthalmology.

[16]  Josef Flammer,et al.  The learning and fatigue effect in automated perimetry , 2004, Graefe's Archive for Clinical and Experimental Ophthalmology.

[17]  A. Ferreras,et al.  Long-term perimetric fluctuation in patients with different stages of glaucoma , 2010, British Journal of Ophthalmology.

[18]  J. Caprioli,et al.  Detection of structural damage from glaucoma with confocal laser image analysis. , 1996, Investigative ophthalmology & visual science.

[19]  J. Folch,et al.  Reproducibility of Peripapillary Retinal Nerve Fiber Thickness Measurements with Stratus OCT in Glaucomatous Eyes , 2008 .

[20]  G. Savini,et al.  The influence of axial length on retinal nerve fibre layer thickness and optic-disc size measurements by spectral-domain OCT , 2011, British Journal of Ophthalmology.

[21]  Elena Garcia-Martin,et al.  Intra and interoperator reproducibility of retinal nerve fibre and macular thickness measurements using Cirrus Fourier‐domain OCT , 2011, Acta ophthalmologica.

[22]  Chris A. Johnson,et al.  Influence of glaucomatous visual field loss on health-related quality of life. , 1997, Archives of ophthalmology.

[23]  D. Garway-Heath,et al.  Mapping the visual field to the optic disc in normal tension glaucoma eyes. , 2000, Ophthalmology.

[24]  J. Jonas,et al.  Pattern of glaucomatous neuroretinal rim loss. , 1993, Ophthalmology.

[25]  C. O'brien,et al.  Quality of Life in Glaucoma and Its Relationship with Visual Function , 2003, Journal of glaucoma.

[26]  T. Chen,et al.  Correlation of localized glaucomatous visual field defects and spectral domain optical coherence tomography retinal nerve fiber layer thinning using a modified structure–function map for OCT , 2015, Eye.

[27]  L. Tang,et al.  The diagnostic accuracy of an intelligent and automated fundus disease image assessment system with lesion quantitative function (SmartEye) in diabetic patients , 2019, BMC Ophthalmology.

[28]  Neil J. Joshi,et al.  Utility of Deep Learning Methods for Referability Classification of Age-Related Macular Degeneration , 2018, JAMA ophthalmology.

[29]  W. Argus,et al.  Fluctuations on the Humphrey and Octopus perimeters. , 1987, Investigative ophthalmology & visual science.

[30]  P. Foster,et al.  The definition and classification of glaucoma in prevalence surveys , 2002, The British journal of ophthalmology.

[31]  Esteban Morales,et al.  The relationship between central visual field sensitivity and macular ganglion cell/inner plexiform layer thickness in glaucoma , 2017, British Journal of Ophthalmology.

[32]  Yifan Peng,et al.  DeepSeeNet: A deep learning model for automated classification of patient-based age-related macular degeneration severity from color fundus photographs , 2018, Ophthalmology.

[33]  Lindsey S. Folio,et al.  Retinal nerve fibre layer and visual function loss in glaucoma: the tipping point , 2011, British Journal of Ophthalmology.

[34]  G. Wollstein,et al.  Reproducibility of nerve fiber thickness, macular thickness, and optic nerve head measurements using StratusOCT. , 2004, Investigative ophthalmology & visual science.

[35]  D. Hood,et al.  Deriving visual field loss based upon OCT of inner retinal thicknesses of the macula , 2011, Biomedical optics express.

[36]  Robert N Weinreb,et al.  Comparing neural networks and linear discriminant functions for glaucoma detection using confocal scanning laser ophthalmoscopy of the optic disc. , 2002, Investigative ophthalmology & visual science.

[37]  P. Carpineto,et al.  Reproducibility and Repeatability of Cirrus™ HD-OCT Peripapillary Retinal Nerve Fibre Layer Thickness Measurements in Young Normal Subjects , 2012, Ophthalmologica.

[38]  Milan Sonka,et al.  Relationships of retinal structure and humphrey 24-2 visual field thresholds in patients with glaucoma. , 2014, Investigative ophthalmology & visual science.

[39]  P. Carpineto,et al.  Reliability of nerve fiber layer thickness measurements using optical coherence tomography in normal and glaucomatous eyes. , 2003, Ophthalmology.

[40]  J. Wild,et al.  The influence of the learning effect on automated perimetry in patients with suspected glaucoma , 1989, Acta ophthalmologica.

[41]  Robert N Weinreb,et al.  Deep Learning Approaches Predict Glaucomatous Visual Field Damage from OCT Optic Nerve Head En Face Images and Retinal Nerve Fiber Layer Thickness Maps. , 2019, Ophthalmology.

[42]  Douglas R. Anderson,et al.  Reproducibility of peripapillary retinal nerve fiber thickness measurements with stratus OCT in glaucomatous eyes. , 2008, Ophthalmology.

[43]  Eun Suk Lee,et al.  Structure-function relationship and diagnostic value of macular ganglion cell complex measurement using Fourier-domain OCT in glaucoma. , 2010, Investigative ophthalmology & visual science.

[44]  Werner Dubitzky,et al.  Fundamentals of Data Mining in Genomics and Proteomics , 2009 .

[45]  Jeffrey M. Liebmann,et al.  Macular and Retinal Nerve Fiber Layer Thickness Measurement Reproducibility Using Optical Coherence Tomography (OCT-3) , 2003, Journal of glaucoma.

[46]  D. Hood,et al.  Retinal ganglion cell layer thickness and local visual field sensitivity in glaucoma. , 2011, Archives of ophthalmology.