Detecting Retinal Nerve Fibre Layer Segmentation Errors on Spectral Domain-Optical Coherence Tomography with a Deep Learning Algorithm

In this study we developed a deep learning (DL) algorithm that detects errors in retinal never fibre layer (RNFL) segmentation on spectral-domain optical coherence tomography (SDOCT) B-scans using human grades as the reference standard. A dataset of 25,250 SDOCT B-scans reviewed for segmentation errors by human graders was randomly divided into validation plus training (50%) and test (50%) sets. The performance of the DL algorithm was evaluated in the test sample by outputting a probability of having a segmentation error for each B-scan. The ability of the algorithm to detect segmentation errors was evaluated with the area under the receiver operating characteristic (ROC) curve. Mean DL probabilities of segmentation error in the test sample were 0.90 ± 0.17 vs. 0.12 ± 0.22 (P < 0.001) for scans with and without segmentation errors, respectively. The DL algorithm had an area under the ROC curve of 0.979 (95% CI: 0.974 to 0.984) and an overall accuracy of 92.4%. For the B-scans with severe segmentation errors in the test sample, the DL algorithm was 98.9% sensitive. This algorithm can help clinicians and researchers review images for artifacts in SDOCT tests in a timely manner and avoid inaccurate diagnostic interpretations.

[1]  L. Labree,et al.  Factors associated with variability in retinal nerve fiber layer thickness measurements obtained by optical coherence tomography. , 2007, Ophthalmology.

[2]  Abhishek Das,et al.  Grad-CAM: Why did you say that? , 2016, ArXiv.

[3]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[4]  F. Medeiros,et al.  A statistical approach to the evaluation of covariate effects on the receiver operating characteristic curves of diagnostic tests in glaucoma. , 2006, Investigative ophthalmology & visual science.

[5]  Giovanni Staurenghi,et al.  ARTIFACTS IN AUTOMATIC RETINAL SEGMENTATION USING DIFFERENT OPTICAL COHERENCE TOMOGRAPHY INSTRUMENTS , 2010, Retina.

[6]  Valery V Tuchin,et al.  Measurement of tissue optical properties in the context of tissue optical clearing , 2018, Journal of biomedical optics.

[7]  F. Medeiros,et al.  A Deep Learning Algorithm to Quantify Neuroretinal Rim Loss From Optic Disc Photographs. , 2019, American journal of ophthalmology.

[8]  Jing Tian,et al.  Performance evaluation of automated segmentation software on optical coherence tomography volume data , 2016, Journal of biophotonics.

[9]  F. Medeiros,et al.  Evaluation of retinal nerve fiber layer, optic nerve head, and macular thickness measurements for glaucoma detection using optical coherence tomography. , 2005, American journal of ophthalmology.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  H. Quigley,et al.  Evaluation of Automated Segmentation Algorithms for Optic Nerve Head Structures in Optical Coherence Tomography Images. , 2018, Investigative ophthalmology & visual science.

[12]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[13]  Takashi Fujikado,et al.  Prevalence and Associated Factors of Segmentation Errors in the Peripapillary Retinal Nerve Fiber Layer and Macular Ganglion Cell Complex in Spectral-domain Optical Coherence Tomography Images , 2017, Journal of glaucoma.

[14]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[15]  G. Ripandelli,et al.  Optical coherence tomography. , 1998, Seminars in ophthalmology.

[16]  Gadi Wollstein,et al.  Clinical Utility of Optical Coherence Tomography in Glaucoma , 2016, Investigative ophthalmology & visual science.

[17]  Felipe A. Medeiros,et al.  From Machine to Machine: An OCT-trained Deep Learning Algorithm for Objective Quantification of Glaucomatous Damage in Fundus Photographs , 2018, Ophthalmology.

[18]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[19]  R. Lee,et al.  Glaucoma versus red disease: imaging and glaucoma diagnosis , 2012, Current opinion in ophthalmology.

[20]  M. He,et al.  Efficacy of a Deep Learning System for Detecting Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. , 2018, Ophthalmology.

[21]  Robert N. Weinreb,et al.  Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography: a variability and diagnostic performance study. , 2010, Ophthalmology.

[22]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Dong Myung Kim,et al.  Long-term reproducibility of cirrus HD optical coherence tomography deviation map in clinically stable glaucomatous eyes. , 2013, Ophthalmology.

[24]  Edem Tsikata,et al.  Patient characteristics associated with artifacts in Spectralis optical coherence tomography imaging of the retinal nerve fiber layer in glaucoma. , 2015, American journal of ophthalmology.

[25]  Sanjay Asrani,et al.  Artifacts in spectral-domain optical coherence tomography measurements in glaucoma. , 2014, JAMA ophthalmology.

[26]  Xiao-Hua Zhou,et al.  Analysis of Correlated ROC Data , 2008 .

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Joel S Schuman,et al.  Assessment of artifacts and reproducibility across spectral- and time-domain optical coherence tomography devices. , 2009, Ophthalmology.

[29]  Delia Cabrera DeBuc,et al.  A Review of Algorithms for Segmentation of Retinal Image Data Using Optical Coherence Tomography , 2011 .

[30]  Gianmarco Vizzeri,et al.  Factors Affecting Cirrus-HD OCT Optic Disc Scan Quality: A Review with Case Examples , 2015, Journal of ophthalmology.

[31]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[32]  Christopher Bowd,et al.  Does the Location of Bruch's Membrane Opening Change Over Time? Longitudinal Analysis Using San Diego Automated Layer Segmentation Algorithm (SALSA) , 2016, Investigative ophthalmology & visual science.

[33]  F. Medeiros,et al.  Detecting Structural Progression in Glaucoma with Optical Coherence Tomography. , 2017, Ophthalmology.

[34]  Robert N Weinreb,et al.  Comparison of the diagnostic accuracies of the Spectralis, Cirrus, and RTVue optical coherence tomography devices in glaucoma. , 2011, Ophthalmology.

[35]  Valery V Tuchin,et al.  Delivery and reveal of localization of upconversion luminescent microparticles and quantum dots in the skin in vivo by fractional laser microablation, multimodal imaging, and optical clearing , 2018, Journal of biomedical optics.

[36]  S. Mansberger,et al.  Automated Segmentation Errors When Using Optical Coherence Tomography to Measure Retinal Nerve Fiber Layer Thickness in Glaucoma. , 2017, American journal of ophthalmology.

[37]  J. Goldberg,et al.  The Frequency of Optical Coherence Tomography Testing in Glaucoma at a Single Academic Medical Center , 2012, Journal of glaucoma.

[38]  B. Nan,et al.  Trends in use of ancillary glaucoma tests for patients with open-angle glaucoma from 2001 to 2009. , 2012, Ophthalmology.