Application of a Deep Machine Learning Model for Automatic Measurement of EZ Width in SD-OCT Images of RP

Purpose We applied a deep convolutional neural network model for automatic identification of ellipsoid zone (EZ) in spectral domain optical coherence tomography B-scans of retinitis pigmentosa (RP). Methods Midline B-scans having visible EZ from 220 patients with RP and 20 normal subjects were manually segmented for inner limiting membrane, inner nuclear layer, EZ, retinal pigment epithelium, and Bruch's membrane. A total of 2.87 million labeled image patches (33 × 33 pixels) extracted from 480 B-scans were used for training a convolutional neural network model implemented in MATLAB. B-scans from a separate group of 80 patients with RP were used for testing the model. A local connected area searching algorithm was developed to process the model output for reconstructing layer boundaries. Correlation and Bland-Altman analyses were conducted to compare EZ width measured by the model to those by manual segmentation. Results The accuracy of the trained model to identify inner limiting membrane, inner nuclear layer, EZ, retinal pigment epithelium, and Bruch's membrane patches in the test dataset was 98%, 89%, 91%, 94%, and 96%, respectively. The EZ width measured by the model was highly correlated with that by two graders (r = 0.97; P < 0.0001). Bland-Altman analysis revealed a mean EZ width difference of 0.30 mm (coefficient of repeatability = 0.9 mm) between the model and the graders, comparable to the mean difference of 0.34mm (coefficient of repeatability = 0.8 mm) between two graders. Conclusions The results demonstrated the capability of a deep machine learning-based method for automatic identification of EZ in RP, suggesting that the method can be used to quantify structural deficits in RP for detecting disease progression and for evaluating treatment effect. Translational Relevance A deep machine learning model has the potential to replace humans for grading spectral domain optical coherence tomography images in RP.

[1]  A. J. Roman,et al.  Retinal laminar architecture in human retinitis pigmentosa caused by Rhodopsin gene mutations. , 2008, Investigative ophthalmology & visual science.

[2]  Jerry L Prince,et al.  Retinal layer segmentation of macular OCT images using boundary classification , 2013, Biomedical optics express.

[3]  Richard G Weleber,et al.  Quantification of Ellipsoid Zone Changes in Retinitis Pigmentosa Using en Face Spectral Domain-Optical Coherence Tomography. , 2016, JAMA ophthalmology.

[4]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[5]  D. Ward,et al.  New and emerging technologies for the treatment of inherited retinal diseases: a horizon scanning review , 2015, Eye.

[6]  D. Hood,et al.  Spectral-domain optical coherence tomography measures of outer segment layer progression in patients with X-linked retinitis pigmentosa. , 2013, JAMA ophthalmology.

[7]  Erping Long,et al.  Use of a Neural Net to Model the Impact of Optical Coherence Tomography Abnormalities on Vision in Age-related Macular Degeneration. , 2017, American journal of ophthalmology.

[8]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[11]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[12]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[13]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[14]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[15]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[16]  Xian Zhang,et al.  Thickness of receptor and post-receptor retinal layers in patients with retinitis pigmentosa measured with frequency-domain optical coherence tomography. , 2009, Investigative ophthalmology & visual science.

[17]  D. Hood,et al.  Rates of decline in regions of the visual field defined by frequency-domain optical coherence tomography in patients with RPGR-mediated X-linked retinitis pigmentosa. , 2015, Ophthalmology.

[18]  Donald C Hood,et al.  A Comparison of Methods for Tracking Progression in X-Linked Retinitis Pigmentosa Using Frequency Domain OCT. , 2013, Translational vision science & technology.

[19]  Wolfgang Drexler,et al.  Ultra-high resolution optical coherence tomography assessment of photoreceptors in retinitis pigmentosa and related diseases. , 2006, American journal of ophthalmology.

[20]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[21]  Nishanthan Ramachandran,et al.  Diabetic retinopathy screening using deep neural network , 2018, Clinical & experimental ophthalmology.

[22]  Sina Farsiu,et al.  Deep longitudinal transfer learning-based automatic segmentation of photoreceptor ellipsoid zone defects on optical coherence tomography images of macular telangiectasia type 2 , 2018, Biomedical optics express.

[23]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[24]  Joseph A. Izatt,et al.  Automatic segmentation of closed-contour features in ophthalmic images using graph theory and dynamic programming , 2012, Biomedical optics express.

[25]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).