Retinal Boundary Segmentation in Stargardt Disease Optical Coherence Tomography Images Using Automated Deep Learning

Purpose To use a deep learning model to develop a fully automated method (fully semantic network and graph search [FS-GS]) of retinal segmentation for optical coherence tomography (OCT) images from patients with Stargardt disease. Methods Eighty-seven manually segmented (ground truth) OCT volume scan sets (5171 B-scans) from 22 patients with Stargardt disease were used for training, validation and testing of a novel retinal boundary detection approach (FS-GS) that combines a fully semantic deep learning segmentation method, which generates a per-pixel class prediction map with a graph-search method to extract retinal boundary positions. The performance was evaluated using the mean absolute boundary error and the differences in two clinical metrics (retinal thickness and volume) compared with the ground truth. The performance of a separate deep learning method and two publicly available software algorithms were also evaluated against the ground truth. Results FS-GS showed an excellent agreement with the ground truth, with a boundary mean absolute error of 0.23 and 1.12 pixels for the internal limiting membrane and the base of retinal pigment epithelium or Bruch's membrane, respectively. The mean difference in thickness and volume across the central 6 mm zone were 2.10 µm and 0.059 mm3. The performance of the proposed method was more accurate and consistent than the publicly available OCTExplorer and AURA tools. Conclusions The FS-GS method delivers good performance in segmentation of OCT images of pathologic retina in Stargardt disease. Translational Relevance Deep learning models can provide a robust method for retinal segmentation and support a high-throughput analysis pipeline for measuring retinal thickness and volume in Stargardt disease.

[1]  Philip J Rosenfeld,et al.  Complement C3 Inhibitor Pegcetacoplan for Geographic Atrophy Secondary to Age-Related Macular Degeneration: A Randomized Phase 2 Trial. , 2020, Ophthalmology.

[2]  S. Sadda,et al.  Impact of segmentation density on spectral domain optical coherence tomography assessment in Stargardt disease , 2019, Graefe's Archive for Clinical and Experimental Ophthalmology.

[3]  Peter A. Calabresi,et al.  Deep learning based topology guaranteed surface and MME segmentation of multiple sclerosis subjects from retinal OCT. , 2019, Biomedical optics express.

[4]  Martin Klein,et al.  Application of a Deep Machine Learning Model for Automatic Measurement of EZ Width in SD-OCT Images of RP , 2020, Translational vision science & technology.

[5]  Richard Parsons,et al.  Prevalence of blindness in Western Australia: a population study using capture and recapture techniques , 2011, British Journal of Ophthalmology.

[6]  Beatriz Munoz,et al.  Reproducibility of Measurements of Retinal Structural Parameters Using Optical Coherence Tomography in Stargardt Disease , 2019, Translational vision science & technology.

[7]  Bryan M. Wong,et al.  Validation of Optical Coherence Tomography Retinal Segmentation in Neurodegenerative Disease , 2019, Translational vision science & technology.

[8]  Stanley Chang,et al.  Disruption in Bruch membrane in patients with Stargardt disease , 2012, Ophthalmic genetics.

[9]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  K. A. Vermeer,et al.  Automated segmentation by pixel classification of retinal layers in ophthalmic OCT images , 2011, Biomedical optics express.

[11]  David Alonso-Caneiro,et al.  Automatic segmentation of OCT retinal boundaries using recurrent neural networks and graph search. , 2018, Biomedical optics express.

[12]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Pearse A Keane,et al.  Segmentation error in spectral domain optical coherence tomography measures of the retinal nerve fibre layer thickness in idiopathic intracranial hypertension , 2017, BMC Ophthalmology.

[14]  David Alonso-Caneiro,et al.  Effect of Altered OCT Image Quality on Deep Learning Boundary Segmentation , 2020, IEEE Access.

[15]  Joseph A. Izatt,et al.  Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation , 2010, Optics express.

[16]  Jay S Duker,et al.  Morphology and Vascular Layers of the Choroid in Stargardt Disease Analyzed Using Spectral-Domain Optical Coherence Tomography. , 2014, American journal of ophthalmology.

[17]  Sebastien Ourselin,et al.  Automatic Cone Photoreceptor Localisation in Healthy and Stargardt Afflicted Retinas Using Deep Learning , 2018, Scientific Reports.

[18]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[19]  Thomas Theelen,et al.  Robust total retina thickness segmentation in optical coherence tomography images using convolutional neural networks. , 2017, Biomedical optics express.

[20]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[21]  G Soubrane,et al.  Analysis of retinal flecks in fundus flavimaculatus using optical coherence tomography , 2006, British Journal of Ophthalmology.

[22]  Xiaodong Wu,et al.  Simultaneous Multiple Surface Segmentation Using Deep Learning , 2017, DLMIA/ML-CDS@MICCAI.

[23]  Jerry L Prince,et al.  Retinal layer segmentation of macular OCT images using boundary classification , 2013, Biomedical optics express.

[24]  William H Morgan,et al.  Impact of retinal pigment epithelium pathology on spectral‐domain optical coherence tomography‐derived macular thickness and volume metrics and their intersession repeatability , 2017, Clinical & experimental ophthalmology.

[25]  Delia Cabrera DeBuc,et al.  Deep Learning based Retinal OCT Segmentation , 2018, Comput. Biol. Medicine.

[26]  Xiaodong Wu,et al.  Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images , 2009, IEEE Transactions on Medical Imaging.

[27]  Kai Hu,et al.  Automatic segmentation of retinal layer boundaries in OCT images using multiscale convolutional neural network and graph search , 2019, Neurocomputing.

[28]  Jay Chhablani,et al.  Segmentation errors in macular ganglion cell analysis as determined by optical coherence tomography in eyes with macular pathology , 2017, International Journal of Retina and Vitreous.

[29]  Adnan Tufail,et al.  Segmentation error in Stratus optical coherence tomography for neovascular age-related macular degeneration. , 2009, Investigative ophthalmology & visual science.

[30]  Zeyun Yu,et al.  State-of-the-Art in Retinal Optical Coherence Tomography Image Analysis , 2014, Quantitative imaging in medicine and surgery.

[31]  Sina Farsiu,et al.  Automatic segmentation of up to ten layer boundaries in SD-OCT images of the mouse retina with and without missing layers due to pathology. , 2014, Biomedical optics express.

[32]  C Ross Ethier,et al.  Shadow removal and contrast enhancement in optical coherence tomography images of the human optic nerve head. , 2011, Investigative ophthalmology & visual science.

[33]  Sina Farsiu,et al.  Deep longitudinal transfer learning-based automatic segmentation of photoreceptor ellipsoid zone defects on optical coherence tomography images of macular telangiectasia type 2 , 2018, Biomedical optics express.

[34]  Gustavo Carneiro,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[35]  David Alonso-Caneiro,et al.  Automatic choroidal segmentation in OCT images using supervised deep learning methods , 2019, Scientific Reports.

[36]  Fei Li,et al.  Joint retina segmentation and classification for early glaucoma diagnosis. , 2019, Biomedical optics express.

[37]  Adnan Tufail,et al.  Choroidal imaging in inherited retinal disease using the technique of enhanced depth imaging optical coherence tomography , 2010, Graefe's Archive for Clinical and Experimental Ophthalmology.

[38]  David Alonso-Caneiro,et al.  Effect of patch size and network architecture on a convolutional neural network approach for automatic segmentation of OCT retinal layers. , 2018, Biomedical optics express.

[39]  LiKang,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006 .

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  F. Cremers,et al.  Clinical spectrum, genetic complexity and therapeutic approaches for retinal disease caused by ABCA4 mutations , 2020, Progress in Retinal and Eye Research.

[42]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[43]  Delia Cabrera DeBuc,et al.  A Review of Algorithms for Segmentation of Retinal Image Data Using Optical Coherence Tomography , 2011 .

[44]  Hendrik P N Scholl,et al.  Assessment of estimated retinal atrophy progression in Stargardt macular dystrophy using spectral-domain optical coherence tomography , 2015, British Journal of Ophthalmology.

[45]  M. G. Penedo,et al.  Robust segmentation of retinal layers in optical coherence tomography images based on a multistage active contour model , 2019, Heliyon.

[46]  Yupeng Xu,et al.  Dual-stage deep learning framework for pigment epithelium detachment segmentation in polypoidal choroidal vasculopathy. , 2017, Biomedical optics express.

[47]  Gerald Liew,et al.  A comparison of the causes of blindness certifications in England and Wales in working age adults (16–64 years), 1999–2000 with 2009–2010 , 2014, BMJ Open.

[48]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.