Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search.

We present a novel framework combining convolutional neural networks (CNN) and graph search methods (termed as CNN-GS) for the automatic segmentation of nine layer boundaries on retinal optical coherence tomography (OCT) images. CNN-GS first utilizes a CNN to extract features of specific retinal layer boundaries and train a corresponding classifier to delineate a pilot estimate of the eight layers. Next, a graph search method uses the probability maps created from the CNN to find the final boundaries. We validated our proposed method on 60 volumes (2915 B-scans) from 20 human eyes with non-exudative age-related macular degeneration (AMD), which attested to effectiveness of our proposed technique.

[1]  Kim L. Boyer,et al.  Retinal thickness measurements from optical coherence tomography using a Markov boundary model , 2001, IEEE Transactions on Medical Imaging.

[2]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[3]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[4]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[5]  Eric L Yuan,et al.  Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. , 2014, Ophthalmology.

[6]  Srinivas R Sadda,et al.  Evaluation of optical coherence tomography retinal thickness parameters for use in clinical trials for neovascular age-related macular degeneration. , 2009, Investigative ophthalmology & visual science.

[7]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[8]  Sina Farsiu,et al.  Automatic detection of cone photoreceptors in split detector adaptive optics scanning light ophthalmoscope images , 2016, Biomedical optics express.

[9]  Yilong Yin,et al.  Choroid segmentation from Optical Coherence Tomography with graph-edge weights learned from deep convolutional neural networks , 2017, Neurocomputing.

[10]  Sina Farsiu,et al.  Validated automatic segmentation of AMD pathology including drusen and geographic atrophy in SD-OCT images. , 2012, Investigative ophthalmology & visual science.

[11]  Luís Gonçalves,et al.  Multi-surface segmentation of OCT images with AMD using sparse high order potentials. , 2017, Biomedical optics express.

[12]  Sina Farsiu,et al.  Retinal nerve fiber layer thickness in amnestic mild cognitive impairment: Case-control study and meta-analysis , 2016, Alzheimer's & dementia.

[13]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[14]  Shutao Li,et al.  Segmentation Based Sparse Reconstruction of Optical Coherence Tomography Images , 2017, IEEE Transactions on Medical Imaging.

[15]  Qiang Chen,et al.  Automated geographic atrophy segmentation for SD-OCT images using region-based C-V model via local similarity factor. , 2016, Biomedical optics express.

[16]  Hiroshi Ishikawa,et al.  Macular segmentation with optical coherence tomography. , 2005, Investigative ophthalmology & visual science.

[17]  Sina Farsiu,et al.  The Effects of Diabetic Retinopathy and Pan-Retinal Photocoagulation on Photoreceptor Cell Function as Assessed by Dark Adaptometry , 2016, Investigative ophthalmology & visual science.

[18]  Joseph A. Izatt,et al.  Robust automatic segmentation of corneal layer boundaries in SDOCT images using graph theory and dynamic programming , 2011, Biomedical optics express.

[19]  Milan Sonka,et al.  Intra-retinal layer segmentation of 3D optical coherence tomography using coarse grained diffusion map , 2012, Medical Image Anal..

[20]  Stefano Mancuso,et al.  Aromatic and proteomic analyses corroborate the distinction between Mediterranean landraces and modern varieties of durum wheat , 2016, Scientific Reports.

[21]  Jerry L Prince,et al.  Retinal layer segmentation of macular OCT images using boundary classification , 2013, Biomedical optics express.

[22]  Sina Farsiu,et al.  Longitudinal Associations Between Microstructural Changes and Microperimetry in the Early Stages of Age-Related Macular Degeneration. , 2016, Investigative ophthalmology & visual science.

[23]  Joseph A. Izatt,et al.  Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation , 2010, Optics express.

[24]  Sina Farsiu,et al.  Enhanced visualization of peripheral retinal vasculature with wavefront sensorless adaptive optics optical coherence tomography angiography in diabetic patients. , 2017, Optics letters.

[25]  Liang Liu,et al.  Automated volumetric segmentation of retinal fluid on optical coherence tomography. , 2016, Biomedical optics express.

[26]  Joseph A. Izatt,et al.  Automatic segmentation of closed-contour features in ophthalmic images using graph theory and dynamic programming , 2012, Biomedical optics express.

[27]  Milan Sonka,et al.  Automated 3-D method for the correction of axial artifacts in spectral-domain optical coherence tomography images , 2011, Biomedical optics express.

[28]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[29]  Kirill V. Larin,et al.  4D Reconstruction of the Beating Embryonic Heart From Two Orthogonal Sets of Parallel Optical Coherence Tomography Slice-Sequences , 2013, IEEE Transactions on Medical Imaging.

[30]  J. Hornegger,et al.  Retinal Nerve Fiber Layer Segmentation on FD-OCT Scans of Normal Subjects and Glaucoma Patients , 2010, Biomedical optics express.

[31]  Sina Farsiu,et al.  Length-adaptive graph search for automatic segmentation of pathological features in optical coherence tomography images , 2016, Journal of biomedical optics.

[32]  J. Duker,et al.  Imaging of macular diseases with optical coherence tomography. , 1995, Ophthalmology.

[33]  Shutao Li,et al.  3-D Adaptive Sparsity Based Image Compression With Applications to Optical Coherence Tomography , 2015, IEEE Transactions on Medical Imaging.

[34]  Sina Farsiu,et al.  Macular sub-layer thinning and association with pulmonary function tests in Amyotrophic Lateral Sclerosis , 2016, Scientific Reports.

[35]  Austin Roorda,et al.  Revealing Henle's fiber layer using spectral domain optical coherence tomography. , 2011, Investigative ophthalmology & visual science.

[36]  Jyotirmoy Chatterjee,et al.  Learning layer-specific edges for segmenting retinal layers with large deformations. , 2016, Biomedical optics express.

[37]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[38]  Isabelle Bloch,et al.  Automated segmentation of macular layers in OCT images and quantitative evaluation of performances , 2011, Pattern Recognit..

[39]  Teresa C. Chen,et al.  Retinal nerve fiber layer thickness map determined from optical coherence tomography images. , 2005, Optics express.

[40]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[41]  Gábor Márk Somfai,et al.  Real-Time Automatic Segmentation of Optical Coherence Tomography Volume Data of the Macular Region , 2015, PloS one.

[42]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[43]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[44]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[45]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[46]  Christian Ahlers,et al.  EVALUATION OF SEGMENTATION PROCEDURES USING SPECTRAL DOMAIN OPTICAL COHERENCE TOMOGRAPHY IN EXUDATIVE AGE-RELATED MACULAR DEGENERATION , 2011, Retina.

[47]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[48]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[49]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[50]  Sina Farsiu,et al.  Automatic segmentation of up to ten layer boundaries in SD-OCT images of the mouse retina with and without missing layers due to pathology. , 2014, Biomedical optics express.

[51]  Donald C. Hood,et al.  Automated segmentation of outer retinal layers in macular OCT images of patients with retinitis pigmentosa , 2011, Biomedical optics express.

[52]  Bram van Ginneken,et al.  Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images , 2016, IEEE Transactions on Medical Imaging.