Deep structure tensor graph search framework for automated extraction and characterization of retinal layers and fluid pathology in retinal SD-OCT scans

Maculopathy is a group of retinal disorders that affect macula and cause severe visual impairment if not treated in time. Many computer-aided diagnostic methods have been proposed over the past that automatically detect macular diseases. However, to our best knowledge, no literature is available that provides an end-to-end solution for analyzing healthy and diseased macular pathology. This paper proposes a vendor-independent deep convolutional neural network and structure tensor graph search-based segmentation framework (CNN-STGS) for the extraction and characterization of retinal layers and fluid pathology, along with 3-D retinal profiling. CNN-STGS works by first extracting nine layers from an optical coherence tomography (OCT) scan. Afterward, the extracted layers, combined with a deep CNN model, are used to automatically segment cyst and serous pathology, followed by the autonomous 3-D retinal profiling. CNN-STGS has been validated on publicly available Duke datasets (containing a cumulative of 42,281 scans from 439 subjects) and Armed Forces Institute of Ophthalmology dataset (containing 4260 OCT scans of 51 subjects), which are acquired through different OCT machinery. The performance of the CNN-STGS framework is validated through the marked annotations, and it significantly outperforms the existing solutions in various metrics. The proposed CNN-STGS framework achieved a mean Dice coefficient of 0.906 for segmenting retinal fluids, along with an accuracy of 98.75% for characterizing cyst and serous fluid from diseased retinal OCT scans.

[1]  X Liu,et al.  Retina layer segmentation using kernel graph cuts and continuous max-flow. , 2015, Optics express.

[2]  Gianni Virgili,et al.  Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy. , 2015, The Cochrane database of systematic reviews.

[3]  Gulistan Raja,et al.  Fully automated assessment of Macular Edema using Optical Coherence Tomography (OCT) images , 2016, 2016 International Conference on Intelligent Systems Engineering (ICISE).

[4]  Carmen A Puliafito,et al.  Automated detection of retinal layer structures on optical coherence tomography images. , 2005, Optics express.

[5]  Desislava Koleva-Georgieva,et al.  Optical Coherence Tomography Findings in Diabetic Macular Edema , 2012 .

[6]  Xian Zhang,et al.  Development of a Semi-Automatic Segmentation Method for Retinal OCT Images Tested in Patients with Diabetic Macular Edema , 2013, PloS one.

[7]  Richard S. Snell,et al.  Clinical Anatomy of the Eye , 1990 .

[8]  Yasser M Helmy,et al.  Optical coherence tomography classification of diabetic cystoid macular edema , 2013, Clinical ophthalmology.

[9]  J. Bigun,et al.  Optimal Orientation Detection of Linear Symmetry , 1987, ICCV 1987.

[10]  Qi Yang,et al.  Automated layer segmentation of macular OCT images using dual-scale gradient information. , 2010, Optics express.

[11]  Bartosz L. Sikorski,et al.  The Diagnostic Function of OCT in Diabetic Maculopathy , 2013, Mediators of inflammation.

[12]  Bianca S. Gerendas,et al.  Fully Automated Detection and Quantification of Macular Fluid in OCT Using Deep Learning. , 2017, Ophthalmology.

[13]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[14]  Xinjian Chen,et al.  Automated segmentation of intraretinal cystoid macular edema for retinal 3D OCT images with macular hole , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[15]  Joseph A. Izatt,et al.  Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation , 2010, Optics express.

[16]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[17]  P. Keane,et al.  Grading of Age-Related Macular Degeneration: Comparison between Color Fundus Photography, Fluorescein Angiography, and Spectral Domain Optical Coherence Tomography , 2013, Journal of ophthalmology.

[18]  Eric L Yuan,et al.  Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. , 2014, Ophthalmology.

[19]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[20]  Peter K Kaiser,et al.  Optical coherence tomography imaging of macular oedema , 2014, British Journal of Ophthalmology.

[21]  A Shrestha,et al.  Optical coherence tomographic assessment of macular thickness and morphological patterns in diabetic macular edema: prognosis after modified grid photocoagulation. , 2012, Nepalese journal of ophthalmology : a biannual peer-reviewed academic journal of the Nepal Ophthalmic Society : NEPJOPH.

[22]  M. Ávila,et al.  Detection of diabetic foveal edema with biomicroscopy, fluorescein angiography and optical coherence tomography. , 2008, Arquivos brasileiros de oftalmologia.

[23]  J. Duker,et al.  Intravitreal triamcinolone for refractory diabetic macular edema. , 2002, Ophthalmology.

[24]  Taimur Hassan,et al.  Structure tensor based automated detection of macular edema and central serous retinopathy using optical coherence tomography images. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Adeel M. Syed,et al.  Automated segmentation of subretinal layers for the detection of macular edema. , 2016, Applied optics.

[26]  Taimur Hassan,et al.  BIOMISA Retinal Image Database for Macular and Ocular Syndromes , 2018, ICIAR.

[27]  Keshab K. Parhi,et al.  Fully Automated Segmentation of Fluid/Cyst Regions in Optical Coherence Tomography Images With Diabetic Macular Edema Using Neutrosophic Sets and Graph Algorithms , 2018, IEEE Transactions on Biomedical Engineering.

[28]  Shyam Vasudeva Rao,et al.  Segmentation and analysis of retinal layers (ILM & RPE) in Optical Coherence Tomography images with Edema , 2014, 2014 IEEE Conference on Biomedical Engineering and Sciences (IECBES).

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[31]  E Reichel,et al.  Topography of diabetic macular edema with optical coherence tomography. , 1998, Ophthalmology.

[32]  Taimur Hassan,et al.  Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces , 2016, Comput. Methods Programs Biomed..

[33]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[34]  Jathurong Sugruk,et al.  Automated Classification between Age-related Macular Degeneration and Diabetic Macular Edema in OCT Image Using Image Segmentation , 2014 .

[35]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[36]  Amy L. Oldenburg,et al.  Automated Segmentation of Intraretinal Cystoid Fluid in Optical Coherence Tomography , 2012, IEEE Transactions on Biomedical Engineering.