Deep‐learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network

&NA; As a non‐invasive imaging modality, optical coherence tomography (OCT) can provide micrometer‐resolution 3D images of retinal structures. These images can help reveal disease‐related alterations below the surface of the retina, such as the presence of edema, or accumulation of fluid which can distort vision, and are an indication of disruptions in the vasculature of the retina. In this paper, a new framework is proposed for multiclass fluid segmentation and detection in the retinal OCT images. Based on the intensity of OCT images and retinal layer segmentations provided by a graph‐cut algorithm, a fully convolutional neural network was trained to recognize and label the fluid pixels. Random forest classification was performed on the segmented fluid regions to detect and reject the falsely labeled fluid regions. The proposed framework won the first place in the MICCAI RETOUCH challenge in 2017 on both the segmentation performance (mean Dice: 0.7667) and the detection performance (mean AUC: 1.00) tasks.

[1]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[2]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[3]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[4]  Bianca S. Gerendas,et al.  Fully Automated Detection and Quantification of Macular Fluid in OCT Using Deep Learning. , 2017, Ophthalmology.

[5]  Sebastian J. Schlecht,et al.  Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks , 2017, ArXiv.

[6]  Thomas Theelen,et al.  Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. , 2018, Biomedical optics express.

[7]  Jayashree Kalpathy-Cramer,et al.  Machine Learning Has Arrived! , 2017, Ophthalmology.

[8]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[9]  A. Joussen,et al.  Retinal vascular disease , 2007 .

[10]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[11]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[12]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[13]  Milan Sonka,et al.  Stratified Sampling Voxel Classification for Segmentation of Intraretinal and Subretinal Fluid in Longitudinal Clinical OCT Data , 2015, IEEE Transactions on Medical Imaging.

[14]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[15]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[16]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[17]  Sven Loncaric,et al.  Segmentation of the foveal microvasculature using deep learning networks , 2016, Journal of biomedical optics.

[18]  Alicja R. Rudnicka,et al.  Automated arteriole and venule classification using deep learning for retinal images from the UK Biobank cohort , 2017, Comput. Biol. Medicine.

[19]  Hyunjin Park,et al.  Three-dimensional continuous max flow optimization-based serous retinal detachment segmentation in SD-OCT for central serous chorioretinopathy. , 2017, Biomedical optics express.

[20]  Xinjian Chen,et al.  An automated framework for 3D serous pigment epithelium detachment segmentation in SD-OCT images , 2016, Scientific Reports.

[21]  Behzad Nazari,et al.  Fully-automated segmentation of fluid regions in exudative age-related macular degeneration subjects: Kernel graph cut in neutrosophic domain , 2017, PloS one.

[22]  M. Beg,et al.  Comparative analysis of repeatability of manual and automated choroidal thickness measurements in nonneovascular age-related macular degeneration. , 2013, Investigative ophthalmology & visual science.

[23]  Georg Langs,et al.  Predicting Semantic Descriptions from Medical Images with Convolutional Neural Networks , 2015, IPMI.

[24]  J. Fujimoto,et al.  Optical coherence tomography of the human retina. , 1995, Archives of ophthalmology.

[25]  Thomas J. Fuchs,et al.  Hybrid Deep Learning on Single Wide-field Optical Coherence tomography Scans Accurately Classifies Glaucoma Suspects , 2017, Journal of glaucoma.

[26]  Mirza Faisal Beg,et al.  Multiple instance learning for age-related macular degeneration diagnosis in optical coherence tomography images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[29]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[30]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[31]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Bianca S. Gerendas,et al.  Neovascular Age-Related Macular Degeneration , 2014 .

[33]  Vasudevan Lakshminarayanan,et al.  Use of Gabor filters and deep networks in the segmentation of retinal vessel morphology , 2017, BiOS.

[34]  Bianca S. Gerendas,et al.  Joint retinal layer and fluid segmentation in OCT scans of eyes with severe macular edema using unsupervised representation and auto-context. , 2017, Biomedical optics express.

[35]  Jelena Novosel,et al.  Joint Segmentation of Retinal Layers and Focal Lesions in 3-D OCT Data of Topologically Disrupted Retinas , 2017, IEEE Transactions on Medical Imaging.

[36]  Amy L. Oldenburg,et al.  Automated Segmentation of Intraretinal Cystoid Fluid in Optical Coherence Tomography , 2012, IEEE Transactions on Biomedical Engineering.

[37]  Matthäus Pilch,et al.  Automated segmentation of pathological cavities in optical coherence tomography scans. , 2013, Investigative ophthalmology & visual science.

[38]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[39]  Liang Liu,et al.  Automated volumetric segmentation of retinal fluid on optical coherence tomography. , 2016, Biomedical optics express.

[40]  J. F. Arevalo,et al.  Clinical applications of optical coherence tomography in the posterior pole: the 2011 José Manuel Espino Lecture – Part II , 2013, Clinical ophthalmology.

[41]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[42]  S. Lee,et al.  Automated characterization of pigment epithelial detachment by optical coherence tomography. , 2012, Investigative ophthalmology & visual science.

[43]  Jerry L Prince,et al.  Automatic segmentation of microcystic macular edema in OCT. , 2014, Biomedical optics express.

[44]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[45]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[46]  Hiroshi Murata,et al.  Detecting Preperimetric Glaucoma with Standard Automated Perimetry Using a Deep Learning Classifier. , 2016, Ophthalmology.