RetFluidNet: Retinal Fluid Segmentation for SD-OCT Images Using Convolutional Neural Network

Age-related macular degeneration (AMD) is one of the leading causes of irreversible blindness and is characterized by fluid-related accumulations such as intra-retinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED). Spectral-domain optical coherence tomography (SD-OCT) is the primary modality used to diagnose AMD, yet it does not have algorithms that directly detect and quantify the fluid. This work presents an improved convolutional neural network (CNN)-based architecture called RetFluidNet to segment three types of fluid abnormalities from SD-OCT images. The model assimilates different skip-connect operations and atrous spatial pyramid pooling (ASPP) to integrate multi-scale contextual information; thus, achieving the best performance. This work also investigates between consequential and comparatively inconsequential hyperparameters and skip-connect techniques for fluid segmentation from the SD-OCT image to indicate the starting choice for future related researches. RetFluidNet was trained and tested on SD-OCT images from 124 patients and achieved an accuracy of 80.05%, 92.74%, and 95.53% for IRF, PED, and SRF, respectively. RetFluidNet showed significant improvement over competitive works to be clinically applicable in reasonable accuracy and time efficiency. RetFluidNet is a fully automated method that can support early detection and follow-up of AMD.

[1]  M. Sonka,et al.  Quantifying disrupted outer retinal-subretinal layer in SD-OCT images in choroidal neovascularization. , 2014, Investigative ophthalmology & visual science.

[2]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[3]  Keshab K. Parhi,et al.  OCT Fluid Segmentation using Graph Shortest Path and Convolutional Neural Network* , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Sohini Roy Chowdhury,et al.  Segmentation of Intra-Retinal Cysts From Optical Coherence Tomography Images Using a Fully Convolutional Neural Network Model , 2019, IEEE Journal of Biomedical and Health Informatics.

[5]  Phillip G Yuile,et al.  Age‐related macular degeneration: a leading cause of blindness , 1997, The Medical journal of Australia.

[6]  Thomas Theelen,et al.  Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. , 2018, Biomedical optics express.

[7]  Milan Sonka,et al.  Three-Dimensional Analysis of Retinal Layer Texture: Identification of Fluid-Filled Regions in SD-OCT of the Macula , 2010, IEEE Transactions on Medical Imaging.

[8]  Raphael Sznitman,et al.  Simultaneous Classification and Segmentation of Cysts in Retinal OCT , 2017 .

[9]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[10]  Hassan Foroosh,et al.  Simultaneous Detection and Quantification of Retinal Fluid with Deep Learning , 2017, ArXiv.

[11]  Milan Sonka,et al.  Stratified Sampling Voxel Classification for Segmentation of Intraretinal and Subretinal Fluid in Longitudinal Clinical OCT Data , 2015, IEEE Transactions on Medical Imaging.

[12]  Keren Xie,et al.  An Improved MPB-CNN Segmentation Method for Edema Area and Neurosensory Retinal Detachment in SD-OCT Images , 2019, OMIA@MICCAI.

[13]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[14]  Hyunjin Park,et al.  Automatic Subretinal Fluid Segmentation of Retinal SD-OCT Images With Neurosensory Retinal Detachment Guided by Enface Fundus Imaging , 2018, IEEE Transactions on Biomedical Engineering.

[15]  Xinjian Chen,et al.  Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images With Serous Pigment Epithelial Detachments , 2015, IEEE Transactions on Medical Imaging.

[16]  Gangjun Liu,et al.  Optical Coherence Tomography Angiography , 2016, Investigative ophthalmology & visual science.

[17]  S. Kishi,et al.  Outer nuclear layer thickness at the fovea determines visual outcomes in resolved central serous chorioretinopathy. , 2009, American journal of ophthalmology.

[18]  Marwan A Abouammoh,et al.  Advances in the treatment of central serous chorioretinopathy , 2015, Saudi journal of ophthalmology : official journal of the Saudi Ophthalmological Society.

[19]  Keshab K. Parhi,et al.  RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge , 2019, IEEE Transactions on Medical Imaging.

[20]  Jessica I W Morgan,et al.  The fundus photo has met its match: optical coherence tomography and adaptive optics ophthalmoscopy are here to stay , 2016, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[21]  Bianca S. Gerendas,et al.  Joint retinal layer and fluid segmentation in OCT scans of eyes with severe macular edema using unsupervised representation and auto-context. , 2017, Biomedical optics express.

[22]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[23]  N. Bressler Age-related macular degeneration is the leading cause of blindness... , 2004, JAMA.

[24]  Jayanthi Sivaswamy,et al.  Segmentation of Retinal Cysts From Optical Coherence Tomography Volumes Via Selective Enhancement , 2017, IEEE Journal of Biomedical and Health Informatics.

[25]  Kun Yu,et al.  DenseASPP for Semantic Segmentation in Street Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[27]  Qiang Chen,et al.  Automated 3-D Retinal Layer Segmentation From SD-OCT Images With Neurosensory Retinal Detachment , 2019, IEEE Access.

[28]  Hyoung Suk Park,et al.  Deep neural networks for the detection and segmentation of the retinal fluid in OCT images , 2018 .

[29]  Abdul Jalil,et al.  A review of retinal blood vessels extraction techniques: challenges, taxonomy, and future trends , 2018, Pattern Analysis and Applications.

[30]  Aaron Klein,et al.  BOHB: Robust and Efficient Hyperparameter Optimization at Scale , 2018, ICML.

[31]  Min Zhao,et al.  Central serous chorioretinopathy: Recent findings and new physiopathology hypothesis , 2015, Progress in Retinal and Eye Research.

[32]  Semi-Automated Segmentation of Symptomatic Exudate-Associated Derangements (SEADs) in 3D OCT Using Layer Segmentation , 2010 .

[33]  Delia Cabrera Fernandez,et al.  Delineating fluid-filled region boundaries in optical coherence tomography images of the retina , 2005, IEEE Transactions on Medical Imaging.

[34]  Stuart J. Gibson,et al.  Cystoid macular edema segmentation of Optical Coherence Tomography images using fully convolutional neural networks and fully connected CRFs , 2017, ArXiv.

[35]  Mirza Faisal Beg,et al.  Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network , 2017, ArXiv.

[36]  Keshab K. Parhi,et al.  Detection and Segmentation of Various Types of Fluids with Graph Shortest Path and Deep Learning Approaches , 2017 .

[37]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Arunkumar Rajendran,et al.  Multi-retinal disease classification by reduced deep learning features , 2017, Neural Computing and Applications.

[39]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[40]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Xinjian Chen,et al.  An automated framework for 3D serous pigment epithelium detachment segmentation in SD-OCT images , 2016, Scientific Reports.

[42]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[43]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.