Context attention-and-fusion network for multiclass retinal fluid segmentation in OCT images

Optical coherence tomography (OCT) is an imaging modality that is extensively used for ophthalmic diagnosis and treatment. OCT can help reveal disease-related alterations below the surface of the retina, such as retinal fluid which can cause vision impairment. In this paper, we propose a novel context attention-and-fusion network (named as CAF-Net) for multiclass retinal fluid segmentation, including intraretinal fluid (IRF), subretinal fluid (SRF) and pigment epithelial detachment (PED). To deal with the seriously uneven sizes and irregular distributions of different types of fluid, our CAF-Net proposes the context shrinkage encode (CSE) module and context pyramid guide (CPG) module to extract and fuse global context information. The CSE module embedded in the encoder path can ignore redundant information and focus on useful information by a shrinkage function. Besides, the CPG module is inserted between the encoder and decoder, which can dynamically fuse multi-scale information in high-level features. The proposed CAF-Net was evaluated on a public dataset from RETOUCH Challenge in MICCAI2017, which consists of 70 OCT volumes with three types of retinal fluid from three different types of devices. The average of Dice similarity coefficient (DSC) and Intersection over Union (IoU) are 74.64% and 62.08%, respectively.

[1]  Jun Ye,et al.  Dice Similarity Measure between Single Valued Neutrosophic Multisets and Its Application in Medical Diagnosis , 2015 .

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Hyewon Chung,et al.  Automated Segmentation of Lesions Including Subretinal Hyperreflective Material in Neovascular Age-related Macular Degeneration. , 2018, American journal of ophthalmology.

[4]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Keshab K. Parhi,et al.  OCT Fluid Segmentation using Graph Shortest Path and Convolutional Neural Network* , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Marinko V Sarunic,et al.  Deep‐learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network , 2019, Medical Image Anal..

[9]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[10]  Keshab K. Parhi,et al.  RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge , 2019, IEEE Transactions on Medical Imaging.

[11]  J. F. Cullen Retinal Vascular Disease , 1968, Scottish medical journal.

[12]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[13]  Michael F. Marmor,et al.  Mechanisms of fluid accumulation in retinal edema , 2004, Documenta Ophthalmologica.

[14]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[15]  G. Ripandelli,et al.  Optical coherence tomography. , 1998, Seminars in ophthalmology.