MPG-Net: Multi-Prediction Guided Network for Segmentation of Retinal Layers in OCT Images

Optical coherence tomography (OCT) is a commonly-used method of extracting high resolution retinal information. Moreover there is an increasing demand for the automated retinal layer segmentation which facilitates the retinal disease diagnosis. In this paper, we propose a novel multi-prediction guided attention network (MPG-Net) for automated retinal layer segmentation in OCT images. The proposed method consists of two major steps to strengthen the discriminative power of a U-shape Fully convolutional network (FCN) for reliable automated segmentation. Firstly, the feature refinement module which adaptively re-weights the feature channels is exploited in the encoder to capture more informative features and discard information in irrelevant regions. Furthermore, we propose a multi-prediction guided attention mechanism which provides pixel-wise semantic prediction guidance to better recover the segmentation mask at each scale. This mechanism which transforms the deep supervision to supervised attention is able to guide feature aggregation with more semantic information between intermediate layers. Experiments on the publicly available Duke OCT dataset confirm the effectiveness of the proposed method as well as an improved performance over other state-of-the-art approaches.

[1]  Jinjun Xiong,et al.  SPGNet: Semantic Prediction Guidance for Scene Parsing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Wei Liu,et al.  ParseNet: Looking Wider to See Better , 2015, ArXiv.

[3]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[4]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Giancarlo Mauri,et al.  USE-Net: incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasets , 2019, Neurocomputing.

[7]  Leyuan Fang,et al.  Automatic Classification of Retinal Optical Coherence Tomography Images With Layer Guided Convolutional Neural Network , 2019, IEEE Signal Processing Letters.

[8]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[9]  Pascal A. Dufour,et al.  Graph-Based Multi-Surface Segmentation of OCT Data Using Trained Hard and Soft Constraints , 2013, IEEE Transactions on Medical Imaging.

[10]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[11]  Sina Farsiu,et al.  Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. , 2014, Biomedical optics express.

[12]  Sina Farsiu,et al.  Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. , 2015, Biomedical optics express.

[13]  J. Fujimoto,et al.  Optical coherence tomography of the human retina. , 1995, Archives of ophthalmology.

[14]  Jose Dolz,et al.  Multi-Scale Self-Guided Attention for Medical Image Segmentation , 2021, IEEE Journal of Biomedical and Health Informatics.

[15]  Peter A. Calabresi,et al.  Towards Topological Correct Segmentation of Macular OCT from Cascaded FCNs , 2017, FIFI/OMIA@MICCAI.

[16]  Jyotirmoy Chatterjee,et al.  Learning layer-specific edges for segmenting retinal layers with large deformations. , 2016, Biomedical optics express.

[17]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[18]  Bappaditya Mandal,et al.  Multi-Level Dual-Attention Based CNN for Macular Optical Coherence Tomography Classification , 2019, IEEE Signal Processing Letters.

[19]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[20]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[21]  F. Medeiros,et al.  Detection of glaucoma progression with stratus OCT retinal nerve fiber layer, optic nerve head, and macular thickness measurements. , 2009, Investigative ophthalmology & visual science.

[22]  R. Ananda Natarajan,et al.  Retinal Layer Segmentation in Pathological SD-OCT Images Using Boisterous Obscure Ratio Approach and its Limitation , 2017 .

[23]  Tanveer F. Syeda-Mahmood,et al.  3D Segmentation with Exponential Logarithmic Loss for Highly Unbalanced Object Sizes , 2018, MICCAI.

[24]  Satnam Dlay,et al.  Automated Retinal Layer Segmentation of OCT Images Using Two-Stage FCN and Decision Mask , 2019, 2019 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[25]  Ashish Sinha,et al.  Multi-scale guided attention for medical image segmentation , 2019, ArXiv.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[28]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Fei Li,et al.  Joint retina segmentation and classification for early glaucoma diagnosis. , 2019, Biomedical optics express.

[30]  Nassir Navab,et al.  ReLayNet: Retinal Layer and Fluid Segmentation of Macular Optical Coherence Tomography using Fully Convolutional Network , 2017, Biomedical optics express.

[31]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.