Dense Segmentation in Selected Dimensions: Application to Retinal Optical Coherence Tomography

We present a novel convolutional neural network architecture designed for dense segmentation in a subset of the dimensions of the input data. The architecture takes an N-dimensional image as input, and produces a label for every pixel in M output dimensions, where 0 < M < N. Large context is incorporated by an encoder-decoder structure, while funneling shortcut subnetworks provide precise localization. We demonstrate applicability of the architecture on two problems in retinal optical coherence tomography: segmentation of geographic atrophy and segmentation of retinal layers. Performance is compared against two baseline methods, that leave out either the encoderdecoder structure or the shortcut subnetworks. For segmentation of geographic atrophy, an average Dice score of 0.49±0.21 was obtained, compared to 0.46±0.22 and 0.28±0.19 for the baseline methods, respectively. For the layer-segmentation task, the proposed architecture achieved a mean absolute error of 1.305±0.547 pixels compared to 1.967±0.841 and 2.166±0.886 for the baseline methods.

[1]  Margrit Betke,et al.  Pulmonary fissure segmentation on CT , 2006, Medical Image Anal..

[2]  Rangaraj M. Rangayyan,et al.  Automatic Delineation of the Diaphragm in Computed Tomographic Images , 2008, Journal of Digital Imaging.

[3]  David A. Rottenberg,et al.  Automatic segmentation of left and right cerebral hemispheres from MRI brain volumes using the graph cuts algorithm , 2007, NeuroImage.

[4]  A. Hofman,et al.  The Rotterdam Study: objectives and design update , 2007, European Journal of Epidemiology.

[5]  Zhihong Hu,et al.  Segmentation of the geographic atrophy in spectral-domain optical coherence tomography and fundus autofluorescence images. , 2013, Investigative ophthalmology & visual science.

[6]  Eric L Yuan,et al.  Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. , 2014, Ophthalmology.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Qiang Chen,et al.  Automated geographic atrophy segmentation for SD-OCT images using region-based C-V model via local similarity factor. , 2016, Biomedical optics express.

[10]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[11]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[12]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[13]  Chong Wang,et al.  Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. , 2017, Biomedical optics express.

[14]  Thomas Theelen,et al.  Automatic detection of the foveal center in optical coherence tomography. , 2017, Biomedical optics express.

[15]  Alexander Wong,et al.  Enhancement of morphological and vascular features in OCT images using a modified Bayesian residual transform. , 2018, Biomedical optics express.

[16]  David Alonso-Caneiro,et al.  Automatic segmentation of OCT retinal boundaries using recurrent neural networks and graph search. , 2018, Biomedical optics express.