Semi-supervised Segmentation of Optic Cup in Retinal Fundus Images Using Variational Autoencoder

Accurate segmentation of optic cup and disc in retinal fundus images is essential to compute the cup to disc ratio parameter, which is important for glaucoma assessment. The ill-defined boundaries of optic cup makes the segmentation a lot more challenging compared to optic disc. Existing approaches have mainly used fully supervised learning that requires many labeled samples to build a robust segmentation framework. In this paper, we propose a novel semi-supervised method to segment the optic cup, which can accurately localize the anatomy using limited number of labeled samples. The proposed method leverages the inherent feature similarity from a large number of unlabeled images to train the segmentation model from a smaller number of labeled images. It first learns the parameters of a generative model from unlabeled images using variational autoencoder. The trained generative model provides the feature embedding of the images which allows the clustering of the related observation in the latent feature space. We combine the feature embedding with the segmentation autoencoder which is trained on the labeled images for pixel-wise segmentation of the cup region. The main novelty of the proposed approach is in the utilization of generative models for semi-supervised segmentation. Experimental results show that the proposed method successfully segments optic cup with small number of labeled images, and unsupervised feature embedding learned from unlabeled data improves the segmentation accuracy. Given the challenge of access to annotated medical images in every clinical application, the proposed framework is a key contribution and applicable for segmentation of different anatomies across various medical imaging modalities.

[1]  Ole Winther,et al.  Auxiliary Deep Generative Models , 2016, ICML.

[2]  Jayanthi Sivaswamy,et al.  Coupled Sparse Dictionary for Depth-Based Cup Segmentation from Single Color Fundus Image , 2014, MICCAI.

[3]  Yang Liu,et al.  Automatically detecting lung nodules based on shape descriptor and semi-supervised learning , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[4]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[5]  George D. C. Cavalcanti,et al.  Semi-supervised clustering for MR brain image segmentation , 2014, Expert Syst. Appl..

[6]  Haizhou Li,et al.  ARGALI: An Automatic Cup-to-Disc Ratio Measurement System for Glaucoma Analysis Using Level-set Image Processing , 2009 .

[7]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[8]  Ole Winther,et al.  Ladder Variational Autoencoders , 2016, NIPS.

[9]  Jayanthi Sivaswamy,et al.  1 & , 2001 .

[10]  Dwarikanath Mahapatra,et al.  Segmentation of Optic Disc and Optic Cup in Retinal Fundus Images Using Coupled Shape Regression , 2016 .

[11]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[12]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[13]  Dwarikanath Mahapatra,et al.  Segmentation of optic disc and optic cup in retinal fundus images using shape regression , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Stephen Lin,et al.  Optic Cup Segmentation for Glaucoma Detection Using Low-Rank Superpixel Representation , 2014, MICCAI.

[15]  H. Quigley,et al.  The number of people with glaucoma worldwide in 2010 and 2020 , 2006, British Journal of Ophthalmology.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.