Optic Disc and Cup Segmentation Based on Deep Convolutional Generative Adversarial Networks

Glaucoma is a chronic eye disease that causes loss of vision and it is irreversible. Accurate segmentation of optic disc and optic cup is a basic step in screening glaucoma. The most existing deep convolutional neural network (DCNN) methods have insufficient feature information extraction, and hence they are susceptible to pathological regions and low-quality images, with have poor ability to restore context information. Finally, the accuracy of the model segmentation is low. In this paper, we propose GL-Net, a multi-label DCNN model that combines the generative adversarial networks. GL-Net consists of two network structures including a Generator and a Discriminator. In the Generator, we use skip connection to promote the fusion of low-level feature information and high-level feature information, which alleviates the difficulty of restoring detailed feature information during upsampling, and reduces the downsampling factor, effectively alleviating excessive feature information loss. In the loss function, we add the <inline-formula> <tex-math notation="LaTeX">$L_{1}$ </tex-math></inline-formula> distance function and the cross-entropy function to prevent the mode collapse when the model is trained, which makes the segmentation result more accurate. We use transfer learning and data augmentation to alleviate the problem of insufficient data and over-fitting of the model during training. Finally, GL-Net was verified on DRISHTI-GS1 dataset. The experimental results show that GL-Net outperforms some state-of-the-art method, such as M-Net, Stack-U-Net, RACE-net, and BCRF in terms of <inline-formula> <tex-math notation="LaTeX">$F1$ </tex-math></inline-formula> and boundary distance localization error (BLE). Particularly, in the optic cup segmentation, GL-Net outperforms RACE-net by 3.5% and 4.16 pixels in terms of <inline-formula> <tex-math notation="LaTeX">$F1$ </tex-math></inline-formula> and BLE, respectively.

[1]  Stephen Lin,et al.  Optic Cup Segmentation for Glaucoma Detection Using Low-Rank Superpixel Representation , 2014, MICCAI.

[2]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[3]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Joachim M. Buhmann,et al.  Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation , 2017, Comput. Medical Imaging Graph..

[5]  Stephen Lin,et al.  Sliding Window and Regression Based Cup Detection in Digital Fundus Images for Glaucoma Diagnosis , 2011, MICCAI.

[6]  Joachim M. Buhmann,et al.  Boosting Convolutional Filters with Entropy Sampling for Optic Cup and Disc Image Segmentation from Fundus Images , 2015, MLMI.

[7]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Matthew B. Blaschko,et al.  Convolutional neural network transfer for automated glaucoma identification , 2017, Symposium on Medical Information Processing and Analysis.

[9]  Hao Chen,et al.  Automatic Fetal Ultrasound Standard Plane Detection Using Knowledge Transferred Recurrent Neural Networks , 2015, MICCAI.

[10]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[11]  Young H. Kwon,et al.  Automated segmentation of the optic disc from stereo color photographs using physiologically plausible features. , 2007, Investigative ophthalmology & visual science.

[12]  James C. Gee,et al.  Optic Disc and Cup Segmentation from Color Fundus Photograph Using Graph Cut with Priors , 2013, MICCAI.

[13]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[14]  Tien Yin Wong,et al.  Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening , 2013, IEEE Transactions on Medical Imaging.

[15]  Haizhou Li,et al.  Automated detection of kinks from blood vessels for optic cup segmentation in retinal images , 2009, Medical Imaging.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Jiang Liu,et al.  Quadratic divergence regularized SVM for optic disc segmentation. , 2017, Biomedical optics express.

[18]  Jayanthi Sivaswamy,et al.  RACE-Net: A Recurrent Neural Network for Biomedical Image Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[21]  Jayanthi Sivaswamy,et al.  Joint optic disc and cup boundary extraction from monocular fundus images , 2017, Comput. Methods Programs Biomed..

[22]  Jayanthi Sivaswamy,et al.  1 & , 2001 .

[23]  Jayanthi Sivaswamy,et al.  Drishti-GS: Retinal image dataset for optic nerve head(ONH) segmentation , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[24]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[25]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[26]  A. Sevastopolsky,et al.  Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network , 2017, Pattern Recognition and Image Analysis.

[27]  Jayanthi Sivaswamy,et al.  Optic Disk and Cup Segmentation From Monocular Color Retinal Images for Glaucoma Assessment , 2011, IEEE Transactions on Medical Imaging.

[28]  Kaamran Raahemifar,et al.  Optic Disc and Optic Cup Segmentation Methodologies for Glaucoma Image Detection: A Survey , 2015, Journal of ophthalmology.

[29]  Shijian Lu,et al.  Accurate and Efficient Optic Disc Detection and Segmentation by a Circular Transformation , 2011, IEEE Transactions on Medical Imaging.

[30]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[31]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[32]  Shuicheng Yan,et al.  Automatic Feature Learning for Glaucoma Detection Based on Deep Learning , 2015, MICCAI.