Mixed Maximum Loss Design for Optic Disc and Optic Cup Segmentation with Deep Learning from Imbalanced Samples

Glaucoma is a serious eye disease that can cause permanent blindness and is difficult to diagnose early. Optic disc (OD) and optic cup (OC) play a pivotal role in the screening of glaucoma. Therefore, accurate segmentation of OD and OC from fundus images is a key task in the automatic screening of glaucoma. In this paper, we designed a U-shaped convolutional neural network with multi-scale input and multi-kernel modules (MSMKU) for OD and OC segmentation. Such a design gives MSMKU a rich receptive field and is able to effectively represent multi-scale features. In addition, we designed a mixed maximum loss minimization learning strategy (MMLM) for training the proposed MSMKU. This training strategy can adaptively sort the samples by the loss function and re-weight the samples through data enhancement, thereby synchronously improving the prediction performance of all samples. Experiments show that the proposed method has obtained a state-of-the-art breakthrough result for OD and OC segmentation on the RIM-ONE-V3 and DRISHTI-GS datasets. At the same time, the proposed method achieved satisfactory glaucoma screening performance on the RIM-ONE-V3 and DRISHTI-GS datasets. On datasets with an imbalanced distribution between typical and rare sample images, the proposed method obtained a higher accuracy than existing deep learning methods.

[1]  Francisco Fumero,et al.  RIM-ONE: An open retinal image database for optic nerve evaluation , 2011, 2011 24th International Symposium on Computer-Based Medical Systems (CBMS).

[2]  Yonatan Wexler,et al.  Minimizing the Maximal Loss: How and Why , 2016, ICML.

[3]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Joachim M. Buhmann,et al.  Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation , 2017, Comput. Medical Imaging Graph..

[5]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[6]  Georg Michelson,et al.  Segmentation of Fundus Eye Images Using Methods of Mathematical Morphology for Glaucoma Diagnosis , 2004, International Conference on Computational Science.

[7]  Jayanthi Sivaswamy,et al.  A Comprehensive Retinal Image Dataset for the Assessment of Glaucoma from the Optic Nerve Head Analysis , 2015 .

[8]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  K. Yanashima,et al.  Development of a simple diagnostic method for the glaucoma using ocular Fundus pictures. , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[11]  Rangaraj M. Rangayyan,et al.  Detection of the Optic Nerve Head in Fundus Images of the Retina Using the Hough Transform for Circles , 2010, Journal of Digital Imaging.

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Xu Sun,et al.  Feature Extraction from Optic Disc and Cup Boundary Lines in Fundus Images Based on ISNT Rule for Glaucoma Diagnosis , 2015 .

[14]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  T. Wong,et al.  Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. , 2014, Ophthalmology.

[18]  J. Liu,et al.  Level-set based automatic cup-to-disc ratio determination using retinal fundus images in ARGALI , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Maoguo Gong,et al.  Self-paced Convolutional Neural Networks , 2017, IJCAI.

[20]  Norwood Viviano Images , 2017 .

[21]  Sang Jun Park,et al.  Towards Accurate Segmentation of Retinal Vessels and the Optic Disc in Fundoscopic Images with Generative Adversarial Networks , 2018, Journal of Digital Imaging.

[22]  Tien Yin Wong,et al.  Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening , 2013, IEEE Transactions on Medical Imaging.

[23]  Haizhou Li,et al.  Automated detection of kinks from blood vessels for optic cup segmentation in retinal images , 2009, Medical Imaging.

[24]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[25]  Andrew Hunter,et al.  Optic nerve head segmentation , 2004, IEEE Transactions on Medical Imaging.

[26]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[27]  A. Sevastopolsky,et al.  Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network , 2017, Pattern Recognition and Image Analysis.

[28]  Jayanthi Sivaswamy,et al.  Optic Disk and Cup Segmentation From Monocular Color Retinal Images for Glaucoma Assessment , 2011, IEEE Transactions on Medical Imaging.

[29]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Yongli Xu,et al.  Optic cup segmentation from fundus images for glaucoma diagnosis , 2017, Bioengineered.

[31]  Bao-Gang Hu,et al.  Learning with Average Top-k Loss , 2017, NIPS.

[32]  Panos Liatsis,et al.  Application of Convolutional Neural Networks for Automated Ulcer Detection in Wireless Capsule Endoscopy Images , 2019, Sensors.

[33]  François Fleuret,et al.  Biased Importance Sampling for Deep Neural Network Training , 2017, ArXiv.

[34]  Jayanthi Sivaswamy,et al.  Coupled Sparse Dictionary for Depth-Based Cup Segmentation from Single Color Fundus Image , 2014, MICCAI.

[35]  Robert Ritch,et al.  The ISNT rule and differentiation of normal from glaucomatous eyes. , 2006, Archives of ophthalmology.

[36]  Engin Avci,et al.  A Novel Method for Classifying Liver and Brain Tumors Using Convolutional Neural Networks, Discrete Wavelet Transform and Long Short-Term Memory Networks , 2019, Sensors.

[37]  Stephen Lin,et al.  Optic Cup Segmentation for Glaucoma Detection Using Low-Rank Superpixel Representation , 2014, MICCAI.