Optic disc segmentation by U-net and probability bubble in abnormal fundus images

Abstract Segmenting optic disc (OD) in abnormal fundus images is a challenge task because of many distractions such as illumination variations, blurry boundary, occlusion of retinal vessels and big bright lesions. Data-driven deep learning is effective and robust to illumination variations, blurry boundary and occlusion in the normal fundus images but sensitive to big bright lesions in abnormal images. In this paper, an automatic OD segmentation method fusing U-net with model-driven probability bubble approach is proposed in abnormal fundus images. The probability bubble is conceived according to the position relationship between retinal vessels and OD, and the localization result is fused into the output layer of U-net through calculating the joint probability. The proposed method takes the advantage of the deep learning architecture and improves the architecture’s performance by including the model-driven position constraint when lack of sufficient training data. Experiments show that the proposed method successfully removes the distraction of bright lesions in abnormal fundus images and obtains a satisfying OD segmentation on three public databases: Kaggle, MESSIDOR and NIVE, and it outperforms existing methods with a very high accuracy.

[1]  Michael H. Goldbaum,et al.  Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels , 2003, IEEE Transactions on Medical Imaging.

[2]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[3]  Ahmed S. Fahmy,et al.  Fast Localization of the Optic Disc Using Projection of Image Features , 2010, IEEE Transactions on Image Processing.

[4]  A. Sevastopolsky,et al.  Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network , 2017, Pattern Recognition and Image Analysis.

[5]  András Hajdu,et al.  Combining algorithms for automatic detection of optic disc and macula in fundus images , 2012, Comput. Vis. Image Underst..

[6]  Edwin R. Hancock,et al.  Learning Backtrackless Aligned-Spatial Graph Convolutional Networks for Graph Classification , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Enrico Grisan,et al.  Detection of optic disc in retinal images by means of a geometrical model of vessel structure , 2004, IEEE Transactions on Medical Imaging.

[8]  Xiaochun Cao,et al.  Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation , 2018, IEEE Transactions on Medical Imaging.

[9]  Shijian Lu,et al.  Automatic Optic Disc Detection From Retinal Images by a Line Operator , 2011, IEEE Transactions on Biomedical Engineering.

[10]  Xiaohui Liu,et al.  Segmentation of the Blood Vessels and Optic Disk in Retinal Images , 2014, IEEE Journal of Biomedical and Health Informatics.

[11]  Sven Loncaric,et al.  Detection of exudates in fundus photographs using deep neural networks and anatomical landmark detection fusion , 2016, Comput. Methods Programs Biomed..

[12]  Mohamed S. Kamel,et al.  Optic Disk Localization for Gray-Scale Retinal Images Based on Patch Filtering , 2014, ICIAR.

[13]  Lu Bai,et al.  Spectral bounding: Strictly satisfying the 1-Lipschitz property for generative adversarial networks , 2020, Pattern Recognit..

[14]  U. Rajendra Acharya,et al.  Computer-aided diagnosis of diabetic retinopathy: A review , 2013, Comput. Biol. Medicine.

[15]  Juan Xu,et al.  Optic disk feature extraction via modified deformable model technique for glaucoma analysis , 2007, Pattern Recognit..

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hongying Lilian Tang,et al.  Automatic Optic Disc Abnormality Detection in Fundus Images: A Deep Learning Approach , 2016 .

[19]  Vivek Kumar Singh,et al.  Retinal Optic Disc Segmentation using Conditional Generative Adversarial Network , 2018, CCIA.

[20]  Nadeem Salamat,et al.  Diabetic retinopathy techniques in retinal images: A review , 2019, Artif. Intell. Medicine.

[21]  Varun P. Gopi,et al.  PCA-based localization approach for segmentation of optic disc , 2017, International Journal of Computer Assisted Radiology and Surgery.

[22]  Jung-San Lee,et al.  Selective scalable secret image sharing with verification , 2015, Multimedia Tools and Applications.

[23]  Dongdong Chen,et al.  Quantum-based subgraph convolutional neural networks , 2019, Pattern Recognit..

[24]  Jacob Scharcanski,et al.  Segmentation of the optic disk in color eye fundus images using an adaptive morphological approach , 2010, Comput. Biol. Medicine.

[25]  Zongben Xu,et al.  Model-driven deep-learning , 2018 .

[26]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Charles V. Stewart,et al.  Robust detection and classification of longitudinal changes in color retinal fundus images for monitoring diabetic retinopathy , 2006, IEEE Transactions on Biomedical Engineering.

[28]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Kenneth W. Tobin,et al.  Detection of Anatomic Structures in Human Retinal Imagery , 2007, IEEE Transactions on Medical Imaging.

[30]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[31]  Rui Wang,et al.  Retinal optic disc localization using convergence tracking of blood vessels , 2017, Multimedia Tools and Applications.

[32]  Jiang Liu,et al.  Quadratic divergence regularized SVM for optic disc segmentation. , 2017, Biomedical optics express.

[33]  Wei Bu,et al.  Optic disc segmentation based on variational model with multiple energies , 2017, Pattern Recognit..

[34]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[35]  Mariano Alcañiz Raya,et al.  Automatic Detection of Optic Disc Based on PCA and Mathematical Morphology , 2013, IEEE Transactions on Medical Imaging.