CSU-Net: A Context Spatial U-Net for Accurate Blood Vessel Segmentation in Fundus Images

Blood vessel segmentation in fundus images is a critical procedure in the diagnosis of ophthalmic diseases. Recent deep learning methods achieve high accuracy in vessel segmentation but still face the challenge to segment the microvascular and detect the vessel boundary. This is due to the fact that common Convolutional Neural Networks (CNN) are unable to preserve rich spatial information and a large receptive field simultaneously. Besides, CNN models for vessel segmentation usually are trained by equal pixel level cross-entropy loss, which tend to miss fine vessel structures. In this paper, we propose a novel Context Spatial U-Net (CSU-Net) for blood vessel segmentation. Compared with the other U-Net based models, we design a two-channel encoder: a context channel with multi-scale convolution to capture more receptive field and a spatial channel with large kernel to retain spatial information. Also, to combine and strengthen the features extracted from two paths, we introduce a feature fusion module (FFM) and an attention skip module (ASM). Furthermore, we propose a structure loss, which adds a spatial weight to cross-entropy loss and guide the network to focus more on the thin vessels and boundaries. We evaluated this model on three public datasets: DRIVE, CHASE-DB1 and STARE. The results show that the CSU-Net achieves higher segmentation accuracy than the current state-of-the-art methods.

[1]  Alan Wee-Chung Liew,et al.  General Retinal Vessel Segmentation Using Regularization-Based Multiconcavity Modeling , 2010, IEEE Transactions on Medical Imaging.

[2]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[3]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[4]  Hui Wu,et al.  An Ensemble Retinal Vessel Segmentation Based on Supervised Learning in Fundus Images , 2016 .

[5]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[6]  C. Paterson,et al.  Measuring retinal vessel tortuosity in 10-year-old children: validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) program. , 2009, Investigative ophthalmology & visual science.

[7]  Emanuele Trucco,et al.  FABC: Retinal Vessel Segmentation Using AdaBoost , 2010, IEEE Transactions on Information Technology in Biomedicine.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[11]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[12]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[13]  Yanning Zhang,et al.  Multiscale Network Followed Network Model for Retinal Vessel Segmentation , 2018, MICCAI.

[14]  Andrew Hunter,et al.  An Active Contour Model for Segmenting and Measuring Retinal Vessels , 2009, IEEE Transactions on Medical Imaging.

[15]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  Erik J. Bekkers,et al.  Retinal vessel delineation using a brain-inspired wavelet transform and random forest , 2017, Pattern Recognit..

[17]  J. Kanski Clinical Ophthalmology: A Systematic Approach , 1989 .

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Sonam Singh,et al.  A fully convolutional neural network based structured prediction approach towards the retinal vessel segmentation , 2016, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[20]  Juntang Zhuang,et al.  LadderNet: Multi-path networks based on U-Net for medical image segmentation , 2018, ArXiv.

[21]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[22]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[23]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[26]  Jing Xin,et al.  Mapping Functions Driven Robust Retinal Vessel Segmentation via Training Patches , 2018, IEEE Access.

[27]  Zhiming Luo,et al.  Weighted Res-UNet for High-Quality Retina Vessel Segmentation , 2018, 2018 9th International Conference on Information Technology in Medicine and Education (ITME).

[28]  Tuan D. Pham,et al.  DUNet: A deformable network for retinal vessel segmentation , 2018, Knowl. Based Syst..

[29]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[30]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[31]  Md Zahangir Alom,et al.  Recurrent residual U-Net for medical image segmentation , 2019, Journal of medical imaging.

[32]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[33]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Razavi Seyyed Mohammad,et al.  Unsupervised Segmentation of Retinal Blood Vessels Using the Human Visual System Line Detection Model , 2016 .

[35]  Shahab Aslani,et al.  A new supervised retinal vessel segmentation method based on robust hybrid features , 2016, Biomed. Signal Process. Control..

[36]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[37]  Sang Jun Park,et al.  Retinal Vessel Segmentation in Fundoscopic Images with Generative Adversarial Networks , 2017, ArXiv.

[38]  Xin Yang,et al.  Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation , 2018, IEEE Transactions on Biomedical Engineering.

[39]  Jianwei Lu,et al.  A Coarse-to-Fine Fully Convolutional Neural Network for Fundus Vessel Segmentation , 2018, Symmetry.

[40]  Bunyarit Uyyanonvara,et al.  An approach to localize the retinal blood vessels using bit planes and centerline detection , 2012, Comput. Methods Programs Biomed..

[41]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[42]  Yiheng Cai,et al.  Retinal blood vessel segmentation based on the Gaussian matched filter and U-net , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[43]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[44]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.