Retinal vessel segmentation by a divide-and-conquer funnel-structured classification framework

Abstract Accurate vessel segmentation is a fundamental and challenging task for the retinal fundus image analysis. Current approaches typically train a global discriminative model for retinal vessel classification that is difficult to fit the complex pattern of vessel structure. In this paper, we propose a novel divide-and-conquer funnel-structured classification framework for retinal vessel segmentation. More specifically, a dividing algorithm, named multiplex vessel partition (MVP), is proposed to divide retinal vessel into well constrained subsets where vessel pixels with similar geometrical property are grouped. A set of homogeneous classifiers are trained in parallel to form discriminative decision for each group. This decomposes a complex classification problem into a number of relatively simpler ones. Moreover, a funnel-structured vessel segmentation (FsVS) framework is proposed to reclassify the uncertain samples caused by imperfect grouping of pixels. This alleviates the problem in data partition at the dividing phase and further enhances the complexity and discriminative capability of the decision model. Both quantitative and qualitative experimental comparisons on three publicly available databases show that the proposed framework produces high performance for retinal vessel segmentation, achieving 95.47–96.46% vessel segmentation accuracy, 83.72–85.79% local vessel segmentation accuracy, 78.63–81.92% F1-score and 76.55–80.13% Matthew correlation coefficient respectively, better than the state-of-the-art methods.

[1]  Yuan Zhang,et al.  Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function , 2018, Neurocomputing.

[2]  Xudong Jiang,et al.  Image detail-preserving filter for impulsive noise attenuation , 2003 .

[3]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[4]  Jérémie Dequidt,et al.  Blood vessel modeling for interactive simulation of interventional neuroradiology procedures , 2017, Medical Image Anal..

[5]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[6]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[7]  Remco Duits,et al.  A Multi-Orientation Analysis Approach to Retinal Vessel Tracking , 2012, Journal of Mathematical Imaging and Vision.

[8]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[9]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[10]  Ali Mahlooji Far,et al.  Retinal Image Analysis Using Curvelet Transform and Multistructure Elements Morphology by Reconstruction , 2011, IEEE Transactions on Biomedical Engineering.

[11]  Xudong Jiang,et al.  Blood vessel segmentation from fundus image by a cascade classification framework , 2019, Pattern Recognit..

[12]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[13]  Feng Lin,et al.  A Graph-Theoretical Approach for Tracing Filamentary Structures in Neuronal and Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[14]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[15]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Américo Oliveira,et al.  Retinal vessel segmentation based on Fully Convolutional Neural Networks , 2018, Expert Syst. Appl..

[18]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[19]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[20]  Gang Wang,et al.  Toward Achieving Robust Low-Level and High-Level Scene Parsing , 2019, IEEE Transactions on Image Processing.

[21]  Erik J. Bekkers,et al.  Retinal vessel delineation using a brain-inspired wavelet transform and random forest , 2017, Pattern Recognit..

[22]  Joseph M. Reinhardt,et al.  Splat Feature Classification With Application to Retinal Hemorrhage Detection in Fundus Images , 2013, IEEE Transactions on Medical Imaging.

[23]  Xudong Jiang,et al.  Enhancing retinal vessel segmentation by color fusion , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Juan Humberto Sossa Azuela,et al.  Retinal vessel extraction using Lattice Neural Networks with dendritic processing , 2015, Comput. Biol. Medicine.

[25]  Xudong Jiang,et al.  Asymmetric Principal Component and Discriminant Analyses for Pattern Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[27]  Keshab K. Parhi,et al.  Iterative Vessel Segmentation of Fundus Images , 2015, IEEE Transactions on Biomedical Engineering.

[28]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[29]  Huiqi Li,et al.  Segment 2D and 3D Filaments by Learning Structured and Contextual Features , 2017, IEEE Transactions on Medical Imaging.

[30]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[31]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[32]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[33]  Buket D. Barkana,et al.  Performance analysis of descriptive statistical features in retinal vessel segmentation via fuzzy logic, ANN, SVM, and classifier fusion , 2017, Knowl. Based Syst..

[34]  Xudong Jiang,et al.  Post-processing for retinal vessel detection , 2018, International Conference on Digital Image Processing.

[35]  Salah Bourennane,et al.  Retinal vessel segmentation using a probabilistic tracking method , 2012, Pattern Recognit..

[36]  Gongping Yang,et al.  Hierarchical retinal blood vessel segmentation based on feature and ensemble learning , 2015, Neurocomputing.

[37]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[38]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[39]  Xudong Jiang,et al.  Nonlinear retinal image enhancement for vessel detection , 2017, International Conference on Digital Image Processing.

[40]  Frank Y. Shih,et al.  Retinal vessels segmentation based on level set and region growing , 2014, Pattern Recognit..

[41]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[42]  Gang Wang,et al.  Context Contrasted Feature and Gated Multi-scale Aggregation for Scene Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[44]  Milan Sonka,et al.  Vessel Boundary Delineation on Fundus Images Using Graph-Based Approach , 2011, IEEE Transactions on Medical Imaging.

[45]  György Kovács,et al.  A self-calibrating approach for the segmentation of retinal vessels by template matching and contour reconstruction , 2016, Medical Image Anal..

[46]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[47]  Ken Masamune,et al.  A Variational Method for Geometric Regularization of Vascular Segmentation in Medical Images , 2008, IEEE Transactions on Image Processing.

[48]  Xin Yang,et al.  Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation , 2018, IEEE Transactions on Biomedical Engineering.