A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images

Goal: In this work, we present an extensive description and evaluation of our method for blood vessel segmentation in fundus images based on a discriminatively trained fully connected conditional random field model. Methods: Standard segmentation priors such as a Potts model or total variation usually fail when dealing with thin and elongated structures. We overcome this difficulty by using a conditional random field model with more expressive potentials, taking advantage of recent results enabling inference of fully connected models almost in real time. Parameters of the method are learned automatically using a structured output support vector machine, a supervised technique widely used for structured prediction in a number of machine learning applications. Results: Our method, trained with state of the art features, is evaluated both quantitatively and qualitatively on four publicly available datasets: DRIVE, STARE, CHASEDB1, and HRF. Additionally, a quantitative comparison with respect to other strategies is included. Conclusion: The experimental results show that this approach outperforms other techniques when evaluated in terms of sensitivity, F1-score, G-mean, and Matthews correlation coefficient. Additionally, it was observed that the fully connected model is able to better distinguish the desired structures than the local neighborhood-based approach. Significance: Results suggest that this method is suitable for the task of segmenting elongated structures, a feature that can be exploited to contribute with other medical and biological applications.

[1]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[2]  Roberto Marcondes Cesar Junior,et al.  Retinal Vessel Segmentation Using the 2-D Morlet Wavelet and Supervised Classification , 2005, ArXiv.

[3]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[4]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[5]  Muhammad Moazam Fraz,et al.  Delineation of blood vessels in pediatric retinal images using decision trees-based ensemble classification , 2014, International Journal of Computer Assisted Radiology and Surgery.

[6]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Elena Prokofyeva,et al.  Epidemiology of Major Eye Diseases Leading to Blindness in Europe: A Literature Review , 2011, Ophthalmic Research.

[8]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[9]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[10]  Bunyarit Uyyanonvara,et al.  Retinal Vessel Extraction Using First-Order Derivative of Gaussian and Morphological Processing , 2011, ISVC.

[11]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  M. Sonka,et al.  Retinal Imaging and Image Analysis , 2010, IEEE Reviews in Biomedical Engineering.

[13]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[14]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[15]  Juan Humberto Sossa Azuela,et al.  Retinal vessel extraction using Lattice Neural Networks with dendritic processing , 2015, Comput. Biol. Medicine.

[16]  Xiaoyi Jiang,et al.  A self-adaptive matched filter for retinal blood vessel detection , 2014, Machine Vision and Applications.

[17]  M. Helmstaedter Cellular-resolution connectomics: challenges of dense neural circuit reconstruction , 2013, Nature Methods.

[18]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[19]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[20]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[21]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Saeed Sadri,et al.  Vessel centerlines extraction from Fundus Fluorescein Angiogram based on Hessian analysis of directional curvelet subbands , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Jan Odstrcilik,et al.  Improvement of Vessel Segmentation by Matched Filtering in Colour Retinal Images , 2009 .

[24]  Andreas K. Maier,et al.  Robust Vessel Segmentation in Fundus Images , 2013, Int. J. Biomed. Imaging.

[25]  Hossein Rabbani,et al.  A new curvelet transform based method for extraction of red lesions in digital color retinal images , 2010, 2010 IEEE International Conference on Image Processing.

[26]  Yali Zhao,et al.  A New Approach to Segment Both Main and Peripheral Retinal Vessels Based on Gray-Voting and Gaussian Mixture Model , 2015, PloS one.

[27]  Giri Babu Kande,et al.  Unsupervised Fuzzy Based Vessel Segmentation In Pathological Digital Fundus Images , 2010, Journal of Medical Systems.

[28]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[29]  Matthew B. Blaschko,et al.  Learning Fully-Connected CRFs for Blood Vessel Segmentation in Retinal Images , 2014, MICCAI.

[30]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[31]  Emanuele Trucco,et al.  FABC: Retinal Vessel Segmentation Using AdaBoost , 2010, IEEE Transactions on Information Technology in Biomedicine.

[32]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[33]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[34]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[35]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[36]  Lili Xu,et al.  A novel method for blood vessel detection from retinal images , 2010, Biomedical engineering online.

[37]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[38]  Emanuele Trucco,et al.  Improving vessel segmentation in ultra-wide field-of-view retinal fluorescein angiograms , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[40]  Thorsten Joachims,et al.  Cutting-plane training of structural SVMs , 2009, Machine Learning.

[41]  Andrew Hunter,et al.  An Active Contour Model for Segmenting and Measuring Retinal Vessels , 2009, IEEE Transactions on Medical Imaging.

[42]  Samuel Kadoury,et al.  Metastatic liver tumour segmentation from discriminant Grassmannian manifolds , 2015, Physics in medicine and biology.

[43]  Salah Bourennane,et al.  Automatic Segmentation and Measurement of Vasculature in Retinal Fundus Images Using Probabilistic Formulation , 2013, Comput. Math. Methods Medicine.

[44]  Ahmad Reza Naghsh-Nilchi,et al.  Automatic wavelet-based retinal blood vessels segmentation and vessel diameter estimation , 2013, Biomed. Signal Process. Control..

[45]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[46]  Hong Yan,et al.  High speed detection of retinal blood vessels in fundus image using phase congruency , 2011, Soft Comput..

[47]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[48]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[49]  Muhammad Moazam Fraz,et al.  Application of Morphological Bit Planes in Retinal Blood Vessel Extraction , 2013, Journal of Digital Imaging.

[50]  Keshab K. Parhi,et al.  Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Subimage Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[51]  Samuel Kadoury,et al.  Higher-Order CRF Tumor Segmentation with Discriminant Manifold Potentials , 2013, MICCAI.

[52]  Keshab K. Parhi,et al.  Iterative Vessel Segmentation of Fundus Images , 2015, IEEE Transactions on Biomedical Engineering.

[53]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[54]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[55]  Stan Z. Li Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.