Automatic detection of vascular bifurcations in segmented retinal images using trainable COSFIRE filters

Background: The vascular tree observed in a retinal fundus image can provide clues for cardiovascular diseases. Its analysis requires the identification of vessel bifurcations and crossovers. Methods: We use a set of trainable keypoint detectors that we call Combination Of Shifted FIlter REsponses or COSFIRE filters to automatically detect vascular bifurcations in segmented retinal images. We configure a set of COSFIRE filters that are selective for a number of prototype bifurcations and demonstrate that such filters can be effectively used to detect bifurcations that are similar to the prototypical ones. The automatic configuration of such a filter selects given channels of a bank of Gabor filters and determines certain blur and shift parameters. The response of a COSFIRE filter is computed as the weighted geometric mean of the blurred and shifted responses of the selected Gabor filters. The COSFIRE approach is inspired by the function of a specific type of shape-selective neuron in area V4 of visual cortex. Results: We ran experiments on three data sets and achieved the following results: (a) a recall of 97.88% at precision of 96.94% on 40 manually segmented images provided in the DRIVE data set, (b) a recall of 97.32% at precision of 96.04% on 20 manually segmented images provided in the STARE data set, and (c) a recall of 97.02% at precision of 96.53% on a set of 10 automatically segmented images obtained from images in the DRIVE data set. Conclusions: The COSFIRE filters that we use are conceptually simple and easy to implement: the filter output is computed as the weighted geometric mean of blurred and shifted Gabor filter responses. They are versatile keypoint detectors as they can be configured with any given local contour pattern and are subsequently able to detect the same and similar patterns.

[1]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[2]  Bunyarit Uyyanonvara,et al.  A supervised method for retinal blood vessel segmentation using line strength, multiscale Gabor and morphological features , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[3]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[4]  N. Chapman,et al.  Peripheral vascular disease is associated with abnormal arteriolar diameter relationships at bifurcations in the human retina. , 2002, Clinical science.

[5]  George Azzopardi,et al.  A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model , 2012, Biological Cybernetics.

[6]  George Azzopardi,et al.  A CORF Computational Model of a Simple Cell , 2012 .

[7]  Hong Shen,et al.  Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images , 2001, IEEE Transactions on Information Technology in Biomedicine.

[8]  Manuel G. Penedo,et al.  Personal verification based on extraction and characterisation of retinal feature points , 2009, J. Vis. Lang. Comput..

[9]  D Selvathi,et al.  Gabor wavelet based blood vessel segmentation in retinal images using kernel classifiers , 2011, 2011 International Conference on Signal Processing, Communication, Computing and Networking Technologies.

[10]  Anil A. Bharath,et al.  Retinal vascular tree morphology: a semi-automatic quantification , 2002, IEEE Transactions on Biomedical Engineering.

[11]  Nicolai Petkov,et al.  Nonlinear operator for oriented texture , 1999, IEEE Trans. Image Process..

[12]  Nicolai Petkov,et al.  Computational models of visual neurons specialised in the detection of periodic and aperiodic oriented visual stimuli: bar and grating cells , 1997, Biological Cybernetics.

[13]  Hiroshi Fujita,et al.  Computerized Detection of Retinal Nerve Fiber Layer Defects in Retinal Fundus Images by Modified Polar Transformation and Gabor Filtering , 2009 .

[14]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Cemal Kose,et al.  Retinal blood vessel segmentation using gabor filter and top-hat transform , 2011, 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU).

[16]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[17]  Changsong Liu,et al.  Gabor filters-based feature extraction for character recognition , 2005, Pattern Recognit..

[18]  Ali Broumandnia,et al.  A new retinal vessel segmentation method using preprocessed Gabor and local binary patterns , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[19]  C. Gross,et al.  Visuotopic organization and extent of V3 and V4 of the macaque , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Eunhwa Jung,et al.  Automatic Retinal Vasculature Structure Tracing and Vascular Landmark Extraction from Human Eye Image , 2006, 2006 International Conference on Hybrid Information Technology.

[21]  C D Murray,et al.  The Physiological Principle of Minimum Work: I. The Vascular System and the Cost of Blood Volume. , 1926, Proceedings of the National Academy of Sciences of the United States of America.

[22]  George Azzopardi,et al.  Trainable COSFIRE Filters for Keypoint Detection and Pattern Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  E. Ardizzone,et al.  Blood vessels and feature points detection on retinal images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Guoliang Fan,et al.  An efficient blood vessel detection algorithm for retinal images using local entropy thresholding , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[25]  I. Deary,et al.  Retinal image analysis: Concepts, applications and potential , 2006, Progress in Retinal and Eye Research.

[26]  Nicolai Petkov,et al.  Suppression of contour perception by band-limited noise and its relation to nonclassical receptive field inhibition , 2003, Biological cybernetics.

[27]  T. Wonnacott,et al.  Relation between diameter and flow in major branches of the arch of the aorta. , 1992, Journal of biomechanics.

[28]  F Pierelli,et al.  Correlation between morphological and functional retinal impairment in multiple sclerosis patients. , 1999, Investigative ophthalmology & visual science.

[29]  Kotagiri Ramamohanarao,et al.  Automatic Detection of Vascular Bifurcations and Crossovers from Color Retinal Fundus Images , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[30]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[31]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[32]  Yang Xiang,et al.  Retinal image registration using bifurcation structures , 2011, 2011 18th IEEE International Conference on Image Processing.

[33]  Lei Zhang,et al.  A Multiscale Approach to Retinal Vessel Segmentation Using Gabor Filters and Scale Multiplication , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[34]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[35]  Tien D. Bui,et al.  Retinal Image Segmentation Based on Mumford-Shah Model and Gabor Wavelet Filter , 2010, 2010 20th International Conference on Pattern Recognition.

[36]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[37]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[38]  Chia-Ling Tsai,et al.  Model-based method for improving the accuracy and repeatability of estimating vascular bifurcations and crossovers from retinal fundus images , 2004, IEEE Transactions on Information Technology in Biomedicine.

[39]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[40]  Nikolay Petkov,et al.  Biologically motivated computationally intensive approaches to image pattern recognition , 1995, Future Gener. Comput. Syst..

[41]  Rangaraj M. Rangayyan,et al.  Detection of the Optic Nerve Head in Fundus Images of the Retina with Gabor Filters and Phase Portrait Analysis , 2010, Journal of Digital Imaging.

[42]  M. Usman Akram,et al.  Gabor wavelet based vessel segmentation in retinal images , 2009, 2009 IEEE Symposium on Computational Intelligence for Image Processing.

[43]  C. Connor,et al.  Population coding of shape in area V4 , 2002, Nature Neuroscience.

[44]  E. Russell Ritenour,et al.  Medical Physics and Biomedical Engineering , 1999 .

[45]  B. Roysam,et al.  Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination , 1998, IEEE Transactions on Biomedical Engineering.

[46]  C. D. Murray.  THE PHYSIOLOGICAL PRINCIPLE OF MINIMUM WORK APPLIED TO THE ANGLE OF BRANCHING OF ARTERIES , 1926, The Journal of general physiology.

[47]  George Azzopardi,et al.  Detection of Retinal Vascular Bifurcations by Trainable V4-Like Filters , 2011, CAIP.

[48]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[49]  Hong Shen,et al.  Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  T F Sherman,et al.  On connecting large vessels to small. The meaning of Murray's law , 1981, The Journal of general physiology.

[51]  Hao Sun,et al.  Linearity Can Account for the Similarity Among Conventional, Frequency-Doubling, and Gabor-Based Perimetric Tests in the Glaucomatous Macula , 2006, Optometry and vision science : official publication of the American Academy of Optometry.

[52]  Manuel G. Penedo,et al.  Automatic detection and characterisation of retinal vessel tree bifurcations and crossovers in eye fundus images , 2011, Comput. Methods Programs Biomed..

[53]  Amir Akramin Shafie,et al.  Vascular intersection detection in retina fundus images using a new hybrid approach , 2010, Comput. Biol. Medicine.

[54]  G Tedeschi,et al.  Correlation between morphological and functional retinal impairment in multiple sclerosis patients , 2007 .

[55]  F. Kingdom,et al.  Multiplication in curvature processing. , 2009, Journal of vision.

[56]  J. Brannan,et al.  Hidden visual loss in optic neuropathy is revealed using Gabor patch contrast perimetry. , 1997, Clinical neuroscience.

[57]  Walter Paulus,et al.  Impairment of retinal increment thresholds in Huntington's disease , 1993, Annals of neurology.

[58]  Cemal Kose,et al.  Comparing 2D matched filter response and Gabor filter methods for vessel segmentation in retinal images , 2010, National Conference on Electrical, Electronics and Computer Engineering.

[59]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[60]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[61]  Nicolai Petkov,et al.  The Role of Non-CRF Inhibition in Contour Detection , 2003, WSCG.

[62]  T. Sano,et al.  [Diabetic retinopathy]. , 2001, Nihon rinsho. Japanese journal of clinical medicine.

[63]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[64]  M. Tso,et al.  Pathophysiology of hypertensive retinopathy. , 1982, Ophthalmology.

[65]  M. Sonka,et al.  Retinal Imaging and Image Analysis. , 2010, IEEE transactions on medical imaging.

[66]  M Zamir,et al.  Arterial bifurcations in the human retina , 1979, The Journal of general physiology.