A Function for Quality Evaluation of Retinal Vessel Segmentations

Retinal blood vessel assessment plays an important role in the diagnosis of ophthalmic pathologies. The use of digital images for this purpose enables the application of a computerized approach and has fostered the development of multiple methods for automated vascular tree segmentation. Metrics based on contingency tables for binary classification have been widely used for evaluating the performance of these algorithms. Metrics from this family are based on the measurement of a success or failure rate in the detected pixels, obtained by means of pixel-to-pixel comparison between the automated segmentation and a manually-labeled reference image. Therefore, vessel pixels are not considered as a part of a vascular structure with specific features. This paper contributes a function for the evaluation of global quality in retinal vessel segmentations. This function is based on the characterization of vascular structures as connected segments with measurable area and length. Thus, its design is meant to be sensitive to anatomical vascularity features. Comparison of results between the proposed function and other general quality evaluation functions shows that this proposal renders a high matching degree with human quality perception. Therefore, it can be used to enhance quality evaluation in retinal vessel segmentations, supplementing the existing functions. On the other hand, from a general point of view, the applied concept of measuring descriptive properties may be used to design specialized functions aimed at segmentation quality evaluation in other complex structures.

[1]  H. Lamecker,et al.  Segmentation of the Liver using a 3D Statistical Shape Model , 2004 .

[2]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[3]  Hicham Laanaya,et al.  Evaluation for uncertain image classification and segmentation , 2006, Pattern Recognit..

[4]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[5]  Bram van Ginneken,et al.  Automatic detection of red lesions in digital color fundus photographs , 2005, IEEE Transactions on Medical Imaging.

[6]  Yannis A. Tolias,et al.  A fuzzy vessel tracking algorithm for retinal images based on fuzzy clustering , 1998, IEEE Transactions on Medical Imaging.

[7]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ying Sun,et al.  Recursive tracking of vascular networks in angiograms based on the detection-deletion scheme , 1993, IEEE Trans. Medical Imaging.

[9]  Martha Elizabeth Shenton,et al.  On evaluating brain tissue classifiers without a ground truth , 2007, NeuroImage.

[10]  David W. Paglieroni Design considerations for image segmentation quality assessment measures , 2004, Pattern Recognit..

[11]  Enrico Grisan,et al.  Detection of optic disc in retinal images by means of a geometrical model of vessel structure , 2004, IEEE Transactions on Medical Imaging.

[12]  John Flynn,et al.  Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis , 2002, Medical Image Anal..

[13]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[14]  Alfredo Ruggeri,et al.  A divide et impera strategy for automatic classification of retinal vessels into arteries and veins , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[15]  Anil A. Bharath,et al.  Retinal Blood Vessel Segmentation by Means of Scale-Space Analysis and Region Growing , 1999, MICCAI.

[16]  Huiqi Li,et al.  Automated feature extraction in color retinal images by a model based approach , 2004, IEEE Transactions on Biomedical Engineering.

[17]  Nicolino J. Pizzi,et al.  Fuzzy pre-processing of gold standards as applied to biomedical spectra classification , 1999, Artif. Intell. Medicine.

[18]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[19]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[20]  Shankar M. Krishnan,et al.  Detection and measurement of retinal vessels in fundus images using amplitude modified second-order Gaussian filter , 2002, IEEE Transactions on Biomedical Engineering.

[21]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[22]  Hong Yan,et al.  A Novel Vessel Segmentation Algorithm for Pathological Retina Images Based on the Divergence of Vector Fields , 2008, IEEE Transactions on Medical Imaging.

[23]  Hiroshi Fujita,et al.  Automated analysis of the distributions and geometries of blood vessels on retinal fundus images , 2004, SPIE Medical Imaging.

[24]  A. Ruggeri,et al.  Quantitative description of vessel features in hypertensive retinopathy fundus images , 2001 .

[25]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[26]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Anil A. Bharath,et al.  Retinal vascular tree morphology: a semi-automatic quantification , 2002, IEEE Transactions on Biomedical Engineering.

[28]  C. Sinthanayothin,et al.  Automated localisation of the optic disc, fovea, and retinal blood vessels from digital colour fundus images , 1999, The British journal of ophthalmology.

[29]  Liang Zhou,et al.  The detection and quantification of retinopathy using digital angiograms , 1994, IEEE Trans. Medical Imaging.

[30]  Aliaa A. A. Youssif,et al.  Optic Disc Detection From Normalized Digital Fundus Images by Means of a Vessels' Direction Matched Filter , 2008, IEEE Transactions on Medical Imaging.

[31]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[32]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[33]  B. Roysam,et al.  Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination , 1998, IEEE Transactions on Biomedical Engineering.

[34]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[35]  Hong Shen,et al.  Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images , 2001, IEEE Transactions on Information Technology in Biomedicine.

[36]  T. Williamson,et al.  Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool. , 1996, The British journal of ophthalmology.

[37]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[38]  George K. Matsopoulos,et al.  Multimodal registration of retinal images using self organizing maps , 2004, IEEE Transactions on Medical Imaging.

[39]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[40]  Frédéric Zana,et al.  A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform , 1999, IEEE Transactions on Medical Imaging.

[41]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[42]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[43]  M. Larsen,et al.  Automated detection of fundus photographic red lesions in diabetic retinopathy. , 2003, Investigative ophthalmology & visual science.

[44]  Andrew Hunter,et al.  Measurement of retinal vessel widths from fundus images based on 2-D modeling , 2004, IEEE Transactions on Medical Imaging.

[45]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[46]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..