Distance Measures for Image Segmentation Evaluation

The task considered in this paper is performance evaluation of region segmentation algorithms in the ground-truth-based paradigm. Given a machine segmentation and a ground-truth segmentation, performance measures are needed. We propose to consider the image segmentation problem as one of data clustering and, as a consequence, to use measures for comparing clusterings developed in statistics and machine learning. By doing so, we obtain a variety of performance measures which have not been used before in image processing. In particular, some of these measures have the highly desired property of being a metric. Experimental results are reported on both synthetic and real data to validate the measures and compare them with others.

[1]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[2]  Qian Huang,et al.  Quantitative methods of evaluating image segmentation , 1995, Proceedings., International Conference on Image Processing.

[3]  Xiaoyi Jiang.  An Adaptive Contour Closure Algorithm and Its Experimental Evaluation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  C. Mallows,et al.  A Method for Comparing Two Hierarchical Clusterings , 1983 .

[5]  Horst Bunke,et al.  Image Segmentation Evaluation by Techniques of Comparing Clusterings , 2005, ICIAP.

[6]  Horst Bunke,et al.  Comparing Curved-Surface Range Image Segmenters , 1998, ICCV.

[7]  Kevin W. Bowyer,et al.  Evaluation of Texture Segmentation Algorithms , 1999, CVPR.

[8]  Isabelle Guyon,et al.  A Stability Based Method for Discovering Structure in Clustered Data , 2001, Pacific Symposium on Biocomputing.

[9]  Mark W. Powell,et al.  Automated performance evaluation of range image segmentation algorithms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[12]  Marina Meila,et al.  Comparing Clusterings by the Variation of Information , 2003, COLT.

[13]  R. Mooney,et al.  Impact of Similarity Measures on Web-page Clustering , 2000 .

[14]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Mikhail J. Atallah,et al.  Algorithms and Theory of Computation Handbook , 2009, Chapman & Hall/CRC Applied Algorithms and Data Structures series.

[16]  Xiaoyi Jiang,et al.  Supervised Evaluation Methodology for Curvilinear Structure Detection Algorithms , 2002, ICPR.

[17]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Xiaoyi Jiang,et al.  PERFORMANCE EVALUATION OF IMAGE SEGMENTATION ALGORITHMS , 2005 .

[20]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[21]  Alastair R. Allen,et al.  A Similarity Metric for Edge Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Kosuke Sato,et al.  Some further results of experimental comparison of range image segmentation algorithms , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  Rita Cucchiara,et al.  Optimal range segmentation parameters through genetic algorithms , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  S. Dongen.  Performance criteria for graph clustering and Markov cluster experiments , 2000 .