Edge-Based Unsupervised Evaluation of Image Segmentation

This paper focuses on a fundamental problem in computer vision: how to evaluate the quality of image segmentation. Supervised evaluation methods provide a more accurate evaluation than the unsupervised methods, but these methods cannot work without manually-segmented reference segmentations. This shortcoming limits its applications. We present an edge-based evaluation method which works without the comparison with reference segmentations. Our method evaluates the quality of segmentation by three edge-based measures: the edge fitness, the intra-region edge error and the out-of-bound error. Experimental results show that our method provides a more accurate evaluation than those method based on the statistic of pixel values, and can be used in both segmentation evaluation and region evaluation. A significant linear correlation is shown between the evaluation scores of our method and two widely used supervised methods. The proposed methods show a high performance on the automatic choice of the best fitted parameters for region growing.

[1]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[2]  Sang Uk Lee,et al.  Learning full pairwise affinities for spectral segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Dieter Schmalstieg,et al.  Discrete-Continuous Gradient Orientation Estimation for Faster Image Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Hélène Laurent,et al.  Unsupervised Performance Evaluation of Image Segmentation , 2006, EURASIP J. Adv. Signal Process..

[6]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[8]  Sheng-Jyh Wang,et al.  The use of visible color difference in the quantitative evaluation of color image segmentation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Hui Zhang,et al.  An entropy-based objective evaluation method for image segmentation , 2003, IS&T/SPIE Electronic Imaging.

[11]  Cristian Sminchisescu,et al.  CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Alexei A. Efros,et al.  Improving Spatial Support for Objects via Multiple Segmentations , 2007, BMVC.