A Learning-Based Framework for Supervised and Unsupervised Image Segmentation Evaluation

Image segmentation is a fundamental task in automatic image analysis. However, there is still no generally accepted effectiveness measure which is suitable for evaluating the segmentation quality in every application. In this paper, we propose an evaluation framework which benefits from multiple stand-alone measures. To this end, different segmentation evaluation measures are chosen to evaluate segmentation separately, and the results are effectively combined using machine learning methods. We train and implement this framework in our brand-new segmentation dataset which contains images of different contents with segmentation ground truth and Weizmann segmentation database (WSD). In addition, we provide human evaluation of image segmentation pairs to benchmark the evaluation results of the measures. Experimental results show a better performance than the stand-alone methods.

[1]  Hui Zhang,et al.  A co-evaluation framework for improving segmentation evaluation , 2005, SPIE Defense + Commercial Sensing.

[2]  Bo Peng,et al.  Parameter Selection for Graph Cut Based Image Segmentation , 2008, BMVC.

[3]  David Zhang,et al.  A survey of graph theoretical approaches to image segmentation , 2013, Pattern Recognit..

[4]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[5]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Paola Campadelli,et al.  Quantitative evaluation of color image segmentation results , 1998, Pattern Recognit. Lett..

[7]  Noel E. O'Connor,et al.  Toward automated evaluation of interactive segmentation , 2011, Comput. Vis. Image Underst..

[8]  C. Fink,et al.  Coronary CT angiography: image quality, diagnostic accuracy, and potential for radiation dose reduction using a novel iterative image reconstruction technique—comparison with traditional filtered back projection , 2011, European Radiology.

[9]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[10]  Doan B. Hoang,et al.  Visual analytics for intrusion detection in spam emails , 2013, Int. J. Grid Util. Comput..

[11]  Yi Yang,et al.  Layered Object Models for Image Segmentation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[13]  Yoav Freund,et al.  Game theory, on-line prediction and boosting , 1996, COLT '96.

[14]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[15]  Wen-Xiong Kang,et al.  The Comparative Research on Image Segmentation Algorithms , 2009, 2009 First International Workshop on Education Technology and Computer Science.

[16]  Daniel Cremers,et al.  A Linear Framework for Region-Based Image Segmentation and Inpainting Involving Curvature Penalization , 2011, International Journal of Computer Vision.

[17]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Evan Fletcher,et al.  Adaptive image segmentation for robust measurement of longitudinal brain tissue change , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[21]  Chengke Wu,et al.  Applying distribution of feature points to detect multiple plane , 2012, Int. J. Grid Util. Comput..

[22]  Andrea Clematis,et al.  A Grid framework to enable parallel and concurrent TMA image analyses , 2009, Int. J. Grid Util. Comput..

[23]  Martial Hebert,et al.  A Comparison of Image Segmentation Algorithms , 2005 .

[24]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.