Computationally Efficient Quantitative Testing of Image Segmentation with a Genetic Algorithm

Quantitative testing of segmentation algorithms implies rigorous testing against ground truth segmentations. Though under-reported in the literature, the performance of a segmentation algorithm depends on the choice of input parameters. The paper reports wide variety both in evaluation time and segmentation results for an example mean-shift algorithm. When testing extends over an algorithmpsilas parameter space, then the search for satisfactory settings has a considerable cost in time. This paper considers the use of a genetic algorithm (GA) to avoid an exhaustive search. As application of the GA drastically reduces search times, the paper investigates how best to apply the GA in terms of initial candidate population, convergence speed, and application of a final polishing round. The GA parameter search forms part of a three-component computation environment aimed at automating the search and reducing the evaluation time. The first component relies on scripted testing and collation of results. The second component transfers to a commodity cluster computer. And the third component applies a genetic algorithm to avoid an exhaustive search.

[1]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[2]  Simon M. Lucas,et al.  Automatic evaluation of algorithms over the Internet , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[6]  William A. Yasnoff,et al.  Error measures for scene segmentation , 1977, Pattern Recognit..

[7]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[8]  Hui Zhang,et al.  An entropy-based objective evaluation method for image segmentation , 2003, IS&T/SPIE Electronic Imaging.

[9]  Qian Huang,et al.  Quantitative methods of evaluating image segmentation , 1995, Proceedings., International Conference on Image Processing.

[10]  Pillip Greenway,et al.  Metrics for image segmentation , 1998, Defense, Security, and Sensing.

[11]  John K. Ousterhout,et al.  Scripting: Higher-Level Programming for the 21st Century , 1998, Computer.

[12]  Brent B Welch,et al.  Practical Programming in Tcl and Tk , 1999 .

[13]  Alan L. Yuille,et al.  Fundamental bounds on edge detection: an information theoretic evaluation of different edge cues , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Henk L. Muller,et al.  Evaluating image segmentation algorithms using monotonic hulls in fitness/cost space , 2001, BMVC.

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[17]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[18]  Paul R. Cohen,et al.  Empirical methods for artificial intelligence , 1995, IEEE Expert.

[19]  Neil A. Thacker,et al.  Algorithmic modelling for performance evaluation , 1997, Machine Vision and Applications.

[20]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Isabelle Guyon,et al.  What Size Test Set Gives Good Error Rate Estimates? , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Sudeep Sarkar,et al.  A Framework for Performance Characterization of Intermediate-Level Grouping Modules , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.