Hybrid superpixel segmentation

Superpixel over-segment image into meaningful clusters so that pixels in each cluster belong to one object. Many state-of-art superpixel algorithms have to make trade-offs between different concerns. As a result, algorithms that can produce good result in some situations fail in another. In order to take advantage of different algorithms and at the same time avoid their limitation, we propose a new fusion approach based on an efficient lazy greedy optimization. It incorporates two different superpixel algorithms as its ancestors and produces a hybrid result. The result is then refined based on a novel energy function that consists of two terms. The region term uses histogram diffusion distance and enforces intra-region similarity from an overall perspective; the boundary term models interregion dissimilarity from a local perspective. In experiments, the result of proposed algorithm matches the best superpixel algorithm and shows outstanding performance over its ancestor algorithms in all the standard evaluation metrics.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Greg Mori,et al.  Guiding model search using segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Svetlana Lazebnik,et al.  Superparsing - Scalable Nonparametric Image Parsing with Superpixels , 2010, International Journal of Computer Vision.

[5]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[6]  Alain Trémeau,et al.  Regions adjacency graph applied to color image segmentation , 2000, IEEE Trans. Image Process..

[7]  Luc Van Gool,et al.  SEEDS: Superpixels Extracted Via Energy-Driven Sampling , 2012, International Journal of Computer Vision.

[8]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[9]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[10]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[12]  FuaPascal,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012 .

[13]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[14]  Haibin Ling,et al.  Diffusion Distance for Histogram Comparison , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.