Unsupervised image segmentation using global spatial constraint and multi-scale representation on multiple segmentation proposals

This paper presents a novel method for unsupervised image segmentation. The method determines the reasonable segments for final segmentation by exploiting both global and local context cues on multiple segmentation proposals. The proposal is obtained by using any existing segmentation algorithms, providing the diverse segment cues to guide segmentation. An iterative process is used to perform the cues integration and the image segmentation, including the segments modeling and the segments labeling. The former estimates the distribution of shared segments, while the latter labels each proposal into segments by minimizing an energy function. The final segmentation is produced when the consistent spatial layout is found in different proposals. Compared with the existing methods, the segmentation results are more satisfying on the Berkeley Segmentation Database.

[1]  Ronen Basri,et al.  Co-clustering of image segments using convex optimization applied to EM neuronal reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Jitendra Malik,et al.  From contours to regions: An empirical evaluation , 2009, CVPR.

[3]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[6]  Nikos Paragios,et al.  Unsupervised co-segmentation through region matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Ronen Basri,et al.  Contour-based joint clustering of multiple segmentations , 2011, CVPR 2011.

[8]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Hongsheng Li,et al.  A hierarchical image clustering cosegmentation framework , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Horst Bischof,et al.  ROI-SEG: Unsupervised Color Segmentation by Combining Differently Focused Sub Results , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Francisco F. Rivera,et al.  Image segmentation based on merging of sub-optimal segmentations , 2006, Pattern Recognit. Lett..