Image segmentation via mean shift and loopy belief propagation

This paper presents a novel approach that can quickly and effectively partition images based on fully exploiting the spatially coherent property. We propose an algorithm named iterative loopy belief propagation (iLBP) to integrate the homogenous regions and prove its convergence. The image is first segmented by mean shift (MS) algorithm to form over-segmented regions that preserve the desirable edges and spatially coherent parts. The segmented regions are then represented by region adjacent graph (RAG). Motivated by k-means algorithm, the iLBP algorithm is applied to perform the minimization of the cost function to integrate the over-segmented parts to get the final segmentation result. The image clustering based on the segmented regions instead of the image pixels reduces the number of basic image entities and enhances the image segmentation quality. Comparing the segmentation result with some existing algorithms, the proposed algorithm shows a better performance based on the evaluation criteria of entropy especially on complex scene images.

[1]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Aydin Alatan,et al.  Efficient graph-based image segmentation via speeded-up turbo pixels , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[4]  Jeffrey Mark Siskind,et al.  Image Segmentation with Ratio Cut , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Li Fei-Fei,et al.  Spatially coherent latent topic model for concurrent object segmentation and classification , 2007 .

[6]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Songcan Chen,et al.  A Scale-Based Connected Coherence Tree Algorithm for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[8]  Daphna Weinshall,et al.  Classification with Nonmetric Distances: Image Retrieval and Class Representation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Donald Geman,et al.  Boundary Detection by Constrained Optimization , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[11]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[13]  Rui Seara,et al.  Image segmentation by histogram thresholding using fuzzy sets , 2002, IEEE Trans. Image Process..

[14]  Sunil Kumar,et al.  Text Extraction and Document Image Segmentation Using Matched Wavelets and MRF Model , 2007, IEEE Transactions on Image Processing.

[15]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Dorin Comaniciu,et al.  An Algorithm for Data-Driven Bandwidth Selection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  W. Eric L. Grimson,et al.  Spatial Latent Dirichlet Allocation , 2007, NIPS.

[18]  Robert P. W. Duin,et al.  STATISTICAL PATTERN RECOGNITION , 2005 .

[19]  Hui Zhang,et al.  An entropy-based objective evaluation method for image segmentation , 2003, IS&T/SPIE Electronic Imaging.

[20]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Tianzi Jiang,et al.  Pixon-based image segmentation with Markov random fields , 2003, IEEE Trans. Image Process..

[22]  Alain Trémeau,et al.  Regions adjacency graph applied to color image segmentation , 2000, IEEE Trans. Image Process..

[23]  Takeo Kanade,et al.  A Hierarchical Markov Random Field Model for Figure-Ground Segregation , 2001, EMMCVPR.

[24]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Jianping Fan,et al.  Seeded region growing: an extensive and comparative study , 2005, Pattern Recognit. Lett..

[26]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[27]  Hai Jin,et al.  Color Image Segmentation Based on Mean Shift and Normalized Cuts , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  David G. Stork,et al.  Pattern Classification , 1973 .

[29]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[30]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.