A label field fusion model with a variation of information estimator for image segmentation

Abstract This paper proposes a new and reliable segmentation approach based on a fusion framework for combining multiple region-based segmentation maps (with any number of regions) to provide a final improved (i.e., accurate and consistent) segmentation result. The core of this new combination model is based on a consensus (cost) function derived from the recent information Theory based variation of information criterion, proposed by Meila, and allowing to quantify the amount of information that is lost or gained in changing from one clustering to another. In this case, the resulting consensus energy-based segmentation fusion model can be efficiently optimized by exploiting an iterative steepest local energy descent strategy combined with a connectivity constraint. This new framework of segmentation combination, relying on the fusion of inaccurate, quickly and roughly calculated, spatial clustering results, emerges as an appealing alternative to the use of complex segmentation models existing nowadays. Experiments on the Berkeley Segmentation Dataset show that the proposed fusion framework compares favorably to previous techniques in terms of reliability scores.

[1]  M. Meilă.  Comparing clusterings---an information based distance , 2007 .

[2]  Long Quan,et al.  Normalized tree partitioning for image segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Taghi M. Khoshgoftaar,et al.  Unsupervised multiscale color image segmentation based on MDL principle , 2006, IEEE Transactions on Image Processing.

[5]  Max Mignotte.  A de-texturing and spatially constrained K-means approach for image segmentation , 2011, Pattern Recognit. Lett..

[6]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[7]  Patrick Pérez,et al.  Three-Class Markovian Segmentation of High-Resolution Sonar Images , 1999, Comput. Vis. Image Underst..

[8]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[9]  Max Mignotte,et al.  Segmentation by Fusion of Histogram-Based $K$-Means Clusters in Different Color Spaces , 2008, IEEE Transactions on Image Processing.

[10]  Soumya Ghosh,et al.  A general framework for reconciling multiple weak segmentations of an image , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[11]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[12]  Zhi-Hua Zhou,et al.  SOM Ensemble-Based Image Segmentation , 2004, Neural Processing Letters.

[13]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[14]  Nong Sang,et al.  Image segmentation via coherent clustering in L , 2011 .

[15]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ajoy Kumar Ray,et al.  A-IFS Histon Based Multithresholding Algorithm for Color Image Segmentation , 2009, IEEE Signal Processing Letters.

[17]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Amar Mitiche,et al.  Multiregion Image Segmentation by Parametric Kernel Graph Cuts , 2011, IEEE Transactions on Image Processing.

[19]  Sotirios Chatzis,et al.  The infinite Hidden Markov random field model , 2009, ICCV.

[20]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[21]  John Wright,et al.  Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[23]  Paul F. Whelan,et al.  CTex-An Adaptive Unsupervised Segmentation Algorithm based on Colour-Texture Coherence , 2022 .

[24]  Max Mignotte,et al.  A hierarchical graph-based markovian clustering approach for the unsupervised segmentation of textured color images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[25]  Liangliang Cao,et al.  Image Segmentation by MAP-ML Estimations , 2010, IEEE Transactions on Image Processing.

[26]  B. S. Manjunath,et al.  A Variational Framework for Multi-Region Pairwise Similarity-based Image Segmentation , 2007 .

[27]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[28]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Max Mignotte,et al.  MDS-Based Multiresolution Nonlinear Dimensionality Reduction Model for Color Image Segmentation , 2011, IEEE Transactions on Neural Networks.

[30]  Max Mignotte,et al.  A non-stationary MRF model for image segmentation from a soft boundary map , 2012, Pattern Analysis and Applications.

[31]  John Wright,et al.  Segmentation of multivariate mixed data via lossy coding and compression , 2007, Electronic Imaging.

[32]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[34]  Jörg-Stefan Praßni,et al.  A random walker based approach to combining multiple segmentations , 2008, 2008 19th International Conference on Pattern Recognition.

[35]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[36]  Miguel Á. Carreira-Perpiñán,et al.  Fast nonparametric clustering with Gaussian blurring mean-shift , 2006, ICML.

[37]  Ana L. N. Fred,et al.  Data clustering using evidence accumulation , 2002, Object recognition supported by user interaction for service robots.

[38]  Daniel Küttel,et al.  Efficient Combination of Probabilistic Sampling Approximations for Robust Image Segmentation , 2006, DAGM-Symposium.

[39]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[40]  B. S. Manjunath,et al.  A Variational Framework for Multiregion Pairwise-Similarity-Based Image Segmentation , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Ioannis Pitas,et al.  Color Texture Segmentation Based on the Modal Energy of Deformable Surfaces , 2009, IEEE Transactions on Image Processing.

[42]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[43]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Patrick Pérez,et al.  Sonar image segmentation using an unsupervised hierarchical MRF model , 2000, IEEE Trans. Image Process..

[45]  Max Mignotte,et al.  Markovian segmentation and parameter estimation on graphics hardware , 2006, J. Electronic Imaging.

[46]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[48]  Stochastic Relaxation , 2014, Computer Vision, A Reference Guide.

[49]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[50]  Charles D. Creusere,et al.  Unsupervised Bitstream Based Segmentation of Images , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[51]  Horst Bischof,et al.  Saliency driven total variation segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[52]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[53]  Amanda J. C. Sharkey,et al.  Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[54]  Ronen Basri,et al.  Hierarchy and adaptivity in segmenting visual scenes , 2006, Nature.

[55]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[56]  Max Mignotte,et al.  MDS-based segmentation model for the fusion of contour and texture cues in natural images , 2012, Comput. Vis. Image Underst..

[57]  Max Mignotte,et al.  A stochastic method for Bayesian estimation of hidden Markov random field models with application to a color model , 2005, IEEE Transactions on Image Processing.

[58]  Max Mignotte,et al.  Fusion of Hidden Markov Random Field Models and Its Bayesian Estimation , 2006, IEEE Transactions on Image Processing.

[59]  Max Mignotte,et al.  Localization of Shapes Using Statistical Models and Stochastic Optimization , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.