Human-Centered Unsupervised Segmentation Fusion

Segmentation is generally an ill-posed problem since it results in multiple solutions and is, therefore, hard to define ground truth data to evaluate algorithms. The problem can be naively surpassed by using only one annotator per image, but such acquisition doesn't represent the cognitive perception of an image by the majority of people. Nowadays, it is not difficult to obtain multiple segmentations with crowdsourcing, so the only problem that stays is how to get one ground truth segmentation per image. There already exist numerous algorithmic solutions, but most methods are supervised or don't consider confidence per human segmentation. In this paper, we introduce a new segmentation fusion model that is based on K-Modes clustering. Results obtained from publicly available datasets with human ground truth segmentations clearly show that our model outperforms the state-of-the-art on human segmentations.

[1]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zhexue Huang,et al.  CLUSTERING LARGE DATA SETS WITH MIXED NUMERIC AND CATEGORICAL VALUES , 1997 .

[4]  Max Mignotte,et al.  A Novel Fusion Approach Based on the Global Consistency Criterion to Fusing Multiple Segmentations , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Soumya Ghosh,et al.  A general framework for reconciling multiple weak segmentations of an image , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[6]  Deirdre Wilson,et al.  Relevance theory: A tutorial , 2002 .

[7]  Peter Meer,et al.  Image Segmentation from Consensus Information , 1997, Comput. Vis. Image Underst..

[8]  Bo Peng,et al.  Bayesian image segmentation fusion , 2014, Knowl. Based Syst..

[9]  Max Mignotte,et al.  A label field fusion model with a variation of information estimator for image segmentation , 2014, Inf. Fusion.

[10]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Max Mignotte,et al.  A Multi-Objective Decision Making Approach for Solving the Image Segmentation Fusion Problem , 2017, IEEE Transactions on Image Processing.

[12]  Jiye Liang,et al.  A new initialization method for categorical data clustering , 2009, Expert Syst. Appl..

[13]  Max Mignotte,et al.  A Precision-Recall Criterion Based Consensus Model For Fusing Multiple Segmentations , 2014 .

[14]  Jörg-Stefan Praßni,et al.  A random walker based approach to combining multiple segmentations , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Jacob Goldberger,et al.  Ensemble Segmentation Using Efficient Integer Linear Programming , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[17]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[18]  George Lakoff,et al.  Women, Fire, and Dangerous Things , 1987 .

[19]  Max Mignotte,et al.  Segmentation by Fusion of Histogram-Based $K$-Means Clusters in Different Color Spaces , 2008, IEEE Transactions on Image Processing.

[20]  Xiaoyi Jiang,et al.  Image Segmentation Fusion Using General Ensemble Clustering Methods , 2010, ACCV.

[21]  Sébastien Lefèvre,et al.  A Generic Framework for Combining Multiple Segmentations in Geographic Object-Based Image Analysis , 2019, ISPRS Int. J. Geo Inf..

[22]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.