A Novel Use of Higher Order Information to Detect Inliers of an Implicit Model

The problem we address in this paper is to label datapoints when the information about them is provided primarily in terms of their subsets or groups. The knowledge we have for a group is a likelihood value for each group member to belong to same class. These likelihood values are computed using a model, either explicit or implicit, of the pattern we wish to learn. By defining a Markov Random Field (MRF) over the labels of data, we formulate the problem as an MRF inference problem. A submodular function is defined as clique potential function for this MRF. We identified a special form of this clique potential function that results in a simple and efficient inference method with linear running time with respect to the number of datapoints and subsets. The formulation allows augmentation of energy functions for data with several different size subsets. We present experimental results in applications where the proposed method produces improved performances over other methods.

[1]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jitendra Malik,et al.  Geometric blur for template matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Tomás Werner,et al.  A Linear Programming Approach to Max-Sum Problem: A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Pushmeet Kohli,et al.  P3 & Beyond: Solving Energies with Higher Order Cliques , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Philip H. S. Torr,et al.  Solving Energies with Higher Order Cliques , 2007 .

[6]  Daniel Freedman,et al.  Energy minimization via graph cuts: settling what is possible , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Martin C. Cooper Minimization of Locally Defined Submodular Functions by Optimal Soft Arc Consistency , 2007, Constraints.

[8]  Vipin Kumar,et al.  Multilevel k-way hypergraph partitioning , 1999, DAC '99.

[9]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Bernhard Schölkopf,et al.  Beyond pairwise classification and clustering using hypergraphs , 2005, NIPS 2005.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[13]  Venu Madhav Govindu,et al.  A tensor decomposition for geometric grouping and segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Satoru Iwata,et al.  A combinatorial strongly polynomial algorithm for minimizing submodular functions , 2001, JACM.

[15]  Hiroshi Ishikawa,et al.  Higher-order clique reduction in binary graph cut , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Pietro Perona,et al.  Beyond pairwise clustering , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  藤重 悟 Submodular functions and optimization , 1991 .

[18]  László Lovász,et al.  Submodular functions and convexity , 1982, ISMP.

[19]  M. Shlezinger Syntactic analysis of two-dimensional visual signals in the presence of noise , 1976 .

[20]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[21]  Stanislav Živný Which submodular functions are expressible using binary submodular functions , 2008 .

[22]  Tamir Hazan,et al.  Multi-way Clustering Using Super-Symmetric Non-negative Tensor Factorization , 2006, ECCV.

[23]  Peter Jeavons Which submodular functions are expressible using binary submodular functions , 2008 .

[24]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.