Joint Optimization for Consistent Multiple Graph Matching

The problem of graph matching in general is NP-hard and approaches have been proposed for its sub optimal solution, most focusing on finding the one-to-one node mapping between two graphs. A more general and challenging problem arises when one aims to find consistent mappings across a number of graphs more than two. Conventional graph pair matching methods often result in mapping inconsistency since the mapping between two graphs can either be determined by pair mapping or by an additional anchor graph. To address this issue, a novel formulation is derived which is maximized via alternating optimization. Our method enjoys several advantages: 1) the mappings are jointly optimized rather than sequentially performed by applying pair matching, allowing the global affinity information across graphs can be propagated and explored, 2) the number of concerned variables to optimize is in linear with the number of graphs, being superior to local pair matching resulting in O(n2) variables, 3) the mapping consistency constraints are analytically satisfied during optimization, and 4) off-the-shelf graph pair matching solvers can be reused under the proposed framework in an `out-of-the-box' fashion. Competitive results on both the synthesized data and the real data are reported, by varying the level of deformation, outliers and edge densities.

[1]  Francesc Serratosa,et al.  A Structural and Semantic Probabilistic Model for Matching and Representing a Set of Graphs , 2009, GbRPR.

[2]  Miguel Cazorla,et al.  Constellations and the Unsupervised Learning of Graphs , 2007, GbRPR.

[3]  Francesc Serratosa,et al.  Models and algorithms for computing the common labelling of a set of attributed graphs , 2011, Comput. Vis. Image Underst..

[4]  Martial Hebert,et al.  An Integer Projected Fixed Point Method for Graph Matching and MAP Inference , 2009, NIPS.

[5]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Martial Hebert,et al.  Unsupervised Learning for Graph Matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Yosi Keller,et al.  A Probabilistic Approach to Spectral Graph Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Andrew K. C. Wong,et al.  Entropy and Distance of Random Graphs with Application to Structural Pattern Recognition , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Vladimir Kolmogorov,et al.  Feature Correspondence Via Graph Matching: Models and Global Optimization , 2008, ECCV.

[10]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Alberto Sanfeliu,et al.  Function-described graphs for modelling objects represented by sets of attributed graphs , 2003, Pattern Recognit..

[12]  Yu Tian,et al.  On the Convergence of Graph Matching: Graduated Assignment Revisited , 2012, ECCV.

[13]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[14]  Barend J. van Wyk,et al.  A POCS-Based Graph Matching Algorithm , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Alberto Sanfeliu,et al.  Second-Order Random Graphs For Modeling Sets Of Attributed Graphs And Their Application To Object Learning And Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[16]  Lei Zhang,et al.  Robust Point Matching Revisited: A Concave Optimization Approach , 2012, ECCV.

[17]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[18]  João Paulo Costeira,et al.  A Global Solution to Sparse Correspondence Problems , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jean Ponce,et al.  A tensor-based algorithm for high-order graph matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Edwin R. Hancock,et al.  Multiple graph matching with Bayesian inference , 1997, Pattern Recognit. Lett..

[21]  Minsu Cho,et al.  Hyper-graph matching via reweighted random walks , 2011, CVPR 2011.

[22]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Francesc Serratosa,et al.  On the Computation of the Common Labelling of a Set of Attributed Graphs , 2009, CIARP.

[24]  Cristian Sminchisescu,et al.  Semi-supervised learning and optimization for hypergraph matching , 2011, 2011 International Conference on Computer Vision.

[25]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.