Graph Matching: Relax at Your Own Risk

Graph matching-aligning a pair of graphs to minimize their edge disagreements-has received wide-spread attention from both theoretical and applied communities over the past several decades, including combinatorics, computer vision, and connectomics. Its attention can be partially attributed to its computational difficulty. Although many heuristics have previously been proposed in the literature to approximately solve graph matching, very few have any theoretical support for their performance. A common technique is to relax the discrete problem to a continuous problem, therefore enabling practitioners to bring gradient-descent-type algorithms to bear. We prove that an indefinite relaxation (when solved exactly) almost always discovers the optimal permutation, while a common convex relaxation almost always fails to discover the optimal permutation. These theoretical results suggest that initializing the indefinite algorithm with the convex optimum might yield improved practical performance. Indeed, experimental results illuminate and corroborate these theoretical findings, demonstrating that excellent results are achieved in both benchmark and real data problems by amalgamating the two approaches.

[1]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[2]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[3]  John E. Hopcroft,et al.  Linear time algorithm for isomorphism of planar graphs (Preliminary Report) , 1974, STOC '74.

[4]  Julian R. Ullmann,et al.  An Algorithm for Subgraph Isomorphism , 1976, J. ACM.

[5]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[6]  Godwin C Ovuworie Nonlinear Programming — Theory and Algorithms , 1979 .

[7]  Eugene M. Luks,et al.  Isomorphism of graphs of bounded valence can be tested in polynomial time , 1980, 21st Annual Symposium on Foundations of Computer Science (sfcs 1980).

[8]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[9]  Béla Bollobás,et al.  Random Graphs , 1985 .

[10]  Donald Goldfarb,et al.  An O(n3L) primal interior point algorithm for convex quadratic programming , 1991, Math. Program..

[11]  Jeong Han Kim,et al.  Nearly perfect matchings in regular simple hypergraphs , 1997 .

[12]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockmodels for Graphs with Latent Block Structure , 1997 .

[13]  Franz Rendl,et al.  QAPLIB – A Quadratic Assignment Problem Library , 1997, J. Glob. Optim..

[14]  Benoit Huet,et al.  Graph Matching for Shape Retrieval , 1998, NIPS.

[15]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[16]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[17]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[18]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[19]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Benny Sudakov,et al.  On the asymmetry of random regular graphs and random graphs , 2002, Random Struct. Algorithms.

[21]  Mario Vento,et al.  A (sub)graph isomorphism algorithm for matching large graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Terry Caelli,et al.  An eigenspace projection clustering method for inexact graph matching , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[25]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Andrea Torsello,et al.  Polynomial-time metrics for attributed trees , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[28]  Fan Chung Graham,et al.  Concentration Inequalities and Martingale Inequalities: A Survey , 2006, Internet Math..

[29]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[30]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[31]  M. Zaslavskiy,et al.  A Path Following Algorithm for the Graph Matching Problem , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Edwin R. Hancock,et al.  A generative model for graph matching and embedding , 2009, Comput. Vis. Image Underst..

[33]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[34]  Eric T. Harley,et al.  Fast Approximate Quadratic Programming for Large (Brain) Graph Matching , 2011 .

[35]  Vera Koponen,et al.  Random graphs with bounded maximum degree: asymptotic structure and a logical limit law , 2012, Discret. Math. Theor. Comput. Sci..

[36]  Minsu Cho,et al.  Progressive graph matching: Making a move of graphs via probabilistic voting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Kaspar Riesen,et al.  Suboptimal Graph Isomorphism using bipartite Matching , 2012, Int. J. Pattern Recognit. Artif. Intell..

[38]  Albert Atserias,et al.  Sherali-Adams relaxations and indistinguishability in counting logics , 2012, ITCS '12.

[39]  Jerry L Prince,et al.  Magnetic Resonance Connectome Automated Pipeline: An Overview , 2012, IEEE Pulse.

[40]  Guillermo Sapiro,et al.  Robust Multimodal Graph Matching: Sparse Coding Meets Graph Matching , 2013, NIPS.

[41]  Alexander M. Bronstein,et al.  Graph matching: relax or not? , 2014, ArXiv.

[42]  Carey E. Priebe,et al.  Seeded graph matching for correlated Erdös-Rényi graphs , 2014, J. Mach. Learn. Res..

[43]  Ryan O'Donnell,et al.  Hardness of robust graph isomorphism, Lasserre gaps, and asymmetry of random graphs , 2014, SODA.

[44]  Guillermo Sapiro,et al.  On spectral properties for graph matching and graph isomorphism problems , 2014, ArXiv.

[45]  Li Chen,et al.  Spectral clustering for divide-and-conquer graph matching , 2013, Parallel Comput..

[46]  Y. Aflalo,et al.  On convex relaxation of graph isomorphism , 2015, Proceedings of the National Academy of Sciences.

[47]  Carey E. Priebe,et al.  Fast Approximate Quadratic Programming for Graph Matching , 2015, PloS one.

[48]  Fernando De la Torre,et al.  Factorized Graph Matching , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.