Point correspondence by a new third order graph matching algorithm

The correspondence between point sets is a fundamental problem in pattern recognition, which is often formulated and solved by graph matching. In this paper, we propose to solve the correspondence problem by a new third order graph matching algorithm. Compared with some previous hyper-graph matching algorithms, the proposed one achieves considerable memory reduction and is applicable to both undirected and directed graphs. Specifically, the correspondence is formulated by the matching between adjacency tensors encoding the third order structural information of each graph, which is then transformed to be a tractable matrix form. Two types of gradient based optimization methods, the graduated nonconvexity and concavity procedure (GNCCP) and graduated assignment (GA) algorithm, are generalized to solve the problem. Comparative experiments with state-of-the-art algorithms on both synthetic and real data witness the effectiveness of the proposed method. HighlightsAn adjacency tensor based third order graph matching algorithm is proposed.It enjoys a much lower storage complexity than affinity tensor based high order algorithms.Instead of spectral decomposition based optimization, it adopts gradient based optimization.Experiments on synthetic and real-world data witness its state-of-the-art performance.

[1]  Cristian Sminchisescu,et al.  Semi-supervised learning and optimization for hypergraph matching , 2011, 2011 International Conference on Computer Vision.

[2]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[3]  Zhiyong Liu,et al.  GNCCP—Graduated NonConvexity and Concavity Procedure , 2014 .

[4]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hong Qiao,et al.  Feature correspondence based on directed structural model matching , 2015, Image Vis. Comput..

[7]  Stefan Carlsson,et al.  Recognizing and Tracking Human Action , 2002, ECCV.

[8]  Horst Bunke,et al.  Error Correcting Graph Matching: On the Influence of the Underlying Cost Function , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Fei Yin,et al.  CASIA Online and Offline Chinese Handwriting Databases , 2011, 2011 International Conference on Document Analysis and Recognition.

[10]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.

[11]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[12]  Hong Qiao,et al.  GNCCP—Graduated NonConvexityand Concavity Procedure , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yu Tian,et al.  On the Convergence of Graph Matching: Graduated Assignment Revisited , 2012, ECCV.

[14]  M. Zaslavskiy,et al.  A Path Following Algorithm for the Graph Matching Problem , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Francesc Serratosa,et al.  Fast computation of Bipartite graph matching , 2014, Pattern Recognit. Lett..

[16]  Kaspar Riesen,et al.  Approximate graph edit distance computation by means of bipartite graph matching , 2009, Image Vis. Comput..

[17]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  Martial Hebert,et al.  Fast and Scalable Approximate Spectral Matching for Higher Order Graph Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Fernando De la Torre,et al.  Deformable Graph Matching , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Martial Hebert,et al.  Efficient MAP approximation for dense energy functions , 2006, ICML.

[21]  Horst Bunke,et al.  Inexact graph matching for structural pattern recognition , 1983, Pattern Recognit. Lett..

[22]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Fernando De la Torre,et al.  Factorized Graph Matching , 2016, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[25]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[26]  Yosi Keller,et al.  A Probabilistic Approach to Spectral Graph Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.

[28]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[29]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Yosi Keller,et al.  Efficient High Order Matching , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Richard Sinkhorn A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices , 1964 .

[32]  Jianbo Shi,et al.  Solving Markov Random Fields with Spectral Relaxation , 2007, AISTATS.

[33]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[34]  H. Kiers Towards a standardized notation and terminology in multiway analysis , 2000 .

[35]  Hong Qiao,et al.  An Extended Path Following Algorithm for Graph-Matching Problem , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Minsu Cho,et al.  Hyper-graph matching via reweighted random walks , 2011, CVPR 2011.

[37]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[38]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Martial Hebert,et al.  Unsupervised Learning for Graph Matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.