Joint Transformation Learning via the L2,1-Norm Metric for Robust Graph Matching

Establishing correspondence between two given geometrical graph structures is an important problem in computer vision and pattern recognition. In this paper, we propose a robust graph matching (RGM) model to improve the effectiveness and robustness on the matching graphs with deformations, rotations, outliers, and noise. First, we embed the joint geometric transformation into the graph matching model, which performs unary matching over graph nodes and local structure matching over graph edges simultaneously. Then, the $L_{2,1}$ -norm is used as the similarity metric in the presented RGM to enhance the robustness. Finally, we derive an objective function which can be solved by an effective optimization algorithm, and theoretically prove the convergence of the proposed algorithm. Extensive experiments on various graph matching tasks, such as outliers, rotations, and deformations show that the proposed RGM model achieves competitive performance compared to the existing methods.

[1]  Kamil Adamczewski,et al.  Discrete Tabu Search for Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[3]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[4]  Pascal Fua,et al.  Geometric Graph Matching Using Monte Carlo Tree Search , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Chen Gong,et al.  Exploring Commonality and Individuality for Multi-Modal Curriculum Learning , 2017, AAAI.

[6]  Nuno Vasconcelos,et al.  Robust Deformable and Occluded Object Tracking With Dynamic Graph , 2014, IEEE Transactions on Image Processing.

[7]  Jian Yang,et al.  Learning with Inadequate and Incorrect Supervision , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[8]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[9]  Kuk-Jin Yoon,et al.  Multi-Attributed Graph Matching With Multi-Layer Graph Structure and Multi-Layer Random Walks , 2018, IEEE Transactions on Image Processing.

[10]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[11]  Martial Hebert,et al.  An Integer Projected Fixed Point Method for Graph Matching and MAP Inference , 2009, NIPS.

[12]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nicu Sebe,et al.  Discriminating Joint Feature Analysis for Multimedia Data Understanding , 2012, IEEE Transactions on Multimedia.

[14]  Martial Hebert,et al.  Fast and scalable approximate spectral graph matching for correspondence problems , 2013, Inf. Sci..

[15]  Nikos Paragios,et al.  Alternating Direction Graph Matching , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Hong Yan,et al.  A quadratic penalty method for hypergraph matching , 2017, Journal of Global Optimization.

[17]  Fernando De la Torre,et al.  Deformable Graph Matching , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Fernando De la Torre,et al.  Factorized Graph Matching , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Quynh N. Nguyen,et al.  An Efficient Multilinear Optimization Framework for Hypergraph Matching , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Kuk-Jin Yoon,et al.  Multi-attributed Graph Matching with Multi-layer Random Walks , 2016, ECCV.

[22]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[23]  Zi Huang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence ℓ2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning , 2022 .

[24]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Matthew L. Baker,et al.  Shape modeling and matching in identifying 3D protein structures , 2008, Comput. Aided Des..

[26]  Zhao Zhang,et al.  Trace Ratio Criterion based Discriminative Feature Selection via l2, p-norm regularization for supervised learning , 2018, Neurocomputing.

[27]  Christoph Schnörr,et al.  Probabilistic Subgraph Matching Based on Convex Relaxation , 2005, EMMCVPR.

[28]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[29]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Shuang Wu,et al.  Graph Correspondence Transfer for Person Re-identification , 2018, AAAI.

[31]  Abdel Nasser,et al.  A Survey of the Quadratic Assignment Problem , 2014 .

[32]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[33]  Shuicheng Yan,et al.  Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[34]  Sing-Hoi Sze,et al.  Path Matching and Graph Matching in Biological Networks , 2007, J. Comput. Biol..

[35]  Xiaowei Zhou,et al.  Multi-image Matching via Fast Alternating Minimization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[36]  Ralph R. Martin,et al.  SuperMatching: Feature Matching Using Supersymmetric Geometric Constraints , 2013, IEEE Transactions on Visualization and Computer Graphics.

[37]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.

[38]  Barend J. van Wyk,et al.  A POCS-Based Graph Matching Algorithm , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Congyan Lang,et al.  Graph Matching with Adaptive and Branching Path Following , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Nicu Sebe,et al.  Multimedia Event Detection Using A Classifier-Specific Intermediate Representation , 2013, IEEE Transactions on Multimedia.

[42]  Hasan M. Jamil,et al.  Top-k Similar Graph Matching Using TraM in Biological Networks , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[43]  Steven C. H. Hoi,et al.  Graph Matching by Simplified Convex-Concave Relaxation Procedure , 2014, International Journal of Computer Vision.

[44]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[45]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Kuk-Jin Yoon,et al.  Exploiting Multi-layer Graph Factorization for Multi-attributed Graph Matching , 2019, Pattern Recognit. Lett..

[47]  Hongyuan Zha,et al.  A Matrix Decomposition Perspective to Multiple Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[48]  Panos M. Pardalos,et al.  Quadratic Assignment Problem , 1997, Encyclopedia of Optimization.

[49]  M. Zaslavskiy,et al.  A Path Following Algorithm for the Graph Matching Problem , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Hongyuan Zha,et al.  Multi-Graph Matching via Affinity Optimization with Graduated Consistency Regularization , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Xuelong Li,et al.  Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection , 2014, IEEE Transactions on Cybernetics.

[52]  Junchi Yan,et al.  Adaptive Discrete Hypergraph Matching , 2018, IEEE Transactions on Cybernetics.

[53]  Jean Ponce,et al.  Learning Graphs to Match , 2013, 2013 IEEE International Conference on Computer Vision.

[54]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[55]  In-So Kweon,et al.  Graph-based robust shape matching for robotic application , 2009, 2009 IEEE International Conference on Robotics and Automation.