Dual Calibration Mechanism Based L2, p-Norm for Graph Matching

Unbalanced geometric structure caused by variations with deformations, rotations and outliers is a critical issue that hinders correspondence establishment between image pairs in existing graph matching methods. To deal with this problem, in this work, we propose a dual calibration mechanism (DCM) for establishing feature points correspondence in graph matching. In specific, we embed two types of calibration modules in the graph matching, which model the correspondence relationship in point and edge respectively. The point calibration module performs unary alignment over points and the edge calibration module performs local structure alignment over edges. By performing the dual calibration, the feature points correspondence between two images with deformations and rotations variations can be obtained. To enhance the robustness of correspondence establishment, the <inline-formula> <tex-math notation="LaTeX">$L_{2,p}$ </tex-math></inline-formula>-norm is employed as the similarity metric in the proposed model, which is a flexible metric due to setting the different <inline-formula> <tex-math notation="LaTeX">$p$ </tex-math></inline-formula> values. Finally, we incorporate the dual calibration and <inline-formula> <tex-math notation="LaTeX">$L_{2,p}$ </tex-math></inline-formula>-norm based similarity metric into the graph matching model which can be optimized by an effective algorithm, and theoretically prove the convergence of the presented algorithm. Experimental results in the variety of graph matching tasks such as deformations, rotations and outliers evidence the competitive performance of the presented DCM model over the state-of-the-art approaches.

[1]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Hong Yan,et al.  Joint Transformation Learning via the L2,1-Norm Metric for Robust Graph Matching , 2019, IEEE Transactions on Cybernetics.

[3]  Abdel Nasser,et al.  A Survey of the Quadratic Assignment Problem , 2014 .

[4]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[5]  Kuk-Jin Yoon,et al.  Multi-attributed Graph Matching with Multi-layer Random Walks , 2016, ECCV.

[6]  Fernando De la Torre,et al.  Deformable Graph Matching , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Tamara G. Kolda,et al.  Triangular Alignment (TAME): A Tensor-Based Approach for Higher-Order Network Alignment , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[8]  Fernando De la Torre,et al.  Factorized Graph Matching , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yue Gao,et al.  Hyper-Clique Graph Matching and Applications , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Gui-Song Xia,et al.  Adaptively Transforming Graph Matching , 2018, ECCV.

[13]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Nikos Paragios,et al.  Alternating Direction Graph Matching , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Minsu Cho,et al.  A Graph Matching Algorithm Using Data-Driven Markov Chain Monte Carlo Sampling , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Yosi Keller,et al.  A Probabilistic Approach to Spectral Graph Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Kamil Adamczewski,et al.  Discrete Tabu Search for Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Hong Yan,et al.  Image Correspondence With CUR Decomposition-Based Graph Completion and Matching , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[21]  Eric Bonabeau,et al.  Graph multidimensional scaling with self-organizing maps , 2002, Inf. Sci..

[22]  Jean Ponce,et al.  A graph-matching kernel for object categorization , 2011, 2011 International Conference on Computer Vision.

[23]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[24]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Leonidas J. Guibas,et al.  An optimization approach for extracting and encoding consistent maps in a shape collection , 2012, ACM Trans. Graph..

[26]  Nikos Paragios,et al.  Dense non-rigid surface registration using high-order graph matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Pascal Fua,et al.  Geometric Graph Matching Using Monte Carlo Tree Search , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Wei Liu,et al.  Discrete hyper-graph matching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Nuno Vasconcelos,et al.  Robust Deformable and Occluded Object Tracking With Dynamic Graph , 2014, IEEE Transactions on Image Processing.

[30]  Wenmin Wang,et al.  Second- and High-Order Graph Matching for Correspondence Problems , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  D. T. Lee,et al.  Two algorithms for constructing a Delaunay triangulation , 1980, International Journal of Computer & Information Sciences.

[32]  Yang Liu,et al.  Robust dense correspondence using deep convolutional features , 2019, The Visual Computer.

[33]  Massimo Piccardi,et al.  Discriminative prototype selection methods for graph embedding , 2013, Pattern Recognit..

[34]  Jianmin Jiang,et al.  A spectral-multiplicity-tolerant approach to robust graph matching , 2013, Pattern Recognit..

[35]  Yang Yu,et al.  A Novel Dual-Lidar Calibration Algorithm Using Planar Surfaces , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[36]  Minsu Cho,et al.  Reweighted Random Walks for Graph Matching , 2010, ECCV.

[37]  Byung-Gyu Kim,et al.  A local stereo matching algorithm based on weighted guided image filtering for improving the generation of depth range images , 2017, Displays.

[38]  Panos M. Pardalos,et al.  Quadratic Assignment Problem , 1997, Encyclopedia of Optimization.

[39]  Minsu Cho,et al.  Graph Matching via Sequential Monte Carlo , 2012, ECCV.

[40]  Salvatore Tabbone,et al.  Graph Embedding Using Constant Shift Embedding , 2010, ICPR Contests.

[41]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Edwin R. Hancock,et al.  A generative model for graph matching and embedding , 2009, Comput. Vis. Image Underst..

[43]  Yanning Zhang,et al.  Tensor Power Iteration for Multi-graph Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Feiping Nie,et al.  $\ell _{2,p}$ -Norm Based PCA for Image Recognition , 2018, IEEE Transactions on Image Processing.

[45]  Qingyu Zhao,et al.  Geometric-Feature-Based Spectral Graph Matching in Pharyngeal Surface Registration , 2014, MICCAI.

[46]  Feiping Nie,et al.  A New Formulation of Linear Discriminant Analysis for Robust Dimensionality Reduction , 2019, IEEE Transactions on Knowledge and Data Engineering.

[47]  Edwin R. Hancock,et al.  Structural Graph Matching Using the EM Algorithm and Singular Value Decomposition , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Haibin Ling,et al.  Gracker: A Graph-Based Planar Object Tracker , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Feipeng Da,et al.  A novel dual-camera calibration method for 3D optical measurement , 2017 .

[50]  Yuan F. Zheng,et al.  A Structured Learning-Based Graph Matching Method for Tracking Dynamic Multiple Objects , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[51]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[52]  Martial Hebert,et al.  An Integer Projected Fixed Point Method for Graph Matching and MAP Inference , 2009, NIPS.

[53]  Xiaochun Cao,et al.  Lagrangian relaxation graph matching , 2017, Pattern Recognit..

[54]  Jean-Yves Ramel,et al.  Fuzzy multilevel graph embedding , 2013, Pattern Recognit..

[55]  Yang Liu,et al.  Deep feature matching for dense correspondence , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[56]  Hong Yan,et al.  Elastic Net Constraint-Based Tensor Model for High-Order Graph Matching. , 2019, IEEE transactions on cybernetics.

[57]  Hongyuan Zha,et al.  Multi-Graph Matching via Affinity Optimization with Graduated Consistency Regularization , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Junchi Yan,et al.  Adaptive Discrete Hypergraph Matching , 2018, IEEE Transactions on Cybernetics.

[59]  Yann LeCun,et al.  Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches , 2015, J. Mach. Learn. Res..

[60]  Jean Ponce,et al.  Learning Graphs to Match , 2013, 2013 IEEE International Conference on Computer Vision.

[61]  Bo Jiang,et al.  Graph matching based on spectral embedding with missing value , 2012, Pattern Recognit..

[62]  Shuang Wu,et al.  Graph Correspondence Transfer for Person Re-identification , 2018, AAAI.

[63]  Byung-Gyu Kim,et al.  Efficient Depth Map Estimation Method Based on Gradient Weight Cost Aggregation Strategy for Distributed Video Sensor Networks , 2013, 2013 Visual Communications and Image Processing (VCIP).