Robust feature matching via advanced neighborhood topology consensus

Abstract Feature matching is one of the key techniques in many vision-based tasks, which aims to establish reliable correspondences between two sets of features. In this paper, we present a new feature matching method, which formulates the matching of two feature sets as a mathematical model based on two common consistency constraints. We first propose an advanced consensus of neighborhood topology, which can better exploit the consensus of topological structures to identify inliers. In order to have reliable neighborhood information for the feature points, a subset with high percentage inliers obtained by a guided matching strategy from the putative matches for the neighborhood construction is used. We demonstrate the advantages of our proposed method on various real image pairs. The results demonstrate that the proposed method is superior to the state-of-the-art feature matching methods.

[1]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[2]  Marcin Wozniak,et al.  Adaptive neuro-heuristic hybrid model for fruit peel defects detection , 2018, Neural Networks.

[3]  Kamil Adamczewski,et al.  Discrete Tabu Search for Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Lifang Wei,et al.  Non-Rigid Point Set Registration via Adaptive Weighted Objective Function , 2018, IEEE Access.

[5]  Zhiguo Cao,et al.  NM-Net: Mining Reliable Neighbors for Robust Feature Correspondences , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Junjun Jiang,et al.  Image Matching from Handcrafted to Deep Features: A Survey , 2020, International Journal of Computer Vision.

[7]  Minh N. Do,et al.  CODE: Coherence Based Decision Boundaries for Feature Correspondence , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Demetri Terzopoulos,et al.  Computer-assisted registration, segmentation, and 3D reconstruction from images of neuronal tissue sections , 1994, IEEE Trans. Medical Imaging.

[10]  Marcin Woźniak,et al.  Soft trees with neural components as image-processing technique for archeological excavations , 2020, Personal and Ubiquitous Computing.

[11]  Riqing Chen,et al.  Non-rigid point set registration via global and local constraints , 2018, Multimedia Tools and Applications.

[12]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Zhanyi Hu,et al.  Rejecting Mismatches by Correspondence Function , 2010, International Journal of Computer Vision.

[14]  Danni Ai,et al.  Local statistical deformation models for deformable image registration , 2018, Neurocomputing.

[15]  Jiri Matas,et al.  Graph-Cut RANSAC , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Quan Z. Sheng,et al.  Nonrigid Point Set Registration With Robust Transformation Learning Under Manifold Regularization , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[18]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[19]  Anders Bjorholm Dahl,et al.  Large-Scale Data for Multiple-View Stereopsis , 2016, International Journal of Computer Vision.

[20]  Yasuyuki Matsushita,et al.  GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Junjun Jiang,et al.  Locality Preserving Matching , 2018, International Journal of Computer Vision.

[22]  Marcin Wozniak,et al.  Bio-inspired methods modeled for respiratory disease detection from medical images , 2018, Swarm Evol. Comput..

[23]  Junjun Jiang,et al.  LMR: Learning a Two-Class Classifier for Mismatch Removal , 2019, IEEE Transactions on Image Processing.

[24]  Christian Theobalt,et al.  A Convex Relaxation for Multi-Graph Matching , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yan Yan,et al.  Superpixel-Guided Two-View Deterministic Geometric Model Fitting , 2018, International Journal of Computer Vision.

[26]  Vincent Lepetit,et al.  Learning to Find Good Correspondences , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[28]  Junjun Jiang,et al.  Robust Feature Matching Using Spatial Clustering With Heavy Outliers , 2020, IEEE Transactions on Image Processing.

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Yang Yang,et al.  Image registration using two-layer cascade reciprocal pipeline and context-aware dissimilarity measure , 2020, Neurocomputing.

[31]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[32]  Thar Baker,et al.  Analysis of Dimensionality Reduction Techniques on Big Data , 2020, IEEE Access.

[33]  Eric Brachmann,et al.  DSAC — Differentiable RANSAC for Camera Localization , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Alan L. Yuille,et al.  A mathematical analysis of the motion coherence theory , 1989, International Journal of Computer Vision.

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.