Scalable Multi-Consistency Feature Matching with Non-Cooperative Games

Correspondence selection aiming at seeking correct relationships between two images is a fundamental and critical task in computer vision. This paper attempts to select consistent correspondences in the context of dynamic scenarios where multiple matching consistencies are normally incorporated. To this end, we present a grid-based game-theoretic matching (Grid-GTM) method which is divided into three processes, i.e., grid matching, local games and enrichment. Specifically, grid matching translates the multi-consistency problem into several independent single-consistency problems to decrease difficulties of selection and boost the efficiency. Local games extended under the guidance of a novel payoff function guarantee that mismatches are effectively removed. Enrichment is added to recover correct matches neglected by local games. Crucially, our approach achieves the state-of-the-art performance compared with seven algorithms in comprehensive evaluations. In addition, we construct a dataset that involves multiple consistencies under three different scenes in this paper.

[1]  Minsu Cho,et al.  Co-recognition of Image Pairs by Data-Driven Monte Carlo Image Exploration , 2008, ECCV.

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  Junjun Jiang,et al.  Locality Preserving Matching , 2018, International Journal of Computer Vision.

[4]  Bing-Yu Chen,et al.  Co-Segmentation Guided Hough Transform for Robust Feature Matching , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  Tat-Jun Chin,et al.  Accelerated Hypothesis Generation for Multi-structure Robust Fitting , 2010, ECCV.

[8]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[9]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Andrea Torsello,et al.  Imposing Semi-Local Geometric Constraints for Accurate Correspondences Selection in Structure from Motion: A Game-Theoretic Perspective , 2011, International Journal of Computer Vision.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Yasuo Kuniyoshi,et al.  Elastic Net Constraints for Shape Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Yasuyuki Matsushita,et al.  GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[15]  Tat-Jun Chin,et al.  Dynamic and hierarchical multi-structure geometric model fitting , 2011, 2011 International Conference on Computer Vision.

[16]  Jan-Michael Frahm,et al.  USAC: A Universal Framework for Random Sample Consensus , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Selim Benhimane,et al.  Real-time image-based tracking of planes using efficient second-order minimization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[19]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[20]  Andrea Fusiello,et al.  Robust Multiple Model Fitting with Preference Analysis and Low-rank Approximation , 2015, BMVC.