UGC: Real-Time, Ultra-Robust Feature Correspondence via Unilateral Grid-Based Clustering

Quickly establishing reliable correspondence between two feature sets is a challenging task for feature matching. However, the key to successful feature matching is not only matching robustness but also the precision and real-time performance. It is difficult to achieve both efficiency and efficacy using the current algorithms. In this paper, we propose unilateral grid-based clustering (UGC), which creates a unilateral grid of an image’s features and meanshift clustering constraints of the other image correspondence features. UGC removes a large number of mismatches using clustering center statistical analysis of the match feature points in a grid region. For low texture, blur and wide-baselines feature matching of images, UGC provides a real-time, ultra-robust correspondence system. Extensive experiments on image data sets demonstrate the higher precision and real-time performance of UGC, which outperforms current state-of-the-art methods, including conditions such as low contrast and high exposure.

[1]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[3]  Zhuowen Tu,et al.  Learning Context-Sensitive Shape Similarity by Graph Transduction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jianbo Shi,et al.  Image Matching via Saliency Region Correspondences , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Yansheng Li,et al.  Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration , 2017, Inf. Sci..

[8]  Ji Zhao,et al.  Non-rigid visible and infrared face registration via regularized Gaussian fields criterion , 2015, Pattern Recognit..

[9]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[10]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[11]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[12]  Nanning Zheng,et al.  Exploiting local linear geometric structure for identifying correct matches , 2014, Comput. Vis. Image Underst..

[13]  Yonghuai Liu,et al.  Improving ICP with easy implementation for free-form surface matching , 2004, Pattern Recognit..

[14]  Tat-Jun Chin,et al.  Accelerated Hypothesis Generation for Multistructure Data via Preference Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[16]  Miguel Á. Carreira-Perpiñán,et al.  Non-rigid point set registration: Coherent Point Drift , 2006, NIPS.

[17]  Pheng-Ann Heng,et al.  Shape Modeling Using Automatic Landmarking , 2005, MICCAI.

[18]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[19]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  R. Karthik,et al.  Image Stitching with Combined Moment Invariants and Sift Features , 2013, ANT/SEIT.

[21]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ilan Shimshoni,et al.  Epipolar Geometry Estimation for Urban Scenes with Repetitive Structures , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[26]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.

[27]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[28]  Minh N. Do,et al.  Bilateral Functions for Global Motion Modeling , 2014, ECCV.

[29]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[30]  Torsten Sattler,et al.  SCRAMSAC: Improving RANSAC's efficiency with a spatial consistency filter , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Ye Zhao,et al.  Image matching by fast random sample consensus , 2013, ICIMCS '13.

[32]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[34]  Vincent Lepetit,et al.  LIFT: Learned Invariant Feature Transform , 2016, ECCV.

[35]  Junjun Jiang,et al.  Locality Preserving Matching , 2018, International Journal of Computer Vision.

[36]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[37]  Liao Li Integrated Point Cloud Storage Structure Based on Octree and KDTree , 2012 .

[38]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Sung-Bong Yang,et al.  gkDtree: A group-based parallel update kd-tree for interactive ray tracing , 2013, J. Syst. Archit..

[40]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[41]  Yasuyuki Matsushita,et al.  GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.