Guided Locality Preserving Feature Matching for Remote Sensing Image Registration

Feature matching, which refers to establishing reliable correspondences between two sets of feature points, is a critical prerequisite in feature-based image registration. This paper proposes a simple yet surprisingly effective approach, termed as guided locality preserving matching, for robust feature matching of remote sensing images. The key idea of our approach is merely to preserve the neighborhood structures of potential true matches between two images. We formulate it into a mathematical model, and derive a simple closed-form solution with linearithmic time and linear space complexities. This enables our method to accomplish the mismatch removal from thousands of putative correspondences in only a few milliseconds. To handle extremely large proportions of outliers, we further design a guided matching strategy based on the proposed method, using the matching result on a small putative set with a high inlier ratio to guide the matching on a large putative set. This strategy can also significantly boost the true matches without sacrifice in accuracy. Experiments on various real remote sensing image pairs demonstrate the generality of our method for handling both rigid and nonrigid image deformations, and it is more than two orders of magnitude faster than the state-of-the-art methods with better accuracy, making it practical for real-time applications.

[1]  Alan L. Yuille,et al.  Non-Rigid Point Set Registration by Preserving Global and Local Structures , 2016, IEEE Transactions on Image Processing.

[2]  Ji Zhao,et al.  Nonrigid Feature Matching for Remote Sensing Images via Probabilistic Inference With Global and Local Regularizations , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[4]  Gang Wang,et al.  Removing mismatches for retinal image registration via multi-attribute-driven regularized mixture model , 2016, Inf. Sci..

[5]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[7]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[8]  Nathan S. Netanyahu,et al.  An Efficient SIFT-Based Mode-Seeking Algorithm for Sub-Pixel Registration of Remotely Sensed Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[9]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[10]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Vladimir Kolmogorov,et al.  Feature Correspondence Via Graph Matching: Models and Global Optimization , 2008, ECCV.

[12]  Shuicheng Yan,et al.  Common visual pattern discovery via spatially coherent correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Markus Vincze,et al.  Guided Matching Based on Statistical Optical Flow for Fast and Robust Correspondence Analysis , 2016, ECCV.

[14]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[15]  Kamil Adamczewski,et al.  Discrete Tabu Search for Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Zhuowen Tu,et al.  Regularized vector field learning with sparse approximation for mismatch removal , 2013, Pattern Recognit..

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Sim Heng Ong,et al.  A robust global and local mixture distance based non-rigid point set registration , 2015, Pattern Recognit..

[19]  Xiaochun Cao,et al.  Good match exploration using triangle constraint , 2012, Pattern Recognit. Lett..

[20]  Lei Wang,et al.  Progressive Mode-Seeking on Graphs for Sparse Feature Matching , 2014, ECCV.

[21]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Taejung Kim,et al.  Automatic satellite image registration by combination of matching and random sample consensus , 2003, IEEE Trans. Geosci. Remote. Sens..

[23]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[24]  Nathan S. Netanyahu,et al.  Survey of image registration methods , 2011, Image Registration for Remote Sensing.

[25]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[26]  Junjun Jiang,et al.  Locality Preserving Matching , 2017, IJCAI.

[27]  Zhanyi Hu,et al.  Rejecting Mismatches by Correspondence Function , 2010, International Journal of Computer Vision.

[28]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[29]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[30]  Minsu Cho,et al.  Progressive graph matching: Making a move of graphs via probabilistic voting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  David S. Doermann,et al.  Robust point matching for nonrigid shapes by preserving local neighborhood structures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yansheng Li,et al.  Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration , 2017, Inf. Sci..

[33]  Alfred Stein,et al.  A WTLS-Based Method for Remote Sensing Imagery Registration , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Yong Ma,et al.  Image Feature Matching via Progressive Vector Field Consensus , 2015, IEEE Signal Processing Letters.

[35]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[37]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[39]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[40]  Qingwu Hu,et al.  Robust Feature Matching for Remote Sensing Image Registration Based on $L_{q}$ -Estimator , 2016, IEEE Geoscience and Remote Sensing Letters.

[41]  Jacqueline Le Moigne,et al.  An automated parallel image registration technique based on the correlation of wavelet features , 2013, IEEE Trans. Geosci. Remote. Sens..

[42]  Gang Wang,et al.  A robust non-rigid point set registration method based on asymmetric gaussian representation , 2015, Comput. Vis. Image Underst..

[43]  Michael Werman,et al.  A Linear Time Histogram Metric for Improved SIFT Matching , 2008, ECCV.

[44]  Wei Liu,et al.  SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework , 2015, IEEE Transactions on Image Processing.

[45]  Guoyou Wang,et al.  Robust Scale-Invariant Feature Matching for Remote Sensing Image Registration , 2009, IEEE Geoscience and Remote Sensing Letters.

[46]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[47]  Sim Heng Ong,et al.  Remote Sensing Image Registration Using Multiple Image Features , 2017, Remote. Sens..

[48]  James S. Duncan,et al.  Rigid point feature registration using mutual information , 1999, Medical Image Anal..

[49]  Sim Heng Ong,et al.  A Small UAV Based Multi-Temporal Image Registration for Dynamic Agricultural Terrace Monitoring , 2017, Remote. Sens..

[50]  Radu Horaud,et al.  Rigid and Articulated Point Registration with Expectation Conditional Maximization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Bing-Yu Chen,et al.  Matching Images With Multiple Descriptors: An Unsupervised Approach for Locally Adaptive Descriptor Selection , 2015, IEEE Transactions on Image Processing.

[52]  Ralph R. Martin,et al.  Regularization Based Iterative Point Match Weighting for Accurate Rigid Transformation Estimation , 2015, IEEE Transactions on Visualization and Computer Graphics.

[53]  Minsu Cho,et al.  Mode-seeking on graphs via random walks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[55]  Lei Peng,et al.  Learning coherent vector fields for robust point matching under manifold regularization , 2016, Neurocomputing.

[56]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[57]  Ming Zhao,et al.  Bi-SOGC: A Graph Matching Approach Based on Bilateral KNN Spatial Orders Around Geometric Centers for Remote Sensing Image Registration , 2013, IEEE Geoscience and Remote Sensing Letters.