Robust feature matching for geospatial images via an affine‐invariant coordinate system

Feature matching is a crucial stage for many photogrammetric and remote sensing applications. This paper proposes a novel and robust feature‐matching method based on a normalised barycentric coordinate system (NBCS), which is superior to a Cartesian system for this task. A scale‐invariant feature transform (SIFT) is performed to provide initial matches containing both correct matches (inliers) and false matches (outliers), with a focus on model estimation from contaminated observations (matches with outliers). An affine‐invariant coordinate system called NBCS is defined based on ratios of areas. The two feature points of a correct match have the same coordinates under NBCS while false correspondences do not. This principle is adapted into a hypothesise‐and‐verify framework. The proposed method is robust, efficient and effective. Extensive experiments on real geospatial image pairs show that it significantly outperforms six other state‐of‐the‐art approaches. The source code and datasets used in this paper have been made public.

[1]  Maoguo Gong,et al.  Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Qingwu Hu,et al.  Robust Feature Matching for Remote Sensing Image Registration Based on $L_{q}$ -Estimator , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[5]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Z. Du,et al.  Reliable Spatial Relationship Constrained Feature Point Matching of Oblique Aerial Images , 2015 .

[7]  Jean Ponce,et al.  Finding Matches in a Haystack: A Max-Pooling Strategy for Graph Matching in the Presence of Outliers , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[9]  Kai Zhang,et al.  A Robust Point-Matching Algorithm for Remote Sensing Image Registration , 2014, IEEE Geoscience and Remote Sensing Letters.

[10]  Jan-Michael Frahm,et al.  USAC: A Universal Framework for Random Sample Consensus , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andrea Marchetti,et al.  Optimal RANSAC-Towards a Repeatable Algorithm for Finding the Optimal Set , 2013, J. WSCG.

[12]  Lionel Moisan,et al.  Automatic Homographic Registration of a Pair of Images, with A Contrario Elimination of Outliers , 2012, Image Process. Line.

[13]  Jubai An,et al.  A Simple and Robust Feature Point Matching Algorithm Based on Restricted Spatial Order Constraints for Aerial Image Registration , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bin Li,et al.  RSCJ: Robust Sample Consensus Judging Algorithm for Remote Sensing Image Registration , 2012, IEEE Geoscience and Remote Sensing Letters.

[15]  Jiri Matas,et al.  Fixing the Locally Optimized RANSAC , 2012, BMVC.

[16]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[18]  Zhanyi Hu,et al.  Rejecting Mismatches by Correspondence Function , 2010, International Journal of Computer Vision.

[19]  Vladimir Kolmogorov,et al.  Feature Correspondence Via Graph Matching: Models and Global Optimization , 2008, ECCV.

[20]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  G. LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[23]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[24]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[25]  Zhengwei Yang,et al.  Image registration and object recognition using affine invariants and convex hulls , 1999, IEEE Trans. Image Process..

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .