Remote sensing image registration based on Gaussian-Hermite moments and the Pseudo-RANSAC algorithm

ABSTRACT This study deals with an important issue that is often encountered with the registration of remote sensing images which are obtained at different times and/or through inter/intra sensors. Remote sensing images may differ significantly in gray-level characteristics and contrast, among other aspects. Thus, it may be difficult to apply directly area-based approaches which are dependent on image intensity values. In this work, a novel image registration approach based on Gaussian-Hermite moments and the Pseudo-RANSAC algorithm is proposed. The problem of intensity difference commonly incurred in multi-temporal or multimodal remote sensing image registration is tackled using features that are invariant to intensity mapping during the feature point matching process. In particular, the feature points are herein represented by a range of newly introduced Gaussian-Hermite moments, and the corresponding feature points in a certain reference image are sought with the Euclidean distance measure. Moreover, an improved RANdom SAmple Consensus (RANSAC) algorithm is presented, reducing computational time complexity while improving performance in stability and accuracy. The final warping of images according to their refined feature points is conducted with bilinear interpolation. The proposed approach has been successfully applied to register synthetic and real remote sensing images, demonstrating its efficacy with systematic experimental evaluations.

[1]  Guoyou Wang,et al.  Robust Scale-Invariant Feature Matching for Remote Sensing Image Registration , 2009, IEEE Geoscience and Remote Sensing Letters.

[2]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[3]  Jie Jiang,et al.  A Robust Point-Matching Algorithm Based on Integrated Spatial Structure Constraint for Remote Sensing Image Registration , 2016, IEEE Geoscience and Remote Sensing Letters.

[4]  Jan Flusser,et al.  Scale invariants from Gaussian-Hermite moments , 2017, Signal Process..

[5]  Marina L. Gavrilova,et al.  Improving RANSAC Feature Matching with Local Topological Information , 2012, 2012 Ninth International Symposium on Voronoi Diagrams in Science and Engineering.

[6]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[9]  Youfu Wu,et al.  Some Aspects of Gaussian-Hermite Moments in Image Analysis , 2007, Third International Conference on Natural Computation (ICNC 2007).

[10]  Nikos Komodakis,et al.  Graph-Based Registration, Change Detection, and Classification in Very High Resolution Multitemporal Remote Sensing Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Ying Li,et al.  Optical Image and SAR Image Registration Based on Linear Features and Control Points , 2012 .

[12]  H. Shu,et al.  Image description with generalized pseudo-Zernike moments. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Ying Li,et al.  Image fusion via nonlocal sparse K-SVD dictionary learning. , 2016, Applied optics.

[14]  Mo Dai,et al.  Image reconstruction from continuous Gaussian-Hermite moments implemented by discrete algorithm , 2012, Pattern Recognit..

[15]  Khalid M. Hosny,et al.  Fast computation of accurate Gaussian-Hermite moments for image processing applications , 2012, Digit. Signal Process..

[16]  Mo Dai,et al.  Rotation and translation invariants of Gaussian-Hermite moments , 2011, Pattern Recognit. Lett..

[17]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.