An Extension of Phase Correlation-Based Image Registration to Estimate Similarity Transform Using Multiple Polar Fourier Transform

Image registration is a core technology of many different image processing areas and is widely used in the remote sensing community. The accuracy of image registration largely determines the effect of subsequent applications. In recent years, phase correlation-based image registration has drawn much attention because of its high accuracy and efficiency as well as its robustness to gray difference and even slight changes in content. Many researchers have reported that the phase correlation method can acquire a sub-pixel accuracy of 1/10 or even 1/100. However, its performance is acquired only in the case of translation, which limits the scope of the application of the method. However, there are few reports on the estimation of scales and angles based on the phase correlation method. To take advantage of the high accuracy property and other merits of phase correlation-based image registration and extend it to estimate the similarity transform, we proposed a novel algorithm, the Multilayer Polar Fourier Transform (MPFT), which uses a fast and accurate polar Fourier transform with different scaling factors to calculate the log-polar Fourier transform. The structure of the polar grids of MPFT is more similar to the one of the log-polar grid. In particular, for rotation estimation only, the polar grid of MPFT is the calculation grid. To validate its effectiveness and high accuracy in estimating angles and scales, both qualitative and quantitative experiments were carried out. The quantitative experiments included a numerical simulation as well as synthetic and real data experiments. The experimental results showed that the proposed method, MPFT, performs better than the existing phase correlation-based similarity transform estimation methods, the Pseudo-polar Fourier Transform (PPFT) and the Multilayer Fractional Fourier Transform method (MLFFT), and the classical feature-based registration method, Scale-Invariant Feature Transform (SIFT), and its variant, ms-SIFT.

[1]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[3]  Bo Tao,et al.  Analysis of image registration noise due to rotationally dependent aliasing , 2003, J. Vis. Commun. Image Represent..

[4]  Fan Mo,et al.  Matching Multi-Source Optical Satellite Imagery Exploiting a Multi-Stage Approach , 2017, Remote. Sens..

[5]  Michel Defrise,et al.  Symmetric Phase-Only Matched Filtering of Fourier-Mellin Transforms for Image Registration and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Bao-Long Guo,et al.  Pseudo-log-polar Fourier transform for image registration , 2006, IEEE Signal Processing Letters.

[7]  Zhaoming Zhang,et al.  A Novel Image Registration Method Based on Phase Correlation Using Low-Rank Matrix Factorization With Mixture of Gaussian , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Vasileios Argyriou,et al.  A Study of Sub-pixel Motion Estimation using Phase Correlation , 2006, BMVC.

[9]  Siamak Khorram,et al.  The effects of image misregistration on the accuracy of remotely sensed change detection , 1998, IEEE Trans. Geosci. Remote. Sens..

[10]  Birgit Kleinschmit,et al.  Robust Automated Image Co-Registration of Optical Multi-Sensor Time Series Data: Database Generation for Multi-Temporal Landslide Detection , 2014, Remote. Sens..

[11]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[12]  Patrick Hostert,et al.  AROSICS: An Automated and Robust Open-Source Image Co-Registration Software for Multi-Sensor Satellite Data , 2017, Remote. Sens..

[13]  Wei Pan,et al.  An Adaptable-Multilayer Fractional Fourier Transform Approach for Image Registration , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Nathan S. Netanyahu,et al.  An Efficient SIFT-Based Mode-Seeking Algorithm for Sub-Pixel Registration of Remotely Sensed Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[15]  Lin Yan,et al.  An Automated Approach for Sub-Pixel Registration of Landsat-8 Operational Land Imager (OLI) and Sentinel-2 Multi Spectral Instrument (MSI) Imagery , 2016, Remote. Sens..

[16]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[17]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[18]  J. G. Liu,et al.  Robust Phase Correlation Methods for Sub-Pixel Feature Matching , 2006 .

[19]  Yusheng Xu,et al.  An Improved Phase Correlation Method Based on 2-D Plane Fitting and the Maximum Kernel Density Estimator , 2015, IEEE Geoscience and Remote Sensing Letters.

[20]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[21]  Sébastien Leprince,et al.  Automatic and Precise Orthorectification, Coregistration, and Subpixel Correlation of Satellite Images, Application to Ground Deformation Measurements , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[23]  Guojin He,et al.  RPC Estimation via $\ell_1$-Norm-Regularized Least Squares (L1LS) , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ikram E. Abdou,et al.  Practical approach to the registration of multiple frames of video images , 1998, Electronic Imaging.

[25]  Amin Sedaghat,et al.  Uniform competency-based local feature extraction for remote sensing images , 2018 .

[26]  Shuang Wang,et al.  A deep learning framework for remote sensing image registration , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[27]  Pramod K. Varshney,et al.  Robustness of Change Detection Algorithms in the Presence of Registration Errors , 2007 .

[28]  David H. Bailey,et al.  The Fractional Fourier Transform and Applications , 1991, SIAM Rev..

[29]  Weili Jiao,et al.  Eliminating Effect of Image Border with Image Periodic Decomposition for Phase Correlation Based Image Registration , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[30]  D. Donoho,et al.  Fast and accurate Polar Fourier transform , 2006 .

[31]  Lorenzo Bruzzone,et al.  A local phase based invariant feature for remote sensing image matching , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[32]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[33]  C. Fraser,et al.  Sensor orientation via RPCs , 2006 .

[34]  André Stumpf,et al.  Improved Co-Registration of Sentinel-2 and Landsat-8 Imagery for Earth Surface Motion Measurements , 2018, Remote. Sens..

[35]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[36]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[37]  Zhaoming Zhang,et al.  A Fast and Reliable Matching Method for Automated Georeferencing of Remotely-Sensed Imagery , 2016, Remote. Sens..

[38]  Luis Ángel Ruiz Fernández,et al.  Evaluating Fourier Cross-Correlation Sub-Pixel Registration in Landsat Images , 2017, Remote. Sens..

[39]  Amin Sedaghat,et al.  Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jianguo Liu,et al.  Phase correlation pixel‐to‐pixel image co‐registration based on optical flow and median shift propagation , 2008 .

[41]  Qingwu Hu,et al.  Robust feature matching via support-line voting and affine-invariant ratios , 2017 .

[42]  William Scott Hoge,et al.  A subspace identification extension to the phase correlation method [MRI application] , 2003, IEEE Transactions on Medical Imaging.

[43]  Yusheng Xu,et al.  A Novel Subpixel Phase Correlation Method Using Singular Value Decomposition and Unified Random Sample Consensus , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  X. Tong,et al.  Detection and estimation of ZY-3 three-line array image distortions caused by attitude oscillation , 2015 .

[45]  Serhiy Skakun,et al.  Automatic sub-pixel co-registration of Landsat-8 Operational Land Imager and Sentinel-2A Multi-Spectral Instrument images using phase correlation and machine learning based mapping , 2017, Int. J. Digit. Earth.

[46]  Hassan Foroosh,et al.  An Exact and Fast Computation of Discrete Fourier Transform for Polar and Spherical Grid , 2017, IEEE Transactions on Signal Processing.

[47]  H. Ebadi,et al.  Accurate Affine Invariant Image Matching Using Oriented Least Square , 2015 .

[48]  Amir Averbuch,et al.  Pseudopolar-based estimation of large translations, rotations, and scalings in images , 2005, IEEE Trans. Image Process..

[49]  Lionel Moisan,et al.  Periodic Plus Smooth Image Decomposition , 2011, Journal of Mathematical Imaging and Vision.