Geometric feature descriptor and dissimilarity-based registration of remotely sensed imagery

Image registration of remotely sensed imagery is challenging, as complex deformations are common. Different deformations, such as affine and homogenous transformation, combined with multimodal data capturing can emerge in the data acquisition process. These effects, when combined, tend to compromise the performance of the currently available registration methods. A new image transform, known as geometric mean projection transform, is introduced in this work. As it is deformation invariant, it can be employed as a feature descriptor, whereby it analyzes the functions of all vertical and horizontal signals in local areas of the image. Moreover, an invariant feature correspondence method is proposed as a point matching algorithm, which incorporates new descriptor’s dissimilarity metric. Considering the image as a signal, the proposed approach utilizes a square Eigenvector correlation (SEC) based on the Eigenvector properties. In our experiments on standard test images sourced from “Featurespace” and “IKONOS” datasets, the proposed method achieved higher average accuracy relative to that obtained from other state of the art image registration techniques. The accuracy of the proposed method was assessed using six standard evaluation metrics. Furthermore, statistical analyses, including t-test and Friedman test, demonstrate that the method developed as a part of this study is superior to the existing methods.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  Yaxuan Wang,et al.  A Feature Matching Algorithm Based on an Illumination and Affine Invariant for Aerial Image Registration , 2014 .

[3]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[4]  Zhuowen Tu,et al.  Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration , 2015, IEEE Transactions on Signal Processing.

[5]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[6]  Zhou Wu,et al.  Adaptive Image Registration via Hierarchical Voronoi Subdivision , 2012, IEEE Transactions on Image Processing.

[7]  Sim Heng Ong,et al.  Remote Sensing Image Registration Using Multiple Image Features , 2017, Remote. Sens..

[8]  SuomelaRiku,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998 .

[9]  Martin Styner,et al.  Parametric estimate of intensity inhomogeneities applied to MRI , 2000, IEEE Transactions on Medical Imaging.

[10]  Yunhui Liu,et al.  Effective corner matching based on Delaunay triangulation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  Lenan Wu,et al.  UCAV Path Planning by Fitness-Scaling Adaptive Chaotic Particle Swarm Optimization , 2013 .

[12]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[13]  Yan Zhang,et al.  Inertial sensors supported visual descriptors encoding and geometric verification for mobile visual location recognition applications , 2015, Signal Process..

[14]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  A. Ardeshir Goshtasby,et al.  Template Matching in Rotated Images , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Md. Jan Nordin,et al.  Contour-Based Corner Detection and Classification by Using Mean Projection Transform , 2014, Sensors.

[17]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[18]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[20]  Md. Jan Nordin,et al.  Deformation invariant image matching based on dissimilarity of spatial features , 2016, Neurocomputing.

[21]  Joon Hee Han,et al.  Chord-to-point distance accumulation and planar curvature: a new approach to discrete curvature , 2001, Pattern Recognit. Lett..

[22]  Guojun Lu,et al.  Robust Image Corner Detection Based on the Chord-to-Point Distance Accumulation Technique , 2008, IEEE Transactions on Multimedia.

[23]  Ferran Marqués,et al.  A contour-based approach to automatic and accurate registration of multitemporal and multisensor satellite imagery , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[24]  Seyed Mostafa Mousavi Kahaki,et al.  Double Line Image Rotation , 2015, IEEE Transactions on Image Processing.

[25]  David R. Haynor,et al.  Nonrigid multimodality image registration , 2001, SPIE Medical Imaging.

[26]  Avijit Kar,et al.  A new approach to corner matching from image sequence using fuzzy similarity index , 2011, Pattern Recognit. Lett..

[27]  Jeff Orchard,et al.  Efficient Global Weighted Least-Squares Translation Registration in the Frequency Domain , 2005, ICIAR.

[28]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[29]  Guojun Lu,et al.  An Improved Curvature Scale-Space Corner Detector and a Robust Corner Matching Approach for Transformed Image Identification , 2008, IEEE Transactions on Image Processing.

[30]  Sim Heng Ong,et al.  A Small UAV Based Multi-Temporal Image Registration for Dynamic Agricultural Terrace Monitoring , 2017, Remote. Sens..

[31]  N. H. C. Yung,et al.  Curvature scale space corner detector with adaptive threshold and dynamic region of support , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[32]  Yudong Zhang,et al.  Remote-Sensing Image Classification Based on an Improved Probabilistic Neural Network , 2009, Sensors.

[33]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[35]  Henry Leung,et al.  A maximum likelihood approach for image registration using control point and intensity , 2004, IEEE Transactions on Image Processing.

[36]  Farzin Mokhtarian,et al.  Performance evaluation of corner detectors using consistency and accuracy measures , 2006, Comput. Vis. Image Underst..

[37]  Ming Lei,et al.  Multi-scale curvature product for robust image corner detection in curvature scale space , 2007, Pattern Recognit. Lett..

[38]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[39]  Chunhui Cui,et al.  Global Propagation of Affine Invariant Features for Robust Matching , 2013, IEEE Transactions on Image Processing.

[40]  Pramod K. Varshney,et al.  Mutual information-based image registration for remote sensing data , 2003 .

[41]  Yi Su,et al.  A SAR Image Registration Method Based on Pixel Migration of Edge-Point Feature , 2014, IEEE Geoscience and Remote Sensing Letters.

[42]  David W. Scott,et al.  Parametric Statistical Modeling by Minimum Integrated Square Error , 2001, Technometrics.

[43]  Yan-Bin Jia Transformations in Homogeneous Coordinates , 2018 .

[44]  Yudong Zhang,et al.  Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization , 2011, Sensors.

[45]  Mingqiang Yang,et al.  Non-rigid registration of medical images with scale-space corner detection and thin-plate spline , 2012, Biomed. Signal Process. Control..

[46]  Penglang Shui,et al.  Corner Detection and Classification Using Anisotropic Directional Derivative Representations , 2013, IEEE Transactions on Image Processing.

[47]  Roman M. Palenichka,et al.  Automatic Extraction of Control Points for the Registration of Optical Satellite and LiDAR Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[49]  Md Jan Nordin,et al.  Invariant Feature Matching for Image Registration Application Based on New Dissimilarity of Spatial Features , 2016, PloS one.