Distinctive Order Based Self-Similarity descriptor for multi-sensor remote sensing image matching

Abstract Robust, well-distributed and accurate feature matching in multi-sensor remote sensing image is a difficult task duo to significant geometric and illumination differences. In this paper, a robust and effective image matching approach is presented for multi-sensor remote sensing images. The proposed approach consists of three main steps. In the first step, UR-SIFT (Uniform robust scale invariant feature transform) algorithm is applied for uniform and dense local feature extraction. In the second step, a novel descriptor namely Distinctive Order Based Self Similarity descriptor , DOBSS descriptor, is computed for each extracted feature. Finally, a cross matching process followed by a consistency check in the projective transformation model is performed for feature correspondence and mismatch elimination. The proposed method was successfully applied for matching various multi-sensor satellite images as: ETM+, SPOT 4, SPOT 5, ASTER, IRS, SPOT 6, QuickBird, GeoEye and Worldview sensors, and the results demonstrate its robustness and capability compared to common image matching techniques such as SIFT, PIIFD, GLOH, LIOP and LSS.

[1]  Li Wang,et al.  A robust multisource image automatic registration system based on the SIFT descriptor , 2012 .

[2]  Vahid Sadeghi,et al.  A new model for automatic normalization of multitemporal satellite images using Artificial Neural Network and mathematical methods , 2013 .

[3]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[4]  Yuanxin Ye,et al.  A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences , 2014 .

[5]  Guoyou Wang,et al.  Robust Scale-Invariant Feature Matching for Remote Sensing Image Registration , 2009, IEEE Geoscience and Remote Sensing Letters.

[6]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[8]  E. G. Parmehr,et al.  Automatic registration of optical imagery with 3D LiDAR data using statistical similarity , 2014 .

[9]  Zhou Wu,et al.  Adaptive Image Registration via Hierarchical Voronoi Subdivision , 2012, IEEE Transactions on Image Processing.

[10]  Guillaume-Alexandre Bilodeau,et al.  Local self-similarity-based registration of human ROIs in pairs of stereo thermal-visible videos , 2013, Pattern Recognit..

[11]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ehud Rivlin,et al.  ROR: Rejection of Outliers by Rotations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  A. Gruen.  Development and Status of Image Matching in Photogrammetry , 2012 .

[14]  Dan Hu,et al.  Scale-invariant feature transform based on the frequency spectrum and the grid for remote sensing image registration , 2013 .

[15]  Laura Igual,et al.  Robust gait-based gender classification using depth cameras , 2013, EURASIP Journal on Image and Video Processing.

[16]  Amin Sedaghat,et al.  Image Matching of Satellite Data Based on Quadrilateral Control Networks , 2012 .

[17]  Jianping Fan,et al.  Fast Local Self-Similarity for describing interest regions , 2012, Pattern Recognit. Lett..

[18]  Manuel Graña,et al.  AN EMPIRICAL EVALUATION OF INTEREST POINT DETECTORS , 2013, Cybern. Syst..

[19]  Bin Fan,et al.  Local Intensity Order Pattern for feature description , 2011, 2011 International Conference on Computer Vision.

[20]  Henrik Aanæs,et al.  Interesting Interest Points , 2011, International Journal of Computer Vision.

[21]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[23]  Zhanyi Hu,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTION ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Rotationally Invariant Descript , 2011 .

[24]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[25]  Mahmod Reza Sahebi,et al.  Automatic building extraction from LIDAR digital elevation models and WorldView imagery , 2009 .

[26]  Youkyung Han,et al.  Automatic Registration of High-Resolution Images Using Local Properties of Features , 2012 .

[27]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[28]  Gamini Dissanayake,et al.  L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry , 2014 .

[29]  Marco Gianinetto,et al.  Automatic Co‐Registration of Satellite Time Series , 2012 .

[30]  Andrew Zisserman,et al.  Efficient retrieval of deformable shape classes using local self-similarities , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[31]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  B. Krishna Mohan,et al.  Image Matching Using SIFT Features and Relaxation Labeling Technique—A Constraint Initializing Method for Dense Stereo Matching , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Shuigeng Zhou,et al.  A Novel Image Registration Algorithm for Remote Sensing Under Affine Transformation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[35]  Mohammad Reza Malek,et al.  VGI and Reference Data Correspondence Based on Location‐Orientation Rotary Descriptor and Segment Matching , 2015, Trans. GIS.

[36]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[37]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Guihua Zeng,et al.  Description of interest regions with oriented local self-similarity , 2012 .

[39]  Miriam Cabrelles,et al.  Automatic orientation and 3D modelling from markerless rock art imagery , 2013 .

[40]  A. Gruen,et al.  3D change detection at street level using mobile laser scanning point clouds and terrestrial images , 2014 .