Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor

Image matching based on local invariant features is crucial for many photogrammetric and remote sensing applications such as image registration and image mosaicking. In this paper, a novel local feature descriptor named adaptive binning scale-invariant feature transform (AB-SIFT) for fully automatic remote sensing image matching that is robust to local geometric distortions is proposed. The main idea of the proposed method is an adaptive binning strategy to compute the local feature descriptor. The proposed descriptor is computed on a normalized region defined by an improved version of the prominent Hessian affine feature extraction algorithm called the uniform robust Hessian affine algorithm. Unlike common distribution-based descriptors, the proposed descriptor uses an adaptive histogram quantization strategy for both location and gradient orientations, which is robust and actually resistant to a local viewpoint distortion and extremely increases the discriminability and robustness of the final AB-SIFT descriptor. In addition to the SIFT descriptor, the proposed adaptive quantization strategy can be easily extended for other distribution-based descriptors. Experimental results on both synthetic and real image pairs show that the proposed AB-SIFT matching method is more robust and accurate than state-of-the-art methods, including the SIFT, DAISY, the gradient location and orientation histogram, the local intensity order pattern, and the binary robust invariant scale keypoint.

[1]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[3]  Luís Corte-Real,et al.  Automatic Image Registration Through Image Segmentation and SIFT , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Miriam Cabrelles,et al.  Automatic orientation and 3D modelling from markerless rock art imagery , 2013 .

[5]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[7]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[8]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[9]  Hans-Peter Seidel,et al.  Scale Invariant Feature Transform with Irregular Orientation Histogram Binning , 2009, ICIAR.

[10]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[11]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[13]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Shuigeng Zhou,et al.  A Novel Image Registration Algorithm for Remote Sensing Under Affine Transformation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  A. Gruen,et al.  3D change detection at street level using mobile laser scanning point clouds and terrestrial images , 2014 .

[16]  Qiuxia Wu,et al.  A new descriptor resistant to affine transformation and monotonic intensity change , 2014, Comput. Vis. Image Underst..

[17]  Jubai An,et al.  A Simple and Robust Feature Point Matching Algorithm Based on Restricted Spatial Order Constraints for Aerial Image Registration , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Amin Sedaghat,et al.  Very high resolution image matching based on local features and k-means clustering , 2015 .

[20]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  H. Ebadi,et al.  Accurate Affine Invariant Image Matching Using Oriented Least Square , 2015 .

[22]  Mahmod Reza Sahebi,et al.  Automatic building extraction from LIDAR digital elevation models and WorldView imagery , 2009 .

[23]  E. G. Parmehr,et al.  Automatic registration of optical imagery with 3D LiDAR data using statistical similarity , 2014 .

[24]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[25]  Yongil Kim,et al.  Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Kacem Chehdi,et al.  A Precise Lower Bound on Image Subpixel Registration Accuracy , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Bin Fan,et al.  Local Intensity Order Pattern for feature description , 2011, 2011 International Conference on Computer Vision.

[28]  Dengrong Zhang,et al.  A fast and fully automatic registration approach based on point features for multi-source remote-sensing images , 2008, Comput. Geosci..

[29]  M. Favalli,et al.  Multiview 3D reconstruction in geosciences , 2012, Comput. Geosci..

[30]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Valentyn Tolpekin,et al.  Multitemporal change detection of urban trees using localized region - based active contours in VHR images , 2012 .

[32]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[33]  Jianping Fan,et al.  Fast Local Self-Similarity for describing interest regions , 2012, Pattern Recognit. Lett..

[34]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[35]  Hongxun Yao,et al.  Nested-SIFT for Efficient Image Matching and Retrieval , 2013, IEEE MultiMedia.

[36]  Fang Liu,et al.  Robust Differential Circle Patterns based on fuzzy membership-pooling: A novel local image descriptor , 2014, Neurocomputing.

[37]  Pierre-Marc Jodoin,et al.  Perspective-SIFT: An efficient tool for low-altitude remote sensing image registration , 2013, Signal Process..

[38]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[39]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[40]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  B. Krishna Mohan,et al.  Image Matching Using SIFT Features and Relaxation Labeling Technique—A Constraint Initializing Method for Dense Stereo Matching , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Mohammad Reza Malek,et al.  VGI and Reference Data Correspondence Based on Location‐Orientation Rotary Descriptor and Segment Matching , 2015, Trans. GIS.

[43]  Amin Sedaghat,et al.  Image Matching of Satellite Data Based on Quadrilateral Control Networks , 2012 .

[44]  Yunsheng Zhang,et al.  GPU-accelerated large-size VHR images registration via coarse-to-fine matching , 2014, Comput. Geosci..

[45]  Lu Tian,et al.  OSRI: A Rotationally Invariant Binary Descriptor , 2014, IEEE Transactions on Image Processing.

[46]  Zhanyi Hu,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTION ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Rotationally Invariant Descript , 2011 .