Improved ORB Algorithm Using Three-Patch Method and Local Gray Difference

This paper presents an improved Oriented Features from Accelerated Segment Test (FAST) and Rotated BRIEF (ORB) algorithm named ORB using three-patch and local gray difference (ORB-TPLGD). ORB takes a breakthrough in real-time aspect. However, subtle changes of the image may greatly affect its final binary description. In this paper, the feature description generation is focused. On one hand, instead of pixel patch pairs comparison method used in present ORB algorithm, a three-pixel patch group comparison method is adopted to generate the binary string. In each group, the gray value of the main patch is compared with that of the other two companion patches to determine the corresponding bit of the binary description. On the other hand, the present ORB algorithm simply uses the gray size comparison between pixel patch pairs, while ignoring the information of the gray difference value. In this paper, another binary string based on the gray difference information mentioned above is generated. Finally, the feature fusion method is adopted to combine the binary strings generated in the above two steps to generate a new feature description. Experiment results indicate that our improved ORB algorithm can achieve greater performance than ORB and some other related algorithms.

[1]  Shuigeng Zhou,et al.  A Novel Image Registration Algorithm for Remote Sensing Under Affine Transformation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zuren Feng,et al.  An Improved Randomized Local Binary Features for Keypoints Recognition , 2018, Sensors.

[3]  Tal Hassner,et al.  LATCH: Learned arrangements of three patch codes , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Pascal Fua,et al.  LDAHash: Improved Matching with Smaller Descriptors , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Vincent Lepetit,et al.  Learning Image Descriptors with Boosting , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Dan Tao,et al.  Global Optimal Structured Embedding Learning for Remote Sensing Image Retrieval , 2020, Sensors.

[10]  Hua Yang,et al.  Robust Semantic Template Matching Using a Superpixel Region Binary Descriptor , 2019, IEEE Transactions on Image Processing.

[11]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  B. Krishna Mohan,et al.  Image Matching Using SIFT Features and Relaxation Labeling Technique—A Constraint Initializing Method for Dense Stereo Matching , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Mohammad Reza Malek,et al.  VGI and Reference Data Correspondence Based on Location‐Orientation Rotary Descriptor and Segment Matching , 2015, Trans. GIS.

[14]  Yongjun Zhang,et al.  Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Matti Pietikäinen,et al.  A Generalized Local Binary Pattern Operator for Multiresolution Gray Scale and Rotation Invariant Texture Classification , 2001, ICAPR.

[16]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[17]  Miriam Cabrelles,et al.  Automatic orientation and 3D modelling from markerless rock art imagery , 2013 .

[18]  Vincent Lepetit,et al.  Efficient Discriminative Projections for Compact Binary Descriptors , 2012, ECCV.

[19]  Krystian Mikolajczyk,et al.  Binary Online Learned Descriptors , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[21]  Yongjun Zhang,et al.  Learning Source-Invariant Deep Hashing Convolutional Neural Networks for Cross-Source Remote Sensing Image Retrieval , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jubai An,et al.  A Simple and Robust Feature Point Matching Algorithm Based on Restricted Spatial Order Constraints for Aerial Image Registration , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Hongxun Yao,et al.  Nested-SIFT for Efficient Image Matching and Retrieval , 2013, IEEE MultiMedia.

[25]  Amin Sedaghat,et al.  Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  A. Gruen,et al.  3D change detection at street level using mobile laser scanning point clouds and terrestrial images , 2014 .

[28]  Mahmod Reza Sahebi,et al.  Automatic building extraction from LIDAR digital elevation models and WorldView imagery , 2009 .

[29]  E. G. Parmehr,et al.  Automatic registration of optical imagery with 3D LiDAR data using statistical similarity , 2014 .

[30]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[31]  Valentyn Tolpekin,et al.  Multitemporal change detection of urban trees using localized region - based active contours in VHR images , 2012 .

[32]  Luís Corte-Real,et al.  Automatic Image Registration Through Image Segmentation and SIFT , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[34]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[35]  Avik Bhattacharya,et al.  CMIR-NET : A Deep Learning Based Model For Cross-Modal Retrieval In Remote Sensing , 2019, Pattern Recognit. Lett..

[36]  Xin Yang,et al.  Local Difference Binary for Ultrafast and Distinctive Feature Description , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[38]  Tal Hassner,et al.  Effective Unconstrained Face Recognition by Combining Multiple Descriptors and Learned Background Statistics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Dan Ma,et al.  Remote Sensing Image Matching Based Improved ORB in NSCT Domain , 2019, Journal of the Indian Society of Remote Sensing.

[40]  Hongwei Zhao,et al.  Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval , 2020, Remote. Sens..

[41]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Vincent Lepetit,et al.  Boosting Binary Keypoint Descriptors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[44]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[45]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  M. Favalli,et al.  Multiview 3D reconstruction in geosciences , 2012, Comput. Geosci..

[47]  Yongil Kim,et al.  Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Kacem Chehdi,et al.  A Precise Lower Bound on Image Subpixel Registration Accuracy , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.