Histogram of maximal point-edge orientation for multi-source image matching

ABSTRACT Features determined from keypoints or edges are widely used in multi-source image matching. However, for cases that exhibit non-linear intensity changes and significant noise, identifying sufficient identical features for multi-source image pairs can be complicated. Motivated by problems encountered in existing multi-source image matching algorithms, a robust and effective algorithm for multi-source image matching was proposed in this paper. First, keypoints uniformly and sufficiently distributed on the significant edge were extracted by a location-based boosting detector. Second, in order to effectively describe the corresponding region and reduce the influence of noise and non-linear intensity changes, a novel descriptor, denoted as the histogram of point-edge orientation (HPEO) was proposed for multi-source image matching. A bilateral matching process was then used to remove the incorrect matches. Experiments were performed with standard infrared-visible datasets and the results demonstrate that the proposed algorithm achieves a more accurate matching performance.

[1]  Vijayan K. Asari,et al.  Histogram of Oriented Phase and Gradient (HOPG) Descriptor for Improved Pedestrian Detection , 2016 .

[2]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Zhou Wu,et al.  Adaptive Image Registration via Hierarchical Voronoi Subdivision , 2012, IEEE Transactions on Image Processing.

[4]  Gui Yun Tian,et al.  Infrared and visible images registration with adaptable local-global feature integration for rail inspection , 2017 .

[5]  B. Krishna Mohan,et al.  Image Matching Using SIFT Features and Relaxation Labeling Technique—A Constraint Initializing Method for Dense Stereo Matching , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[7]  Dan Hu,et al.  Scale-invariant feature transform based on the frequency spectrum and the grid for remote sensing image registration , 2013 .

[8]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[9]  Qi Tian,et al.  SIFT match verification by geometric coding for large-scale partial-duplicate web image search , 2013, TOMCCAP.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[12]  Li Li,et al.  Hierarchical line matching based on Line-Junction-Line structure descriptor and local homography estimation , 2016, Neurocomputing.

[13]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[14]  Edward Rosten,et al.  Boosting in Location Space , 2013, ArXiv.

[15]  Pierre-Luc St-Charles,et al.  Thermal–visible registration of human silhouettes: A similarity measure performance evaluation , 2014 .

[16]  Bin Xiao,et al.  Adaptive remote-sensing image fusion based on dynamic gradient sparse and average gradient difference , 2017 .

[17]  Lu Wang,et al.  Wide-baseline image matching using Line Signatures , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Qinyong Lin,et al.  Real-time automatic registration in optical surgical navigation , 2016 .

[19]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[20]  Guohua Gu,et al.  Polynomial fitting-based shape matching algorithm for multi-sensors remote sensing images , 2016 .

[21]  Hua Lee,et al.  Image retrieval using indexed histogram of Void-and-Cluster Block Truncation Coding , 2016, Signal Process..

[22]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Subrahmanyam Murala,et al.  Local extrema co-occurrence pattern for color and texture image retrieval , 2015, Neurocomputing.

[24]  Xiang Zhou,et al.  A New FPGA Architecture of FAST and BRIEF Algorithm for On-Board Corner Detection and Matching , 2018, Sensors.

[25]  Zhenfeng Shao,et al.  Scale and rotation robust line-based matching for high resolution images , 2013 .

[26]  Angel Domingo Sappa,et al.  Multispectral Image Feature Points , 2012, Sensors.

[27]  Gang Wang,et al.  Robust point matching method for multimodal retinal image registration , 2015, Biomed. Signal Process. Control..

[28]  Charles V. Stewart,et al.  Keypoint Descriptors for Matching Across Multiple Image Modalities and Non-linear Intensity Variations , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Amin Sedaghat,et al.  Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Xiaorun Li,et al.  Medium-low resolution multisource remote sensing image registration based on SIFT and robust regional mutual information , 2018 .

[31]  Ying Wei,et al.  Hybrid Histogram Descriptor: A Fusion Feature Representation for Image Retrieval , 2018, Sensors.

[32]  Rulon W. Clark,et al.  Sensory basis of navigation in snakes: the relative importance of eyes and pit organs , 2019, Animal Behaviour.

[33]  Xuejin Chen,et al.  LSGP: Line-SIFT Geometric Pattern for wide-baseline image matching , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[34]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[35]  Lei Huang,et al.  Feature-based image registration using the shape context , 2010 .

[36]  Li Wang,et al.  A robust multisource image automatic registration system based on the SIFT descriptor , 2012 .

[37]  Xiangguo Lin,et al.  An Index Based on Joint Density of Corners and Line Segments for Built-Up Area Detection from High Resolution Satellite Imagery , 2017, ISPRS Int. J. Geo Inf..

[38]  Paolo Napoletano,et al.  Evaluating color texture descriptors under large variations of controlled lighting conditions , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  Kai Li,et al.  Robust Line Matching Based on Ray-Point-Ray Structure Descriptor , 2014, ACCV Workshops.

[40]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[41]  Gongping Yang,et al.  Finger Vein Recognition Based on Local Directional Code , 2012, Sensors.

[42]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[43]  Xu Chen,et al.  Corner detection and matching for infrared image based on double ring mask and adaptive SUSAN algorithm , 2018 .

[44]  Jie Zhang,et al.  Coastline interpretation from multispectral remote sensing images using an association rule algorithm , 2010 .

[45]  Yong Li,et al.  Combining and matching keypoints and lines on multispectral images , 2019 .