Nonlinear intensity measurement for multi-source images based on structural similarity

Abstract Feature-based algorithms are widely used in automatic matching of multi-source images (e.g., LiDAR, optical, infrared, map, and SAR images). However, it remains a challenging task to find sufficient correct correspondences for image pairs in the presence of significant noise and nonlinear intensity differences. To solve this problem, this paper proposes a novel feature descriptor named the histogram of maximum phase congruency (HMPC), which is based on the structural properties of images. Then, a novel distance formula is designed by normalizing the phase orientation and histogram value to calculate the similarity. Furthermore, the precise bilateral matching principle and consistency-checking algorithm based on the phase orientation are used to perform matching between the corresponding point sets. Benefiting from combinatorial features, the proposed method can effectively capture the structural information of images and present robust matching performance for complex texture structures and noise images compared to that of the sole feature, and it has been tested with a variety of SAR, LiDAR, optical,and map datas. The results demonstrate that the proposed HMPC achieves a more robust and accurate matching performance than many state-of-the-art methods.

[1]  Francesca Bovolo,et al.  A Fast and Robust Matching Framework for Multimodal Remote Sensing Image Registration , 2018, ArXiv.

[2]  Michael Grass,et al.  Automatic optimum phase point selection based on centerline consistency for 3D rotational coronary angiography , 2008, International Journal of Computer Assisted Radiology and Surgery.

[3]  Tardi Tjahjadi,et al.  Clique descriptor of affine invariant regions for robust wide baseline image matching , 2010, Pattern Recognit..

[4]  Yusong Pang,et al.  Multispectral visual detection method for conveyor belt longitudinal tear , 2019, Measurement.

[5]  Haichao Li,et al.  Robust Multi-Source Image Registration for Optical Satellite Based on Phase Information , 2016 .

[6]  Pengfeng Chen,et al.  LCO: A robust and efficient local descriptor for image matching , 2017 .

[7]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[8]  Chern-Sheng Lin,et al.  The remote cruise method for the robot with multiple sensors , 2018 .

[9]  Josef Kittler,et al.  Curvature scale space image in shape similarity retrieval , 1999, Multimedia Systems.

[10]  Amin Sedaghat,et al.  Distinctive Order Based Self-Similarity descriptor for multi-sensor remote sensing image matching , 2015 .

[11]  Tung-Hsien Tsai,et al.  An image matching algorithm for variable mesh surfaces , 2007 .

[12]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[14]  Angel Domingo Sappa,et al.  Multispectral Image Feature Points , 2012, Sensors.

[15]  Laura Igual,et al.  Robust gait-based gender classification using depth cameras , 2013, EURASIP Journal on Image and Video Processing.

[16]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[17]  Jianping Fan,et al.  Fast Local Self-Similarity for describing interest regions , 2012, Pattern Recognit. Lett..

[18]  Guili Xu,et al.  Histogram of maximal point-edge orientation for multi-source image matching , 2020 .

[19]  M. Wagner,et al.  Multimodal image registration by elastic matching of edge sketches via optimal control , 2013 .

[20]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  Muguo Li,et al.  Underwater image matching with efficient refractive-geometry estimation for measurement in glass-flume experiments , 2020 .

[23]  Liyan Zhang,et al.  Attitude-sensor-aided in-process registration of multi-view surface measurement , 2011 .

[24]  Y. Ye,et al.  HOPC: A NOVEL SIMILARITY METRIC BASED ON GEOMETRIC STRUCTURAL PROPERTIES FOR MULTI-MODAL REMOTE SENSING IMAGE MATCHING , 2016 .

[26]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[28]  Lianghong Wu,et al.  R-K algorithm: A novel Dynamic Feature Matching Method of flotation froth , 2020 .

[29]  Gongping Yang,et al.  Finger Vein Recognition Based on Local Directional Code , 2012, Sensors.

[30]  Minh N. Do,et al.  DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Jianqi Sun,et al.  ROI-Based Intraoperative MR-CT Registration for Image-Guided Multimode Tumor Ablation Therapy in Hepatic Malignant Tumors , 2020, IEEE Access.

[32]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Yuehua Cheng,et al.  Robust and efficient multi-source image matching method based on best-buddies similarity measure , 2019 .

[34]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[35]  Lorenzo Bruzzone,et al.  Region-Based Retrieval of Remote Sensing Images Using an Unsupervised Graph-Theoretic Approach , 2016, IEEE Geoscience and Remote Sensing Letters.

[36]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[37]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  K. Vijayalakshmi,et al.  Medical image denoising using multi-resolution transforms , 2019, Measurement.

[39]  Yuehua Cheng,et al.  A curvature salience descriptor for full and partial shape matching , 2018, Multimedia Tools and Applications.