Deformed contour segment matching for multi-source images

Abstract Robust and accurate multi-source matching is a difficult task due to significant nonlinear radiometric differences, background clutter, and geometric deformation in corresponding regions. Motivated by these existing problems, a discriminating yet robust combined descriptor for multi-source image matching, called deformed contour segment similarity (DCSS), is proposed in this work. First, the proposed DCSS, which is constructed by histogram of the combined contour features rather than the commonly used corner point and gradient, presents the accurate correspondence between image pairs and improves the descriptive ability to radiometric differences. Second, the deformed curve is presented via a finite-dimensional matrix Lie group to determine the similarity metric with an explicit geodesic solution. The geodesic distance, which indicates the nearest distance between curves in fluid space, is defined as the weight coefficient of the constructed histogram to enhance the robustness of the descriptor. The proposed algorithm utilizes the holistic contour information for the scoring and ranking of the shape similarity hypothesis, which can effectively reduce the influence of partially missing contours. Finally, a precise bilateral matching rule is used to perform the matching between the corresponding contour segments. Some experiments are carried out on various infrared-visible image data sets. The results demonstrate that the proposed DCSS achieves more robust and accurate matching performance than many popular multi-source image matching methods.

[1]  Yi Xiao,et al.  Deep Matching Network for Handwritten Chinese Character Recognition , 2020, Pattern Recognit..

[2]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Yuehua Cheng,et al.  Robust and efficient multi-source image matching method based on best-buddies similarity measure , 2019 .

[5]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[7]  Andrew Blake,et al.  Multiscale Categorical Object Recognition Using Contour Fragments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Josef Kittler,et al.  Curvature scale space image in shape similarity retrieval , 1999, Multimedia Systems.

[9]  Changxin Gao,et al.  Joint Image Deblurring and Matching with Blurred Invariant-Based Sparse Representation Prior , 2019, Complex..

[10]  Jinyun Zhou,et al.  Fast and robust template matching with majority neighbour similarity and annulus projection transformation , 2020, Pattern Recognit..

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Lin Xie,et al.  Improved spatial pyramid matching for scene recognition , 2018, Pattern Recognit..

[13]  Yuehua Cheng,et al.  A curvature salience descriptor for full and partial shape matching , 2018, Multimedia Tools and Applications.

[14]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[15]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Wenyu Liu,et al.  Maximal Cliques that Satisfy Hard Constraints with Application to Deformable Object Model Learning , 2011, NIPS.

[17]  Haojie Li,et al.  Line matching based on line-points invariant and local homography , 2018, Pattern Recognit..

[18]  Longin Jan Latecki,et al.  From partial shape matching through local deformation to robust global shape similarity for object detection , 2011, CVPR 2011.

[19]  Erwin M. Bakker,et al.  CycleMatch: A cycle-consistent embedding network for image-text matching , 2019, Pattern Recognit..

[20]  Pengfeng Chen,et al.  LCO: A robust and efficient local descriptor for image matching , 2017 .

[21]  Tony X. Han,et al.  Constellational contour parsing for deformable object detection , 2016, J. Vis. Commun. Image Represent..

[22]  Hui Wei,et al.  Scale-invariant contour segment context in object detection , 2014, Image Vis. Comput..

[23]  Li Liu,et al.  Learning visual and textual representations for multimodal matching and classification , 2018, Pattern Recognit..

[24]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[25]  Changxin Gao,et al.  Joint image deblurring and matching with feature-based sparse representation prior , 2020, Pattern Recognit..

[26]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[27]  Andrew Blake,et al.  Efficiently Combining Contour and Texture Cues for Object Recognition , 2008, BMVC.

[28]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[29]  Nicola Senin,et al.  Optical measurement of surface topographies with transparent coatings , 2019, Optics and Lasers in Engineering.

[30]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Julie Delon,et al.  SAR-SIFT: A SIFT-like algorithm for applications on SAR images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Weidong Min,et al.  Remote Sensing Image Registration Using Convolutional Neural Network Features , 2018, IEEE Geoscience and Remote Sensing Letters.

[33]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[34]  Angel Domingo Sappa,et al.  Multispectral Image Feature Points , 2012, Sensors.

[35]  Jianping Fan,et al.  Fast Local Self-Similarity for describing interest regions , 2012, Pattern Recognit. Lett..

[36]  Guili Xu,et al.  Histogram of maximal point-edge orientation for multi-source image matching , 2020 .

[37]  Girum G. Demisse,et al.  Deformation Based Curved Shape Representation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Xi Chen,et al.  Opinion Dynamics Model Based on Cognitive Styles: Field-Dependence and Field-Independence , 2019, Complex..

[39]  Rafael Grompone von Gioi,et al.  Gestaltic Grouping of Line Segments , 2018, Image Process. Line.