Point pattern matching based on line graph spectral context and descriptor embedding

Spectral methods have been extensively studied for point pattern matching. In this work, we aim to render the spectral matching algorithm more robust for positional jitter and outliers. We concentrate on the issue of spectral representation for point patterns. A local structural descriptor, called the line graph spectral context, is proposed to characterize the attribute of point patterns, making it fundamentally different from the available representation approaches at the global level. For any given point, we first construct a line graph using its neighboring points. Then the eigenvalues of various matrix representations associated with the obtained line graph are used as the point descriptor. Furthermore, the similarities between the descriptors are evaluated by comparing their low dimensional embedding via the technique of multiview spectral embedding. The proposed descriptor is finally integrated with a graph-matching framework for establishing the correspondences. Comparative experiments conducted on both synthetic data and real-world images show the effectiveness of the proposed method, especially in the presence of positional jitter and outliers.

[1]  Edwin R. Hancock,et al.  Spectral embedding of graphs , 2003, Pattern Recognit..

[2]  H. C. Longuet-Higgins,et al.  An algorithm for associating the features of two images , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[3]  Edwin R. Hancock,et al.  Correspondence Matching with Modal Clusters , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  In-So Kweon,et al.  Robust feature point matching by preserving local geometric consistency , 2009, Comput. Vis. Image Underst..

[5]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ali Shokoufandeh,et al.  Indexing hierarchical structures using graph spectra , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Richard Sinkhorn A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices , 1964 .

[8]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  David S. Doermann,et al.  Robust point matching for nonrigid shapes by preserving local neighborhood structures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michael Brady,et al.  Feature-based correspondence: an eigenvector approach , 1992, Image Vis. Comput..

[11]  Edwin R. Hancock,et al.  Correspondence matching using kernel principal components analysis and label consistency constraints , 2006, Pattern Recognit..

[12]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[13]  Zhanyi Hu,et al.  Towards reliable matching of images containing repetitive patterns , 2011, Pattern Recognit. Lett..

[14]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[15]  Claire J. Tomlin,et al.  Versatile spectral methods for point set matching , 2011, Pattern Recognit. Lett..

[16]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  Ping Zhu,et al.  A study of graph spectra for comparing graphs and trees , 2008, Pattern Recognit..

[18]  Francesca Odone,et al.  SVD-matching using SIFT features , 2006, Graph. Model..

[19]  Edwin R. Hancock,et al.  Spectral correspondence for point pattern matching , 2003, Pattern Recognit..