Common visual pattern discovery via directed graph model

In this paper, a novel directed graph (or digraph) model-based approach is proposed to discover visual patterns commonly shared by two images. Unlike the conventional undirected graph model with only one weight value on each link, the directed graph model has two link weights, one for each direction of the link. In our work, it takes two phases to compute the link weights. First, the principle of pairwise spatial consistency is exploited to generate the initial link weights. The entire initial weights are then modified to generate the relative link weights by further considering the “relativeness” of neighboring vertices for each vertex using our proposed n-ranking value. Consequently, the resulted relative link weights are more robust to combat various commonly encountered scenarios such as large viewpoint variations and inaccurate feature descriptors. Based on the relative link weights, the strongly-connected subgraph for each scale value under consideration is then extracted from the graph by applying the non-cooperative game theory for handling non-symmetric adjacency matrix issue. All the vertices (i.e., point-to-point feature correspondences) belonging to the subgraph are collectively denoted as one common visual pattern. Preliminary simulation results have reasonably demonstrated the efficacy and robustness of the proposed method on discovering common visual patterns.

[1]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[2]  Andrea Torsello,et al.  Grouping with Asymmetric Affinities: A Game-Theoretic Perspective , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Jean Ponce,et al.  A Tensor-Based Algorithm for High-Order Graph Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Fredrik Kahl,et al.  Optimal correspondences from pairwise constraints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Shuicheng Yan,et al.  Common visual pattern discovery via spatially coherent correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Alexei A. Efros,et al.  Using Multiple Segmentations to Discover Objects and their Extent in Image Collections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.