Object categorization using bone graphs

The bone graph (Macrini et al., in press, 2008) [23,25] is a graph-based medial shape abstraction that offers improved stability over shock graphs and other skeleton-based descriptions that retain unstable ligature structure. Unlike the shock graph, the bone graph's edges are attributed, allowing a richer specification of relational information, including how and where two medial parts meet. In this paper, we propose a novel shape matching algorithm that exploits this relational information. Formulating the problem as an inexact directed acyclic graph matching problem, we extend a leading bipartite graph-based algorithm for matching shock graphs (Siddiqi et al., 1999) [41]. In addition to accommodating the relational information, our new algorithm is better able to enforce hierarchical and sibling constraints between nodes, resulting in a more general and more powerful matching algorithm. We evaluate our algorithm with respect to a competing shock graph-based matching algorithm, and show that for the task of view-based object categorization, our algorithm applied to bone graphs outperforms the competing algorithm. Moreover, our algorithm applied to shock graphs also outperforms the competing shock graph matching algorithm, demonstrating the generality and improved performance of our matching algorithm.

[1]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[2]  Robert E. Tarjan,et al.  Faster scaling algorithms for general graph matching problems , 1991, JACM.

[3]  M. Fatih Demirci,et al.  Object Recognition as Many-to-Many Feature Matching , 2006, International Journal of Computer Vision.

[4]  P. Anandan,et al.  Optimization in Model Matching and Perceptual Organization , 1989, Neural Computation.

[5]  Václav Koubek,et al.  A Reduct-and-Closure Algorithm for Graphs , 1979, MFCS.

[6]  Edwin R. Hancock,et al.  Efficiently Computing Weighted Tree Edit Distance Using Relaxation Labeling , 2001, EMMCVPR.

[7]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Linda G. Shapiro,et al.  Identification of Space Curves from Two-Dimensional Perspective Views , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  M. Fatih Demirci,et al.  The Representation and Matching of Images Using Top Points , 2009, Journal of Mathematical Imaging and Vision.

[11]  Horst Bunke,et al.  On a relation between graph edit distance and maximum common subgraph , 1997, Pattern Recognit. Lett..

[12]  Kaleem Siddiqi,et al.  Many-to-many Matching of Attributed Trees Using Association Graphs and Game Dynamics , 2001, IWVF.

[13]  Josef Kittler,et al.  Combining Evidence in Probabilistic Relaxation , 1989, Int. J. Pattern Recognit. Artif. Intell..

[14]  Ali Shokoufandeh,et al.  A Unified Framework for Indexing and Matching Hierarchical Shape Structures , 2001, IWVF.

[15]  Edwin R. Hancock,et al.  Bayesian graph edit distance , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[16]  William J. Christmas,et al.  Structural Matching in Computer Vision Using Probabilistic Relaxation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Kaleem Siddiqi,et al.  Attributed tree matching and maximum weight cliques , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[18]  S. Zucker,et al.  Continuous-based Heuristics for Graph and Tree Isomorphisms, with Application to Computer Vision , 2000 .

[19]  Sven J. Dickinson,et al.  From skeletons to bone graphs: Medial abstraction for object recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Edwin R. Hancock,et al.  Structural Matching by Discrete Relaxation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Sven J. Dickinson,et al.  Canonical Skeletons for Shape Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Mario Vento,et al.  How and Why Pattern Recognition and Computer Vision Applications Use Graphs , 2007, Applied Graph Theory in Computer Vision and Pattern Recognition.

[24]  M. Fatih Demirci,et al.  The representation and matching of categorical shape , 2006, Comput. Vis. Image Underst..

[25]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[26]  Aykut Erdem,et al.  Dissimilarity between two skeletal trees in a context , 2009, Pattern Recognit..

[27]  Sven J. Dickinson,et al.  Bone graphs: Medial shape parsing and abstraction , 2011, Comput. Vis. Image Underst..

[28]  Longin Jan Latecki,et al.  Path Similarity Skeleton Graph Matching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Leonidas J. Guibas,et al.  The Earth Mover's Distance under transformation sets , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  M. Fatih Demirci,et al.  Skeletal Shape Abstraction from Examples , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Benoit Huet,et al.  Shape recognition from large image libraries by inexact graph matching , 1999, Pattern Recognit. Lett..

[32]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  J. Köbler,et al.  The Graph Isomorphism Problem: Its Structural Complexity , 1993 .

[34]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[35]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[36]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[37]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[38]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark (Figures 1 and 2) , 2004, Shape Modeling International Conference.

[39]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[40]  PaperNo Recognition of shapes by editing shock graphs , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[41]  Alan L. Yuille,et al.  FORMS: A flexible object recognition and modelling system , 1996, International Journal of Computer Vision.

[42]  Edwin R. Hancock,et al.  Structural Graph Matching Using the EM Algorithm and Singular Value Decomposition , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[44]  Ali Shokoufandeh,et al.  Indexing hierarchical structures using graph spectra , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Ali Shokoufandeh,et al.  View-based 3-D object recognition using shock graphs , 2002, Object recognition supported by user interaction for service robots.