Error-Tolerant Coarse-to-Fine Matching Model for Hierarchical Graphs

Graph-based representations are effective tools to capture structural information from visual elements. However, retrieving a query graph from a large database of graphs implies a high computational complexity. Moreover, these representations are very sensitive to noise or small changes. In this work, a novel hierarchical graph representation is designed. Using graph clustering techniques adapted from graph-based social media analysis, we propose to generate a hierarchy able to deal with different levels of abstraction while keeping information about the topology. For the proposed representations, a coarse-to-fine matching method is defined. These approaches are validated using real scenarios such as classification of colour images and handwritten word spotting.

[1]  Alicia Fornés,et al.  Large-scale graph indexing using binary embeddings of node contexts for information spotting in document image databases , 2017, Pattern Recognit. Lett..

[2]  Ernest Valveny,et al.  Word Spotting and Recognition with Embedded Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Fernando De la Torre,et al.  Factorized Graph Matching , 2016, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Philip S. Yu,et al.  Graph indexing: a frequent structure-based approach , 2004, SIGMOD '04.

[5]  Narendra Ahuja,et al.  From Region Based Image Representation to Object Discovery and Recognition , 2010, SSPR/SPR.

[6]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Xuelong Li,et al.  A survey of graph edit distance , 2010, Pattern Analysis and Applications.

[8]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[9]  Jean-Michel Jolion,et al.  A graph-based, multi-resolution algorithm for tracking objects in presence of occlusions , 2005, Pattern Recognit..

[10]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[11]  Sergio Escalera,et al.  Blurred Shape Model for binary and grey-level symbol recognition , 2009, Pattern Recognit. Lett..

[12]  Luc Brun,et al.  Contains and inside relationships within combinatorial pyramids , 2006, Pattern Recognit..

[13]  Alicia Fornés,et al.  Large-Scale Graph Indexing Using Binary Embeddings of Node Contexts , 2015, GbRPR.

[14]  Josep Lladós,et al.  Hierarchical Plausibility-Graphs for Symbol Spotting in Graphical Documents , 2013, GREC.

[15]  Abdolreza Mirzaei,et al.  Hierarchical graph embedding in vector space by graph pyramid , 2017, Pattern Recognit..

[16]  Alicia Forn BH2M: the Barcelona Historical Handwritten Marriages database , 2014 .

[17]  Alicia Fornés,et al.  Handwritten word spotting by inexact matching of grapheme graphs , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[18]  Dennis Shasha,et al.  Algorithmics and applications of tree and graph searching , 2002, PODS.

[19]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[20]  Kaspar Riesen,et al.  Approximate graph edit distance computation by means of bipartite graph matching , 2009, Image Vis. Comput..