An Incremental Parser to Recognize Diagram Symbols and Gestures Represented by Adjacency Grammars

Syntactic approaches on structural symbol recognition are characterized by defining symbols using a grammar. Following the grammar productions a parser is constructed to recognize symbols: given an input, the parser detects whether it belongs to the language generated by the grammar, recognizing the symbol, or not. In this paper, we describe a parsing methodology to recognize a set of symbols represented by an adjacency grammar. An adjacency grammar is a grammar that describes a symbol in terms of the primitives that form it and the relations among these primitives. These relations are called constraints, which are validated using a defined cost function. The cost function approximates the distortion degree associated to the constraint. When a symbol has been recognized the cost associated to the symbol is like a similarity value. The evaluation of the method has been realized from a qualitative point of view, asking some users to draw some sketches. From a quantitative point of view a benchmarking database of sketched symbols has been used.

[1]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[2]  Yves Lecourtier,et al.  Combination of Invariant Pattern Recognition Primitives on Technical Documents , 1999, GREC.

[3]  Josep Lladós,et al.  An Adjacency Grammar to Recognize Symbols and Gestures in a Digital Pen Framework , 2005, IbPRIA.

[4]  Ehud Rivlin,et al.  Applying algebraic and differential invariants for logo recognition , 1996 .

[5]  Gennaro Costagliola,et al.  Visual Language Editors based on LR Parsing Techniques , 2003, IWPT.

[6]  Horst Bunke Attributed Programmed Graph Grammars and Their Application to Schematic Diagram Interpretation , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Kim Marriott,et al.  Automatic construction of user interfaces from constraint multiset grammars , 1995, Proceedings of Symposium on Visual Languages.

[8]  Dorothea Blostein,et al.  A graph grammar programming style for recognition of music notation , 1993, Machine Vision and Applications.

[9]  Wenyin Liu,et al.  Sketch-Based User Interface for Inputting Graphic Objects on Small Screen Devices , 2001, GREC.

[10]  Ernest Valveny,et al.  A Platform to Extract Knowledge from Graphic Documents. Application to an Architectural Sketch Understanding Scenario , 2004, Document Analysis Systems.

[11]  Ephraim P. Glinert,et al.  Online parsing of visual languages using adjacency grammars , 1995, Proceedings of Symposium on Visual Languages.

[12]  Joaquim A. Jorge,et al.  JavaSketchIt: Issues in Sketching the Look of User Interfaces , 2002 .

[13]  Suzanne Collin,et al.  Syntactic Analysis of Technical Drawing Dimensions , 1994, Int. J. Pattern Recognit. Artif. Intell..