Creating Semantic Representations of Diagrams

Diagrams that serve as a visual input facility for programming environments have to be translated into some kind of semantic description. This paper describes such a method which is based on a specification of the translation process. The translation process starts with a diagram, which is simply represented as a collection of atomic diagram components, and it ends up with some data structure as a semantic representation of the diagram. The specification of the translation process mainly consists of two parts: the specification of spatial relationships between atomic diagram components in terms of their numeric parameters (e.g., position, size), and an attributed hypergraph grammar that describes the concrete diagram syntax as well as the rules for generating the semantic representation.

[1]  Mark Minas Diagram editing with hypergraph parser support , 1997, Proceedings. 1997 IEEE Symposium on Visual Languages (Cat. No.97TB100180).

[2]  Mark Minas,et al.  Interaction in really graphical user interfaces , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[3]  Kurt Mehlhorn,et al.  Data Structures and Algorithms 3: Multi-dimensional Searching and Computational Geometry , 2012, EATCS Monographs on Theoretical Computer Science.

[4]  Genny Tortora,et al.  Automatic Generation of Visual Programming Environments , 1995, Computer.

[5]  Mark Minas,et al.  DiaGen: a generator for diagram editors providing direct manipulation and execution of diagrams , 1995, Proceedings of Symposium on Visual Languages.

[6]  Andy Schürr,et al.  Specification of Graph Translators with Triple Graph Grammars , 1994, WG.

[7]  Manfred Nagl,et al.  Graph-Grammars and Their Application to Computer Science , 1982, Lecture Notes in Computer Science.

[8]  Volker Haarslev Formal semantics of visual languages using spatial reasoning , 1995, Proceedings of Symposium on Visual Languages.

[9]  Mark Minas,et al.  Specification of diagram editors providing layout adjustment with minimal change , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[10]  Genny Tortora,et al.  Semantics of visual languages , 1994, AVI '94.

[11]  Andy Schürr,et al.  A graph based framework for the implementation of visual environments , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[12]  M. Minas,et al.  Application of graph transformation to visual languages , 1999 .

[13]  Richard Hall,et al.  Programming with visual expressions , 1995, Proceedings of Symposium on Visual Languages.

[14]  Horst Bunke Attributed Programmed Graph Grammars and Their Application to Schematic Diagram Interpretation , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Herbert Göttler,et al.  Attributed graph grammars for graphics , 1982, Graph-Grammars and Their Application to Computer Science.

[16]  Henk Zeevat,et al.  A syntax directed approach to picture semantics , 1996 .

[17]  Mark Minas Hypergraphs as a Uniform Diagram Representation Model , 1998, TAGT.

[18]  Gregor Engels,et al.  How to represent a visual specification , 1998 .