Structure and Semantics of Arrow Diagrams

Arrows are major components of diagrams, where they are typically used to facilitate the communication of spatial and temporal knowledge. An automated interpretation of arrow diagrams would be highly desirable in pen-based interfaces. This paper develops a method for deducing possible interpretations of arrow diagrams, which is composed of a uni-directional arrow symbol and one or more components. Based on a study of the use of arrow diagrams, we classify their semantics into properties, annotations, actions, and conjunctions. Then, we discuss the structural requirements of arrow diagrams for illustrating each class of semantics, as well as the structural rules for adding optional components. Finally, we investigate all possible structures of simple arrow diagrams for each class of semantics and demonstrate that knowledge about the structure of an arrow diagram reduces the ambiguity of its interpretation.

[1]  Thomas F. Stahovich,et al.  Interpreting Schematic Sketches Using Physical Reasoning , 2002 .

[2]  Kenneth D. Forbus,et al.  Sketching for knowledge capture: a progress report , 2002, IUI '02.

[3]  Waldo R. Tobler,et al.  Experiments In Migration Mapping By Computer , 1987 .

[4]  Max J. Egenhofer,et al.  Query Processing in Spatial-Query-by-Sketch , 1997, J. Vis. Lang. Comput..

[5]  Michael Burke,et al.  Information Graphics: Innovative Solutions in Contemporary Design , 1998 .

[6]  Barbara Tversky,et al.  Spatial schemas in depictions , 1999 .

[7]  Max J. Egenhofer,et al.  Identity-based change: a foundation for spatio-temporal knowledge representation , 2000, Int. J. Geogr. Inf. Sci..

[8]  Max J. Egenhofer,et al.  Semantics of Simple Arrow Diagrams , 2005, AAAI Spring Symposium: Reasoning with Mental and External Diagrams: Computational Modeling and Spatial Assistance.

[9]  Frederik P. Agterberg,et al.  Interactive spatial data analysis , 1996 .

[10]  Kenneth D. Forbus,et al.  A Cognitive Approach to Sketch Understanding , 2002 .

[11]  Robert E. Horn,et al.  Visual Language: Global Communication for the 21st Century , 1998 .

[12]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[13]  Paul U. Lee,et al.  Lines, Blobs, Crosses and Arrows: Diagrammatic Communication with Schematic Figures , 2000, Diagrams.

[14]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[15]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[16]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[17]  Colin Blakemore,et al.  Images and understanding : thoughts about images, ideas about understanding , 1990 .

[18]  Randall Davis,et al.  Sketch Understanding in Design: Overview of Work at the MIT AI Lab , 2002 .

[19]  Christine Alvarado,et al.  Resolving ambiguities to create a natural computer-based sketching environment , 2007, SIGGRAPH '07.

[20]  Sharon L. Oviatt,et al.  Multimodal interfaces for dynamic interactive maps , 1996, CHI.

[21]  Seymour Lipschutz,et al.  Schaum's Outline of Theory and Problems of Discrete Mathematics , 1976 .

[22]  Merideth Leigh Gattis,et al.  Spatial schemas and abstract thought , 2001 .

[23]  Volker Haarslev,et al.  Theory and Application of Diagrams , 2003, Lecture Notes in Computer Science.