Using Perceptual Syntax to Enhance Semantic Content in Diagrams

Diagrams are essential in documenting large information systems. They capture, communicate, and leverage knowledge indispensable for solving problems and act as cognitive externalizations (intertwining internal and external processes to extract information from the external world to enhance thought). A diagram provides a mapping from the problem domain to the visual representation by supporting cognitive processes that involve perceptual pattern finding and cognitive symbolic operations. However, not all mappings are equal, and for effectiveness we must embed a diagram's representation with characteristics, which lets users easily perceive meaningful patterns. Consequently, a diagram's effectiveness depends to some extent on how well we construct it as an input to our visual system. In our research, we focus on a class of diagrams commonly referred to as graphs or node-link diagrams. Nodes representing entities, objects, or processes, and links or edges representing relationships between the nodes characterize them. Their most common form is outline circles or boxes denoting nodes and lines of different types representing links between the nodes. Entity-relationship diagrams, software structure diagrams, and data-flow models are examples of node-link diagrams used to model the structure of processes, software, or data.

[1]  Cay S. Horstmann Computing Concepts with Java Essentials , 1997 .

[2]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[3]  Chris Marshall,et al.  Enterprise modeling with UML: designing successful software through business analysis , 2000 .

[4]  Marian Petre,et al.  Why looking isn't always seeing: readership skills and graphical programming , 1995, CACM.

[5]  Pourang Irani,et al.  Diagrams based on structural object perception , 2000, AVI '00.

[6]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[7]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[8]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[9]  Jiajie Zhang,et al.  The Nature of External Representations in Problem Solving , 1997, Cogn. Sci..

[10]  Karl. S. Bernhardt,et al.  The Child'S Conception of Number , 1954 .

[11]  D. Papadias,et al.  Computational Imagery , 1992, Cogn. Sci..

[12]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[13]  J. Piaget,et al.  The Child's Conception of Number , 1953 .

[14]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[15]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[16]  N. Hari Narayanan,et al.  Diagrammatic Reasoning: Cognitive and Computational Perspectives , 1995 .

[17]  Pourang Irani,et al.  Should the Elements of Diagrams Be Rendered in 3D , 2000 .

[18]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[19]  Kendall Scott,et al.  UML distilled - applying the standard object modeling language , 1997 .

[20]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  Bruce Powel Douglass Real-Time UML , 2002, FTRTFT.

[22]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[23]  Kendall Scott,et al.  UML distilled - a brief guide to the Standard Object Modeling Language (2. ed.) , 2000, notThenot Addison-Wesley object technology series.

[24]  I. Biederman,et al.  Recognizing depth-rotated objects: evidence and conditions for three-dimensional viewpoint invariance. , 1993, Journal of experimental psychology. Human perception and performance.

[25]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .