Geon diagrams: a perception-based method for visualizing structured information

Abstract information is commonly structured, presented and communicated using diagrams. One particular type of diagram that has played a predominant role in the Information Sciences is the node-link diagram. Nodes that represent entities, objects, or units and links that represent relationships of various kinds between the nodes characterize this type of diagram. Visually these nodes are represented using outline forms such as boxes and circles and the links have been depicted with lines consisting of different characteristics. Recent advances in perception present evidence that our visual system is endowed with the capability of recognizing objects from their structural composition. This structure is inherently 3D in nature. This thesis investigates methods for applying these theories to creating diagrams that are more expressive a new kind of diagramming convention called a Geon Diagram. A series of experiments was carried out to evaluate the effectiveness of Geon Diagrams. The results indicate that applying theories of structural object recognition to the construction of node-link diagrams can facilitate identification, recall, and understanding of diagram structures. The benefits are significant in comparison to diagrams created with box-and-line notations, or diagrams with elements consisting of 2D solid outline shapes. The results show that a diagrammatic notation based on perceptual semantics, such as those available from structural object recognition theories, can facilitate expert users in a given problem domain.

[1]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[2]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[3]  Charles W. Bachman,et al.  Data structure diagrams , 1969, DATB.

[4]  Bernice E. Rogowitz,et al.  How not to lie with visualization , 1996 .

[5]  L. C. Vroomen,et al.  Cheops: a compact explorer for complex hierarchies , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[6]  V. Bruce,et al.  Visual Perception: Physiology, Psychology and Ecology , 1985 .

[7]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[8]  Robert J. Hendley,et al.  Narcissus: visualising information , 1995 .

[9]  M. A. Jackson,et al.  Structured Systems Analysis: Tools and Techniques , 1980 .

[10]  Ramana Rao,et al.  Laying out and visualizing large trees using a hyperbolic space , 1994, UIST '94.

[11]  S. Palmer,et al.  Rethinking perceptual organization: The role of uniform connectedness , 1994, Psychonomic bulletin & review.

[12]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[13]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[14]  Ronald A. Rensink,et al.  Influence of scene-based properties on visual search. , 1990, Science.

[15]  Ronald A. Rensink,et al.  Sensitivity To Three-Dimensional Orientation in Visual Search , 1990 .

[16]  H. L. Resnikoff The illusion of reality , 1988 .

[17]  Bernice E. Rogowitz,et al.  Task dependence, veridicality, and preattentive vision: taking advantage of perceptually rich computer environments , 1992, Electronic Imaging.

[18]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[19]  D L Schacter,et al.  Implicit and explicit memory for novel visual objects: structure and function. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[20]  James T. Enns,et al.  Building perceptual textures to visualize multidimensional datasets , 1998 .

[21]  Jock D. Mackinlay,et al.  Information visualization using 3D interactive animation , 1991, CHI.

[22]  Michael Otte,et al.  What is a Text , 1986 .

[23]  Roy R. Behrens Design in the Visual Arts , 1983 .

[24]  E. SenkoM.,et al.  Data structures and accessing in data-base systems , 1973 .

[25]  Richard A. Robb,et al.  Introduction to Visualization , 2000 .

[26]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[27]  A. G. Priest,et al.  New light on novice—expert differences in physics problem solving , 1992 .

[28]  B. Marx The Visual Display of Quantitative Information , 1985 .

[29]  P. Perona,et al.  Preattentive Perception of Elementary Three-dimensional Shapes , 1996, Vision Research.

[30]  J. Piaget The Child's Conception of Number , 1953 .

[31]  E. F. CODD,et al.  A relational model of data for large shared data banks , 1970, CACM.

[32]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[33]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[34]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[35]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[36]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[37]  H. Herne,et al.  How to Lie with Statistics , 1973 .

[38]  G W Humphreys,et al.  The Effects of Surface Detail on Object Categorization and Naming , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[39]  Raymonde Guindon,et al.  Cognitive science and its applications for human-computer interaction , 1988 .

[40]  Xuemin Lin,et al.  How to draw a directed graph , 1989, [Proceedings] 1989 IEEE Workshop on Visual Languages.

[41]  Ganesh S. Oak Information Visualization Introduction , 2022 .

[42]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[43]  Haim Levkowitz,et al.  Perceptual Issues in Visualization , 1995, IFIP Series on Computer Graphics.

[44]  H. Goldstine,et al.  The Computer from Pascal to von Neumann , 1974 .

[45]  Andreas Buja,et al.  Interactive High-Dimensional Data Visualization , 1996 .

[46]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..

[47]  Thomas Erickson,et al.  Working with interface metaphors , 1995 .

[48]  G. Bower,et al.  Comprehension and memory for pictures , 1975, Memory & cognition.

[49]  N. Hari Narayanan,et al.  Diagrammatic Reasoning: Cognitive and Computational Perspectives , 1995 .

[50]  Mark A. Georgeson,et al.  Visual perception : physiology, psychology, & ecology , 2003 .

[51]  Peter P. Chen The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[52]  E. Gombrich ART AND ILLUSION: A STUDY IN THE PSYCHOLOGY OF PICTORIAL REPRESENTATION. , 1960 .

[53]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[54]  William A. Wallace,et al.  The Effects of 3D Imagery on Managerial Data Interpretation , 1986, MIS Q..

[55]  David S. Ebert,et al.  Using shape to visualize multivariate data , 1999, NPIVM '99.

[56]  James Abello,et al.  Visualizing massive multi-digraphs , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[57]  David Harel,et al.  On visual formalisms , 1988, CACM.

[58]  Ioannis G. Tollis,et al.  A framework for dynamic graph drawing , 1992, SCG '92.

[59]  David G. Durand,et al.  What is text, really? , 1990, J. Comput. High. Educ..

[60]  Stephen G. Eick,et al.  Seesoft-A Tool For Visualizing Line Oriented Software Statistics , 1992, IEEE Trans. Software Eng..

[61]  Haim Levkowitz,et al.  Color scales for image data , 1992, IEEE Computer Graphics and Applications.

[62]  André Skupin,et al.  From metaphor to method: cartographic perspectives on information visualization , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[63]  Oliver Saal,et al.  Visualisation of ATM network connectivity and topology , 2001 .

[64]  Bill Hibbard,et al.  Top ten visualization problems , 1999, COMG.

[65]  M. Goodale Image and Brain: The Resolution of the Imagery Debate , 1995 .

[66]  V. Coltheart Fleeting memories : cognition of brief visual stimuli , 1999 .

[67]  Peter C.-H. Cheng Scientific Discovery With Law-Encoding Diagrams , 1996 .

[68]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[69]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[70]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[71]  Colin Ware,et al.  Representing nodes and arcs in 3D networks , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[72]  David C. Banks,et al.  Visualizing a tennis match , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[73]  Jock D. Mackinlay,et al.  Cone Trees: animated 3D visualizations of hierarchical information , 1991, CHI.

[74]  M. Sheelagh T. Carpendale,et al.  3-dimensional pliable surfaces: for the effective presentation of visual information , 1995, UIST '95.

[75]  Grady Booch,et al.  Object-Oriented Analysis and Design with Applications , 1990 .

[76]  B. Shneiderman Designing the User Interface (3rd Ed.) , 1998 .

[77]  J. Albers,et al.  Interaction of Color , 1971 .

[78]  Stephen G. Eick,et al.  Visualization's new tack: making sense of information. ieee spectrum, 32(11):38-56 , 1995 .

[79]  R. W. Driver,et al.  The Influence of Computer Graphics on the Recall of Information , 1983, MIS Q..

[80]  H. Komatsu,et al.  Influence of the Direction of Elemental Luminance Gradients on the Responses of V4 Cells to Textured Surfaces , 2001, The Journal of Neuroscience.

[81]  Steven K. Feiner,et al.  AutoVisual: rule-based design of interactive multivariate visualizations , 1993, IEEE Computer Graphics and Applications.

[82]  David A. Scanlan Structured flowcharts outperform pseudocode: an experimental comparison , 1989, IEEE Software.

[83]  Keith Andrews,et al.  Information Slices: Visualising and Exploring Large Hierarchies using Cascading, Semi-Circular Discs , 1998 .

[84]  Bruce Powel Douglass Real-Time UML , 2002, FTRTFT.

[85]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[86]  James J. Thomas,et al.  Visualizing the non-visual: spatial analysis and interaction with information from text documents , 1995, Proceedings of Visualization 1995 Conference.

[87]  William Knight,et al.  Orderable dimensions of visual texture for data display: orientation, size and contrast , 1992, CHI.

[88]  J. Halverson,et al.  The First Pictures: Perceptual Foundations of Paleolithic Art , 1992, Perception.

[89]  J. B. Brooke,et al.  An experimental study of flowcharts as an aid to identification of procedural faults , 1980 .

[90]  Stuart J. Rose The sunflower visual metaphor, a new paradigm for dimensional compression , 1999, Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99).

[91]  R. Shepard,et al.  Turning something over in the mind. , 1984, Scientific American.

[92]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[93]  Irving Biederman,et al.  One-shot viewpoint invariance in matching novel objects , 1999, Vision Research.

[94]  Jock D. Mackinlay,et al.  Visualizing the evolution of Web ecologies , 1998, CHI.

[95]  Kendall Scott,et al.  UML distilled - applying the standard object modeling language , 1997 .

[96]  S. Edelman Representation of Similarity in 3D Object Discrimination , 1995 .

[97]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[98]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[99]  Graham J. Wills NicheWorks—Interactive Visualization of Very Large Graphs , 1999 .

[100]  Chris Marshall,et al.  Enterprise modeling with UML: designing successful software through business analysis , 2000 .

[101]  Tamara Munzner,et al.  H3: laying out large directed graphs in 3D hyperbolic space , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[102]  D. Papadias,et al.  Computational Imagery , 1992, Cogn. Sci..

[103]  Eric Freeman,et al.  Lifestreams: Organizing your Electronic Life* , 1995 .

[104]  Kenneth D. Forbus,et al.  Qualitative Spatial Reasoning: The Clock Project , 1991, Artif. Intell..

[105]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[106]  I. Biederman,et al.  Viewpoint-dependent mechanisms in visual object recognition: Reply to Tarr and Bülthoff (1995). , 1995 .

[107]  J. Braun Shape-from-shading is independent of visual attention and may be a 'texton'. , 1993, Spatial vision.

[108]  Gary Marchionini,et al.  Visualizing websites using a hierarchical table of contents browser:WebTOC , 1998 .

[109]  Bernice E. Rogowitz,et al.  Data visualization: the end of the rainbow , 1998 .

[110]  William E. Lorensen,et al.  Object-Oriented Modeling and Design , 1991, TOOLS.

[111]  Richard Lowe,et al.  Selectivity in diagrams: reading beyond the lines , 1994 .

[112]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[113]  Colin Ware,et al.  Evaluating stereo and motion cues for visualizing information nets in three dimensions , 1996, TOGS.

[114]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[115]  Nahum D. Gershon,et al.  Information Visualization Applications in the Real World , 1997, IEEE Computer Graphics and Applications.

[116]  Brian V. Funt,et al.  Problem-Solving with Diagrammatic Representations , 1980, Artif. Intell..

[117]  Lucy T. Nowell,et al.  ThemeRiver: visualizing theme changes over time , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[118]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[119]  George W. Furnas,et al.  Semnet: three-dimensional graphic representa-tions of large knowledge bases , 1990 .

[120]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[121]  J. B. Brooke,et al.  Experimental studies of flowchart use at different stages of program debugging , 1980 .

[122]  H. Intraub The representation of visual scenes , 1997, Trends in Cognitive Sciences.

[123]  David S. Ebert,et al.  A Shape-Based Visual Interface for Text Retrieval , 1999, IEEE Computer Graphics and Applications.

[124]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[125]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[126]  Edward Tufte,et al.  Visual Explanations , 1997 .

[127]  William Knight,et al.  Using visual texture for information display , 1995, TOGS.

[128]  Manojit Sarkar,et al.  Graphical fisheye views , 1994, CACM.

[129]  A. M. Triesman,et al.  Preattentive processing in vision , 1985 .

[130]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[131]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[132]  Glyn W. Humphreys,et al.  Object and face recognition , 1994 .

[133]  Cay S. Horstmann Computing Concepts with Java 2 Essentials / with CD , 2000 .

[134]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[135]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[136]  Allan R. Wilks,et al.  Visualizing Network Data , 1995, IEEE Trans. Vis. Comput. Graph..

[137]  Marian Petre,et al.  Why looking isn't always seeing: readership skills and graphical programming , 1995, CACM.

[138]  Kenneth C. Cox,et al.  3D geographic network displays , 1996, SGMD.

[139]  P. Johnson-Laird,et al.  PSYCHOLOGICAL SCIENCE Research Article HOW DIAGRAMS CAN IMPROVE REASONING , 2022 .

[140]  Michael E. Senko,et al.  Data Structures and Accessing in Data-Base Systems. I: Evolution of Information Systems , 1973, IBM Syst. J..