Representational Correspondence as a Basic Principle of Diagram Design

The timeworn claim that a picture is worth a thousand words is generally well-supported by empirical evidence, suggesting that diagrams and other information graphics can enhance human cognitive capacities in a wide range of contexts and applications. But not every picture is worth the space it occupies. What qualities make a diagram an effective and efficient conduit of information to the human mind? In this article we argue that the best diagrams depict information the same way that our internal mental representations do. That is, “visual thinking” operates largely on relatively sketchy, cartoon-like representations of the physical world, translating sensory input into efficient codes before storing and manipulating it. Effective diagrams will assist this process by stripping away irrelevant detail while preserving or highlighting essential information about objects and their spatial relations. We discuss several examples that illustrate this “Representational Correspondence Principle,” and we consider its implications for the design of systems that use diagrams to represent abstract, conceptual knowledge, such as social networks, financial markets, or web content hierarchies.

[1]  M. H. Fischer,et al.  Do irrelevant depth cues affect the comprehension of bar graphs , 2000 .

[2]  Hippolyte Adolphe Taine On Intelligence , 1977 .

[3]  Stephen M. Kosslyn,et al.  Graphics and Human Information Processing: A Review of Five Books , 1985 .

[4]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[5]  G. Rhodes,et al.  Distinctiveness and Expertise Effects with Homogeneous Stimuli: Towards a Model of Configural Coding , 1990, Perception.

[6]  G. Rhodes,et al.  Identification and ratings of caricatures: Implications for mental representations of faces , 1987, Cognitive Psychology.

[7]  Roger N. Shepard,et al.  Visual functions of mental imagery , 1986 .

[8]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[9]  S. J. Segal,et al.  Influence of imaged pictures and sounds on detection of visual and auditory signals. , 1970, Journal of experimental psychology.

[10]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[11]  H. Riedwyl,et al.  Graphical Representation of Multivariate Data by Means of Asymmetrical Faces , 1981 .

[12]  Marc Sageman,et al.  Understanding terror networks. , 2004, International journal of emergency mental health.

[13]  Stephen M. Kosslyn,et al.  Neural Systems Activated during Visual Mental Imagery: A Review and Meta-Analyses , 2000 .

[14]  A. Binet,et al.  Psychologie des grands calculateurs et joueurs d'échecs , 1894 .

[15]  S. Kosslyn,et al.  Neural Systems Shared by Visual Imagery and Visual Perception: A Positron Emission Tomography Study , 1997, NeuroImage.

[16]  Marcia K. Johnson,et al.  Reality Monitoring , 2005 .

[17]  Marcia K. Johnson,et al.  Contextual prerequisites for understanding: Some investigations of comprehension and recall , 1972 .

[18]  B. Scholl Objects and attention: the state of the art , 2001, Cognition.

[19]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[20]  George Steiner Fields of Force: Fischer and Spassky at Reykjavik , 1974 .

[21]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[22]  W. Cleveland,et al.  Graphics and Human Information Processing: A Review of Five Books@@@Semiology of Graphs.@@@Graphical Methods for Data Analysis.@@@Mapping Information.@@@Statistical Graphics.@@@The Visual Display of Quantitative Information. , 1985 .

[23]  R. Fine The psychology of blindfold chess. An introspective account. , 1965, Acta psychologica.

[24]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[25]  Cheves West Perky An Experimental study of imagination. , 1910 .

[26]  S. Kosslyn Image and mind , 1982 .

[27]  A. Snyder,et al.  Autistic Artists Give Clues to Cognition , 1997, Perception.

[28]  A. Binet Mnemonic virtuosity: a study of chess players. , 1966, Genetic psychology monographs.

[29]  S. Rakover Featural vs. configurational information in faces: a conceptual and empirical analysis. , 2002, British journal of psychology.

[30]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[31]  W. Howard Levie,et al.  Effects of text illustrations: A review of research , 1982 .

[32]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[33]  Douglas J. Gillan,et al.  Minimalism and the Syntax of Graphs , 1994 .

[34]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[35]  Bonnie L. Angelone,et al.  Memory for centrally attended changing objects in an incidental real-world change detection paradigm. , 2002, British journal of psychology.

[36]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[37]  B. Marx The Visual Display of Quantitative Information , 1985 .

[38]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[39]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.