Cognitive Questions in Software Visualisation

Software visualisation is nifty stuff; but is it the powerful cognitive tool it is often assumed to be? This chapter attempts to moderate the understandable enthusiasm for software visualisation and to raise some of the questions for which the discipline doesn’t yet have answers. The chapter is structured as a list of questions with discussion. The questions are not a comprehensive analysis of cognitive challenges in software visualisation. Rather, the chapter attempts to provide a list sufficiently provocative to give designers pause, in order:

[1]  Donis A. Dondis.  A primer of visual literacy , 1973 .

[2]  C. Trevarthen.  Review: Cognition and Reality: Principles and Implications of Cognitive Psychology , 1977 .

[3]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[4]  Betty Edwards.  Drawing on the right side of the brain , 1981 .

[5]  James L. Alty,et al.  Computing Skills and the User Interface , 1981 .

[6]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[7]  Donald E. Knuth,et al.  Literate Programming , 1984, Comput. J..

[8]  Kate Ehrlich,et al.  Empirical Studies of Programming Knowledge , 1984, IEEE Transactions on Software Engineering.

[9]  S. Ullman.  Visual routines , 1984, Cognition.

[10]  Elliot Soloway,et al.  From Problems to Programs via Plans: The Content and Structure of Knowledge for Introductory LISP Programming , 1985 .

[11]  Robert Sedgewick,et al.  Techniques for Algorithm Animation , 1985, IEEE Software.

[12]  Gabriele Rohr.  Using Visual Concepts , 1986 .

[13]  Nancy Pennington,et al.  Comprehension strategies in programming , 1987 .

[14]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[15]  Rachel K. E. Bellamy,et al.  Parsing and Gnisrap: a model of device use , 1987 .

[16]  John R. Anderson,et al.  Change-episodes in coding: when and how do programmers change their code? , 1987 .

[17]  Shi-Kuo Chang,et al.  Principles of Visual Programming Systems , 1989 .

[18]  S. Kosslyn.  Understanding charts and graphs , 1989 .

[19]  I. Gordon.  Theories of Visual Perception , 1989 .

[20]  Jeffrey G. Bonar,et al.  A visual programming language for novices , 1990 .

[21]  Joan K. Gallini,et al.  When Is an Illustration Worth Ten Thousand Words , 1990 .

[22]  Thomas R. G. Green,et al.  Cognitive dimensions of notations , 1990 .

[23]  Brad A. Myers,et al.  Taxonomies of visual programming and program visualization , 1990, J. Vis. Lang. Comput..

[24]  Nancy Pennington,et al.  The Tasks of Programming , 1990 .

[25]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[26]  Scott P. Robertson,et al.  Program comprehension beyond the line , 1990, IFIP TC13 International Conference on Human-Computer Interaction.

[27]  B. Tversky,et al.  Cross-cultural and developmental trends in graphic productions , 1991, Cognitive Psychology.

[28]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[29]  Marian Petre,et al.  What experts want from programming languages , 1991 .

[30]  Mary Beth Rosson,et al.  The task-artifact cycle , 1991 .

[31]  John M. Carroll,et al.  Designing Interaction: Psychology at the Human-Computer Interface , 1991 .

[32]  Ann Jones.  Conceptual models of programming environments: how learners use the glass box , 1992 .

[33]  Marian Petre,et al.  Learning to Read Graphics: Some Evidence that 'Seeing' an Information Display is an Acquired Skill , 1993, J. Vis. Lang. Comput..

[34]  James C. Spohrer,et al.  Empirical Studies of Programmers: Fifth Workshop , 1993 .

[35]  P. Johnson-Laird,et al.  PSYCHOLOGICAL SCIENCE Research Article HOW DIAGRAMS CAN IMPROVE REASONING , 2022 .

[36]  S. Palmer,et al.  Rethinking perceptual organization: The role of uniform connectedness , 1994, Psychonomic bulletin & review.

[37]  José J. Cañas,et al.  Mental models and computer programming , 1994, Int. J. Hum. Comput. Stud..

[38]  Maria Vargas-Vera,et al.  Applying Prolog programming techniques , 1994, Int. J. Hum. Comput. Stud..

[39]  Christopher D. Wickens,et al.  The Proximity Compatibility Principle: Its Psychological Foundation and Relevance to Display Design , 1995, Hum. Factors.

[40]  Jon Oberlander,et al.  A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation , 1995, Cogn. Sci..

[41]  Richard Cox,et al.  Contrasting the cognitive effects of graphical and sentential logic teaching: Reasoning, representation and individual differences , 1995 .

[42]  Jon Oberlander.  Grice for graphics: Pragmatic implicature in network diagrams , 1995 .

[43]  Paul Brna,et al.  Supporting the use of external representation in problem solving: the need for flexible learning environments , 1995 .

[44]  Marian Petre,et al.  Why looking isn't always seeing: readership skills and graphical programming , 1995, CACM.

[45]  P. Carpenter,et al.  Conceptual limitations in comprehending line graphs. , 1995 .

[46]  Deborah A. Boehm-Davis,et al.  Empirical Studies of Programmers: Sixth Workshop , 1996 .

[47]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[48]  K. Holyoak,et al.  Mapping conceptual to spatial relations in visual reasoning. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[49]  T. Ormerod,et al.  Human performance on the traveling salesman problem , 1996, Perception & psychophysics.

[50]  M. Petre,et al.  Usability Analysis of Visual Programming Environments , 1996 .

[51]  Alan F. Blackwell,et al.  Metacognitive theories of visual programming: what do we think we are doing? , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[52]  Tim O'Shea,et al.  The black box inside the glass box: presenting computing concepts to novices , 1999, Int. J. Hum. Comput. Stud..

[53]  Brian Bomeisler,et al.  Drawing on the right side of the brain , 1999, CHI Extended Abstracts.