Connecting Internal and External Representations: Spatial Transformations of Scientific Visualizations

Many scientific discoveries have depended on external diagrams or visualizations. Many scientists also report to use an internal mental representation or mental imagery to help them solve problems and reason. How do scientists connect these internal and external representations? We examined working scientists as they worked on external scientific visualizations. We coded the number and type of spatial transformations (mental operations that scientists used on internal or external representations or images) and found that there were a very large number of comparisons, either between different visualizations or between a visualization and the scientists’ internal mental representation. We found that when scientists compared visualization to visualization, the comparisons were based primarily on features. However, when scientists compared a visualization to their mental representation, they were attempting to align the two representations. We suggest that this alignment process is how scientists connect internal and external representations.

[1]  M. Hegarty Mental animation: inferring motion from static displays of mechanical systems. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[2]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[3]  Nigel J. T. Thomas Are theories of imagery theories of imagination?: An active perception approach to conscious mental content , 1999 .

[4]  Susan Bell Trickett,et al.  A New Model of Graph and Visualization Usage , 2001 .

[5]  S. Kosslyn,et al.  Squinting with the mind’s eye: Effects of stimulus resolution on imaginal and perceptual comparisons , 1999, Memory & cognition.

[6]  J. Gregory Trafton,et al.  Turning pictures into numbers: extracting and generating information from complex visualizations , 2000, Int. J. Hum. Comput. Stud..

[7]  Alexander Findlay,et al.  A Hundred Years Of Chemistry , 1948 .

[8]  Dedre Gentner,et al.  Mechanisms of Analogical Learning. , 1987 .

[9]  Nancy J. Nersessian,et al.  Model-Based Reasoning in Conceptual Change , 1999 .

[10]  Arthur B. Markman,et al.  Analogical Reasoning and Conceptual Change: A Case Study of Johannes Kepler , 1997 .

[11]  K. Dunbar How scientists think: On-line creativity and conceptual change in science. , 1997 .

[12]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[13]  Wai-Tat Fu,et al.  From Dipsy-Doodle to Streaming Motions: Changes in Representation in the Analysis of Visual Scientific Data , 2000 .

[14]  Craig A. Kaplan,et al.  In search of insight , 1990, Cognitive Psychology.

[15]  D. Gentner Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[16]  J. Kemeny Man Viewed as a Machine , 1955 .

[17]  J. Hadamard,et al.  The Psychology of Invention in the Mathematical Field. , 1945 .