Differences between Spatial and Visual Mental Representations

This article investigates the relationship between visual mental representations and spatial mental representations in human visuo-spatial processing. By comparing two common theories of visuo-spatial processing – mental model theory and the theory of mental imagery – we identified two open questions: (1) which representations are modality-specific, and (2) what is the role of the two representations in reasoning. Two experiments examining eye movements and preferences for under-specified problems were conducted to investigate these questions. We found that significant spontaneous eye movements along the processed spatial relations occurred only when a visual mental representation is employed, but not with a spatial mental representation. Furthermore, the preferences for the answers of the under-specified problems differed between the two mental representations. The results challenge assumptions made by mental model theory and the theory of mental imagery.

[1]  P. Johnson-Laird.  Mental models and deduction , 2001, Trends in Cognitive Sciences.

[2]  S. Kosslyn.  Image and Brain , 1994 .

[3]  Holger Schultheis,et al.  Variable stability of preferences in spatial reasoning , 2013, Cognitive Processing.

[4]  L. Carlson,et al.  Spatial Reasoning , 2010 .

[5]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[6]  S. Kosslyn,et al.  Different cognitive processes in two image-scanning paradigms , 2006, Memory & cognition.

[7]  Holger Schultheis,et al.  Casimir: An Architecture for Mental Spatial Knowledge Processing , 2011, Top. Cogn. Sci..

[8]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[9]  S. Kosslyn,et al.  Generating visual images: units and relations. , 1983, Journal of experimental psychology. General.

[10]  Holger Schultheis,et al.  The Spatial and the Visual in Mental Spatial Reasoning: An Ill-Posed Distinction , 2006, Spatial Cognition.

[11]  S. Kosslyn.  Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[12]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[13]  Jan Frederik Sima.  The Nature of Mental Images - An Integrative Computational Theory , 2011, CogSci.

[14]  R. Dolan,et al.  Functional neuroanatomy of three-term relational reasoning , 2001, Neuropsychologia.

[15]  Daniel Reisberg,et al.  Can mental images be ambiguous , 1985 .

[16]  P. Johnson-Laird,et al.  Visual imagery can impede reasoning , 2002, Memory & cognition.

[17]  Karl Christoph Klauer,et al.  Double dissociations in visual and spatial short-term memory. , 2004, Journal of experimental psychology. General.

[18]  Philip N. Johnson-Laird,et al.  Imagery, Visualization, and Thinking , 1998 .

[19]  S. Kosslyn.  Scanning visual images:Some structural implications , 1973 .

[20]  Michael J. Spivey,et al.  Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects , 2001, Psychological research.

[21]  Martha J. Farah,et al.  A case study of mental imagery deficit , 1988, Brain and Cognition.

[22]  Andrew U. Frank,et al.  Spatial Information Theory A Theoretical Basis for GIS , 1997, Lecture Notes in Computer Science.

[23]  Richard Dewhurst,et al.  Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. , 2012, Journal of experimental psychology. Human perception and performance.

[24]  Edward E. Smith,et al.  Working Memory: A View from Neuroimaging , 1997, Cognitive Psychology.

[25]  Myeong-Kwan Kevin Cheon,et al.  Frank and I , 2012 .

[26]  Z. Pylyshyn.  Mental imagery: In search of a theory , 2002, Behavioral and Brain Sciences.

[27]  Michael E J Masson,et al.  A tutorial on a practical Bayesian alternative to null-hypothesis significance testing , 2011, Behavior research methods.

[28]  Barry H. Cohen,et al.  Evidence for image-scanning eye movements during transitive inference , 1998, Biological Psychology.

[29]  Jana Holsanova,et al.  Visual and Verbal Focus Patterns when Describing Pictures , 1999 .

[30]  H. Damasio,et al.  Dissociable visual and spatial impairments following right posterior cerebral lesions: Clinical, neuropsychological and anatomical evidence , 1987, Neuropsychologia.

[31]  Roger Johansson,et al.  Pictures and Spoken Descriptions Elicit Similar Eye Movements During Mental Imagery, Both in Light and in Complete Darkness , 2006, Cogn. Sci..

[32]  A. Sack.  Parietal cortex and spatial cognition , 2009, Behavioural Brain Research.

[33]  Cornelius Hagen,et al.  Preferred and Alternative Mental Models in Spatial Reasoning , 2005, Spatial Cogn. Comput..

[34]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[35]  P. Johnson-Laird.  The three-term series problem ☆ , 1972 .

[36]  Leslie G. Ungerleider,et al.  Object and spatial visual working memory activate separate neural systems in human cortex. , 1996, Cerebral cortex.

[37]  S. Kosslyn.  Image and mind , 1982 .

[38]  R. Finke,et al.  Principles of mental imagery , 1989 .

[39]  P. Johnson-Laird,et al.  Reasoning, Models, and Images: Behavioral Measures and Cortical Activity , 2003, Journal of Cognitive Neuroscience.

[40]  D. Levine,et al.  Two visual systems in mental imagery , 1985, Neurology.

[41]  S. Kosslyn,et al.  Functional Anatomy of High-Resolution Visual Mental Imagery , 2000, Journal of Cognitive Neuroscience.

[42]  L. Rips.  The Psychology of Proof: Deductive Reasoning in Human Thinking , 1994 .

[43]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[44]  Christian Freksa,et al.  Towards Computational Cognitive Modeling of Mental Imagery , 2012, KI - Künstliche Intelligenz.

[45]  P. Johnson-Laird,et al.  Preferred mental models in reasoning about spatial relations , 2007, Memory & cognition.