Language, perception, and the schematic representation of spatial relations

Schemas are abstract nonverbal representations that parsimoniously depict spatial relations. Despite their ubiquitous use in maps and diagrams, little is known about their neural instantiation. We sought to determine the extent to which schematic representations are neurally distinguished from language on the one hand, and from rich perceptual representations on the other. In patients with either left hemisphere damage or right hemisphere damage, a battery of matching tasks depicting categorical spatial relations was used to probe for the comprehension of basic spatial concepts across distinct representational formats (words, pictures, and schemas). Left hemisphere patients underperformed right hemisphere patients across all tasks. However, focused residual analyses using voxel-based lesion-symptom mapping (VLSM) suggest that (1) left hemisphere deficits in the representation of categorical spatial relations are difficult to distinguish from deficits in naming these relations and (2) the right hemisphere plays a special role in extracting schematic representations from richly textured pictures.

[1]  M. Sliwinski,et al.  Development and validation of a model for estimating premorbid verbal intelligence in the elderly. , 1991, Journal of clinical and experimental neuropsychology.

[2]  Drew McDermott,et al.  A critique of pure reason 1 , 1987, The Philosophy of Artificial Intelligence.

[3]  Anjan Chatterjee,et al.  Language and space: some interactions , 2001, Trends in Cognitive Sciences.

[4]  G. Lakoff.  Philosophy in the flesh , 1999 .

[5]  P. Quinn,et al.  Development of Categorical Representations for "Above" and "Below" Spatial Relations in 3- to 7-Month-Old Infants. , 1996 .

[6]  D. Tranel,et al.  Neuroanatomical correlates of locative prepositions , 2004, Cognitive neuropsychology.

[7]  J. Mandler,et al.  Understanding spatial relations: Flexible infants, lexical adults , 2003, Cognitive Psychology.

[8]  Merideth Leigh Gattis,et al.  Spatial schemas and abstract thought , 2001 .

[9]  Anjan Chatterjee,et al.  The Neural Basis for Spatial Relations , 2010, Journal of Cognitive Neuroscience.

[10]  C. Peirce,et al.  Philosophical Writings of Peirce , 1955 .

[11]  Loyal Jones,et al.  Remembering , 1975, IEEE Power Engineering Review.

[12]  R. Jackendoff.  The architecture of the linguistic-spatial interface , 1996 .

[13]  A. Chatterjee.  The neural organization of spatial thought and language. , 2008, Seminars in speech and language.

[14]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[15]  Volker Haarslev,et al.  Theory and Application of Diagrams , 2003, Lecture Notes in Computer Science.

[16]  Leonard Talmy,et al.  Toward a cognitive semantics, Vol. 1: Concept structuring systems. , 2000 .

[17]  J. Mandler.  How to build a baby: II. Conceptual primitives. , 1992, Psychological review.

[18]  A. Damasio,et al.  Neural Correlates of Naming Actions and of Naming Spatial Relations , 2001, NeuroImage.

[19]  Anjan Chatterjee,et al.  The Functional Neuroanatomy of Thematic Role and Locative Relational Knowledge , 2007, Journal of Cognitive Neuroscience.

[20]  Karen Emmorey,et al.  Neural Systems Underlying Spatial Language in American Sign Language , 2002, NeuroImage.

[21]  C. Rorden,et al.  Stereotaxic display of brain lesions. , 2000, Behavioural neurology.

[22]  Angela D. Friederici,et al.  Production and comprehension of prepositions in aphasia , 1981, Neuropsychologia.

[23]  Mark Rowlands,et al.  The body in mind , 1999 .

[24]  B. Landau,et al.  “What” and “where” in spatial language and spatial cognition , 1993 .

[25]  M. Nicholls,et al.  The greyscales task: a perceptual measure of attentional bias following unilateral hemispheric damage , 2004, Neuropsychologia.

[26]  C. Smith.  The emergence of ‘maps’ in European rock art: A prehistoric preoccupation with place 1 , 1982 .

[27]  S. Kosslyn,et al.  Neural systems that encode categorical versus coordinate spatial relations: PET investigations , 1998, Psychobiology.

[28]  S. Levinson,et al.  LANGUAGE AND SPACE , 1996 .

[29]  Amy Needham,et al.  Intuitions about support in 4.5-month-old infants , 1993, Cognition.

[30]  C. B. Cave,et al.  Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. , 1989, Journal of experimental psychology. Human perception and performance.

[31]  J. Mandler.  Perceptual and Conceptual Processes in Infancy , 2000 .

[32]  Alejna Brugos,et al.  Proceedings of the 28th annual Boston University Conference on Language Development , 2004 .

[33]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[34]  Barbara Tversky,et al.  Spatial schemas in depictions , 1999 .

[35]  Nadine Martin,et al.  Access to knowledge from pictures but not words in a patient with progressive fluent aphasia , 2003 .

[36]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[37]  Mark L. Johnson.  The body in the mind: the bodily basis of meaning , 1987 .

[38]  Paul U. Lee,et al.  Lines, Blobs, Crosses and Arrows: Diagrammatic Communication with Schematic Figures , 2000, Diagrams.

[39]  D. Tranel,et al.  A DOUBLE DISSOCIATION BETWEEN LINGUISTIC AND PERCEPTUAL REPRESENTATIONS OF SPATIAL RELATIONSHIPS , 2000, Cognitive neuropsychology.

[40]  S. Neggers,et al.  Neural correlates of locative prepositions , 2008, Neuropsychologia.

[41]  Renee L Baillargeon,et al.  Physical reasoning in young infants: Seeking explanations for impossible events , 1994 .

[42]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[43]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[44]  Jon Oberlander,et al.  Foundations of Representation: Where Might Graphical Symbol Systems Come From? , 2007, Cogn. Sci..

[45]  A Aguiar,et al.  Eight-and-a-half-month-old infants' reasoning about containment events. , 1998, Child development.