Neural Systems Underlying Spatial Language in American Sign Language

A [(15)O]water PET experiment was conducted to investigate the neural regions engaged in processing constructions unique to signed languages: classifier predicates in which the position of the hands in signing space schematically represents spatial relations among objects. Ten deaf native signers viewed line drawings depicting a spatial relation between two objects (e.g., a cup on a table) and were asked either to produce a classifier construction or an American Sign Language (ASL) preposition that described the spatial relation or to name the figure object (colored red). Compared to naming objects, describing spatial relationships with classifier constructions engaged the supramarginal gyrus (SMG) within both hemispheres. Compared to naming objects, naming spatial relations with ASL prepositions engaged only the right SMG. Previous research indicates that retrieval of English prepositions engages both right and left SMG, but more inferiorly than for ASL classifier constructions. Compared to ASL prepositions, naming spatial relations with classifier constructions engaged left inferior temporal (IT) cortex, a region activated when naming concrete objects in either ASL or English. Left IT may be engaged because the handshapes in classifier constructions encode information about object type (e.g., flat surface). Overall, the results suggest more right hemisphere involvement when expressing spatial relations in ASL, perhaps because signing space is used to encode the spatial relationship between objects.

[1]  Merideth Leigh Gattis,et al.  Spatial schemas and abstract thought , 2001 .

[2]  Elissa L. Newport,et al.  The acquisition of American Sign Language. , 1985 .

[3]  D. Slobin.  The Crosslinguistic Study of Language Acquisition , 1987 .

[4]  Vera Maljkovic,et al.  Two types of image generation: Evidence for left and right hemisphere processes , 1995, Neuropsychologia.

[5]  K. Emmorey.  Language, Cognition, and the Brain: Insights From Sign Language Research , 2001 .

[6]  Leonard Talmy,et al.  How Language Structures Space , 1983 .

[7]  A. Lerner,et al.  Neurotrauma , 1990, Neurology.

[8]  A. Damasio,et al.  Cortical systems for retrieval of concrete knowledge: The convergence zone framework , 1994 .

[9]  Ceil Lucas,et al.  Sign Language Research: Theoretical Issues , 1990 .

[10]  R. J. Frank,et al.  Reliability of PET activation across statistical methods, subject groups, and sample sizes , 1996, Human brain mapping.

[11]  Ted Suppalla,et al.  The Classifier System in American Sign Language , 1986 .

[12]  Patrick Coppens,et al.  Aphasia in atypical populations , 2000 .

[13]  J C Mazziotta,et al.  Creation and use of a Talairach‐compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data , 1999, Human brain mapping.

[14]  K. Emmorey,et al.  Language, Gesture, and Space. , 1996 .

[15]  F. Attneave.  Physical determinants of the judged complexity of shapes. , 1957, Journal of experimental psychology.

[16]  S. Kosslyn.  Seeing and imagining in the cerebral hemispheres: a computational approach. , 1987, Psychological review.

[17]  S. Levinson,et al.  LANGUAGE AND SPACE , 1996 .

[18]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[19]  D. Wolpert,et al.  Maintaining internal representations: the role of the human superior parietal lobe , 1998, Nature Neuroscience.

[20]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[21]  D. Tranel,et al.  A DOUBLE DISSOCIATION BETWEEN LINGUISTIC AND PERCEPTUAL REPRESENTATIONS OF SPATIAL RELATIONSHIPS , 2000, Cognitive neuropsychology.

[22]  Karen Emmorey,et al.  Neural systems underlying lexical retrieval for sign language , 2003, Neuropsychologia.

[23]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[24]  R. J. Frank,et al.  Brainvox: An Interactive, Multimodal Visualization and Analysis System for Neuroanatomical Imaging , 1997, NeuroImage.

[25]  Visual language processing and unilateral neglect: Evidence from American sign language , 1996 .

[26]  Judy Anne Shepard-Kegl,et al.  Locative relations in American Sign Language word formation, syntax and discourse , 1985 .

[27]  Philip K. McGuire,et al.  Neural Correlates of British Sign Language Comprehension: Spatial Processing Demands of Topographic Language , 2002, Journal of Cognitive Neuroscience.

[28]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[29]  R. J. Frank,et al.  Three-dimensional in vivo mapping of brain lesions in humans. , 1992, Archives of neurology.

[30]  Karen Emmorey,et al.  A Comparison of Spatial Language in English & American Sign Language , 1995 .

[31]  A. Damasio,et al.  A neural basis for lexical retrieval , 1996, Nature.

[32]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[33]  A. Ioannides,et al.  Contribution of the human superior parietal lobule to spatial selection process: an MEG study , 2001, Brain Research.

[34]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[35]  Ursula Bellugi,et al.  The signs of aphasia , 2002 .

[36]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[37]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[38]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[39]  Karen Emmorey,et al.  Perspectives on Classifier Constructions in Sign Languages , 2003 .

[40]  M. Corbetta,et al.  A PET study of visuospatial attention , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  A. Friederici.  Syntactic and semantic processes in aphasic deficits: The availability of prepositions , 1982, Brain and Language.

[42]  A. Damasio,et al.  Neural Correlates of Naming Actions and of Naming Spatial Relations , 2001, NeuroImage.

[43]  H. Pick,et al.  Spatial orientation : theory, research, and application , 1984 .

[44]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[45]  H. Damasio,et al.  A technique for neuroanatomical analysis of positron emission tomography images , 1993 .

[46]  Alan C. Evans,et al.  Enhancement of MR Images Using Registration for Signal Averaging , 1998, Journal of Computer Assisted Tomography.

[47]  K. Worsley,et al.  Local Maxima and the Expected Euler Characteristic of Excursion Sets of χ 2, F and t Fields , 1994, Advances in Applied Probability.

[48]  Cecile McKee.  The Signs of Language Revisited: An Anthology to Honor Ursula Bellugi and Edward Klima (review) , 2001 .

[49]  H. Damasio,et al.  A new technique for pet slice orientation and MRI‐PET coregistration , 1994 .