The neural correlates of spatial language in English and American Sign Language: a PET study with hearing bilinguals

Rather than specifying spatial relations with a closed-class set of prepositions, American Sign Language (ASL) encodes spatial relations using space itself via classifier constructions. In these constructions, handshape morphemes specify object type, and the position of the hands in signing space schematically represents the spatial relation between objects. A [15O]water PET study was conducted to investigate the neural regions engaged during the production of English prepositions and ASL locative classifier constructions in hearing subjects with deaf parents (ASL-English bilinguals). Ten subjects viewed line drawings depicting a spatial relation between two objects and were asked to produce either an ASL locative classifier construction or an English preposition that described the spatial relation. The comparison task was to name the figure object (colored red) in either ASL or in English. Describing spatial relations in either ASL or English engaged parietal cortex bilaterally. However, an interaction analysis revealed that right superior parietal cortex was engaged to a greater extent for ASL than for English. We propose that right parietal cortex is involved in the visual-motoric transformation required for ASL. The production of both English prepositions and ASL nouns engaged Broca's area to a greater extent than ASL classifier constructions. We suggest that Broca's area is not engaged because these constructions do not involve retrieval of the name of an object or the name of a spatial relation. Finally, under the same task conditions, only left parietal activation was observed for monolingual English speakers producing spatial prepositions (H. Damasio et al., 2001, NeuroImage, 13). We conclude that the right hemisphere activation observed for ASL-English bilinguals was due to their life-long experience with spatial language in ASL.

[1]  P. Boyes-Braem,et al.  The Hands are the Head of the Mouth , 2002 .

[2]  K. Emmorey,et al.  Language, Gesture, and Space. , 1996 .

[3]  Hanna Damasio,et al.  Premotor and Prefrontal Correlates of Category-Related Lexical Retrieval , 1998, NeuroImage.

[4]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[5]  A. Braun,et al.  The neural organization of discourse: an H2 15O-PET study of narrative production in English and American sign language. , 2001, Brain : a journal of neurology.

[6]  R. Adolphs,et al.  Neural systems behind word and concept retrieval , 2004, Cognition.

[7]  F. Grosjean The Bilingual's Language Modes. , 2001 .

[8]  A. Braun,et al.  Activation of Broca’s area during the production of spoken and signed language: a combined cytoarchitectonic mapping and PET analysis , 2003, Neuropsychologia.

[9]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[10]  A. Damasio,et al.  Neural Correlates of Naming Actions and of Naming Spatial Relations , 2001, NeuroImage.

[11]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[12]  R. J. Frank,et al.  Three-dimensional in vivo mapping of brain lesions in humans. , 1992, Archives of neurology.

[13]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[14]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[15]  Leonard Talmy,et al.  Toward a cognitive semantics, Vol. 1: Concept structuring systems. , 2000 .

[16]  F. Grosjean Studying bilinguals: Methodological and conceptual issues , 1998, Bilingualism: Language and Cognition.

[17]  S. Kosslyn,et al.  Visual imagery and visual-spatial language: Enhanced imagery abilities in deaf and hearing ASL signers , 1993, Cognition.

[18]  R. J. Frank,et al.  Brainvox: An Interactive, Multimodal Visualization and Analysis System for Neuroanatomical Imaging , 1997, NeuroImage.

[19]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[20]  Stephen M Kosslyn,et al.  Sequential processes in image generation , 1988, Cognitive Psychology.

[21]  P. T. Fox,et al.  Positron emission tomographic studies of the cortical anatomy of single-word processing , 1988, Nature.

[22]  Karen Emmorey,et al.  10 Categorical Versus Gradient Properties of Classifier Constructions in ASL , 2003 .

[23]  S. Kosslyn Seeing and imagining in the cerebral hemispheres: a computational approach. , 1987, Psychological review.

[24]  H. Damasio,et al.  A new technique for pet slice orientation and MRI‐PET coregistration , 1994 .

[25]  Antoni Rodríguez-Fornells,et al.  Imaging bilinguals: When the neurosciences meet the language sciences , 2003, Bilingualism: Language and Cognition.

[26]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[27]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[28]  T. Dijkstra,et al.  The architecture of the bilingual word recognition system: From identification to decision , 2002, Bilingualism: Language and Cognition.

[29]  Stephen M. Kosslyn,et al.  Enhanced Image Generation Abilities in Deaf Signers: A Right Hemisphere Effect , 1996, Brain and Cognition.

[30]  J C Mazziotta,et al.  Creation and use of a Talairach‐compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data , 1999, Human brain mapping.

[31]  Karen Emmorey,et al.  Perspectives on Classifier Constructions in Sign Languages , 2003 .

[32]  Vera Maljkovic,et al.  Two types of image generation: Evidence for left and right hemisphere processes , 1995, Neuropsychologia.

[33]  H. Damasio,et al.  A technique for neuroanatomical analysis of positron emission tomography images , 1993 .

[34]  Alan C. Evans,et al.  Enhancement of MR Images Using Registration for Signal Averaging , 1998, Journal of Computer Assisted Tomography.

[35]  K. Worsley,et al.  Local Maxima and the Expected Euler Characteristic of Excursion Sets of χ 2, F and t Fields , 1994, Advances in Applied Probability.

[36]  Karen Emmorey,et al.  Neural Systems Underlying Spatial Language in American Sign Language , 2002, NeuroImage.

[37]  Karen Emmorey,et al.  Motor-iconicity of sign language does not alter the neural systems underlying tool and action naming , 2004, Brain and Language.

[38]  Janet L Nicol,et al.  One mind, two languages : bilingual language processing , 2001 .

[39]  Philip K. McGuire,et al.  Neural Correlates of British Sign Language Comprehension: Spatial Processing Demands of Topographic Language , 2002, Journal of Cognitive Neuroscience.

[40]  A. Damasioa,et al.  Neural systems behind word and concept retrieval , 2004 .

[41]  R. J. Frank,et al.  Reliability of PET activation across statistical methods, subject groups, and sample sizes , 1996, Human brain mapping.