The Biology of Linguistic Expression Impacts Neural Correlates for Spatial Language

Biological differences between signed and spoken languages may be most evident in the expression of spatial information. PET was used to investigate the neural substrates supporting the production of spatial language in American Sign Language as expressed by classifier constructions, in which handshape indicates object type and the location/motion of the hand iconically depicts the location/motion of a referent object. Deaf native signers performed a picture description task in which they overtly named objects or produced classifier constructions that varied in location, motion, or object type. In contrast to the expression of location and motion, the production of both lexical signs and object type classifier morphemes engaged left inferior frontal cortex and left inferior temporal cortex, supporting the hypothesis that unlike the location and motion components of a classifier construction, classifier handshapes are categorical morphemes that are retrieved via left hemisphere language regions. In addition, lexical signs engaged the anterior temporal lobes to a greater extent than classifier constructions, which we suggest reflects increased semantic processing required to name individual objects compared with simply indicating the type of object. Both location and motion classifier constructions engaged bilateral superior parietal cortex, with some evidence that the expression of static locations differentially engaged the left intraparietal sulcus. We argue that bilateral parietal activation reflects the biological underpinnings of sign language. To express spatial information, signers must transform visual–spatial representations into a body-centered reference frame and reach toward target locations within signing space.

[1]  H. Damasio,et al.  Validation of Partial Tissue Segmentation of Single-Channel Magnetic Resonance Images of the Brain , 2000, NeuroImage.

[2]  A. Damasio,et al.  Neural Correlates of Naming Actions and of Naming Spatial Relations , 2001, NeuroImage.

[3]  Elizabeth Jefferies,et al.  Semantic Processing in the Anterior Temporal Lobes: A Meta-analysis of the Functional Neuroimaging Literature , 2010, Journal of Cognitive Neuroscience.

[4]  J. Rodd,et al.  Processing Objects at Different Levels of Specificity , 2004, Journal of Cognitive Neuroscience.

[5]  Ted Suppalla,et al.  The Classifier System in American Sign Language , 1986 .

[6]  S. Glover,et al.  Separate visual representations in the planning and control of action , 2004, Behavioral and Brain Sciences.

[7]  H. Damasio,et al.  A new technique for pet slice orientation and MRI‐PET coregistration , 1994 .

[8]  K. Emmorey,et al.  Differential Processing of Topographic and Referential Functions of Space , 2013 .

[9]  Daniel Y. Kimberg,et al.  Language, perception, and the schematic representation of spatial relations , 2012, Brain and Language.

[10]  Adam Schembri,et al.  Rethinking ‘Classifiers’ in Signed Languages , 2003 .

[11]  Melvyn A. Goodale,et al.  Programs for action in superior parietal cortex: A triple-pulse TMS investigation , 2011, Neuropsychologia.

[12]  M. Mesulam,et al.  Remapping attentional priorities: differential contribution of superior parietal lobule and intraparietal sulcus. , 2007, Cerebral cortex.

[13]  T. Rogers,et al.  Anterior temporal cortex and semantic memory: Reconciling findings from neuropsychology and functional imaging , 2006, Cognitive, affective & behavioral neuroscience.

[14]  Matthew H. Davis,et al.  Susceptibility-Induced Loss of Signal: Comparing PET and fMRI on a Semantic Task , 2000, NeuroImage.

[15]  Alan J. Miller,et al.  Least Squares Routines to Supplement Those of Gentleman , 1992 .

[16]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[17]  Carol Padden,et al.  American Sign Language and the architecture of phonological theory , 1987 .

[18]  Denise H. Wu,et al.  Neural substrates of processing path and manner information of a moving event , 2008, Neuropsychologia.

[19]  J C Mazziotta,et al.  Creation and use of a Talairach‐compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data , 1999, Human brain mapping.

[20]  D. Gitelman,et al.  Functional Specificity of Superior Parietal Mediation of Spatial Shifting , 2001, NeuroImage.

[21]  Hanna Damasio,et al.  Naming the Same Entities from Visual or from Auditory Stimulation Engages Similar Regions of Left Inferotemporal Cortices , 2005, Journal of Cognitive Neuroscience.

[22]  R. Battison,et al.  Lexical Borrowing in American Sign Language , 1978 .

[23]  D. Kemmerer The semantics of space: Integrating linguistic typology and cognitive neuroscience , 2006, Neuropsychologia.

[24]  P. Brown The INs and ONs of Tzeltal locative expressions: the semantics of static descriptions of location , 1994 .

[25]  Peter Herscovitch,et al.  Brain blood flow measured with intravenous H/sub 2//sup 15/O. I. Theory and error analysis , 1983 .

[26]  Kara D. Federmeier,et al.  Timed picture naming: Extended norms and validation against previous studies , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[27]  Richard D. Hichwa,et al.  Clinical Blood Flow Measurement with [15O] Water and Positron Emission Tomography (PET) , 1995 .

[28]  Wendy Sandler,et al.  Sign Language and Linguistic Universals: Entering the lexicon: lexicalization, backformation, and cross-modal borrowing , 2006 .

[29]  A. Damasio,et al.  A role for left temporal pole in the retrieval of words for unique entities , 2001, Human brain mapping.

[30]  Karen Emmorey,et al.  Modulation of BOLD Response in Motion-sensitive Lateral Temporal Cortex by Real and Fictive Motion Sentences , 2010, Journal of Cognitive Neuroscience.

[31]  G. Hickok,et al.  Neural dissociation in the production of lexical versus classifier signs in ASL: Distinct patterns of hemispheric asymmetry , 2009, Neuropsychologia.

[33]  U. Bellugi,et al.  What the hands reveal about the brain , 1987 .

[34]  L. Ponto,et al.  Sign language and pantomime production differentially engage frontal and parietal cortices , 2011, Language and cognitive processes.

[35]  M. Corbetta,et al.  Superior Parietal Cortex Activation During Spatial Attention Shifts and Visual Feature Conjunction , 1995, Science.

[36]  Cara L. Wong,et al.  The function of the anterior temporal lobe: A review of the empirical evidence , 2012, Brain Research.

[37]  K. Worsley,et al.  Local Maxima and the Expected Euler Characteristic of Excursion Sets of χ 2, F and t Fields , 1994, Advances in Applied Probability.

[38]  Karen Emmorey,et al.  Neural Systems Underlying Spatial Language in American Sign Language , 2002, NeuroImage.

[39]  D. Tranel,et al.  Neuroanatomical correlates of locative prepositions , 2004, Cognitive neuropsychology.

[40]  Scott K. Liddell Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[41]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[42]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[43]  Karen Emmorey,et al.  The neural correlates of spatial language in English and American Sign Language: a PET study with hearing bilinguals , 2005, NeuroImage.

[44]  R. J. Frank,et al.  Brainvox: An Interactive, Multimodal Visualization and Analysis System for Neuroanatomical Imaging , 1997, NeuroImage.

[45]  Alex Martin,et al.  Semantic memory and the brain: structure and processes , 2001, Current Opinion in Neurobiology.

[46]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[47]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[48]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[49]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[50]  S. Neggers,et al.  Neural correlates of locative prepositions , 2008, Neuropsychologia.

[51]  Hsuan-Chich Chen,et al.  The role of inferior frontal gyrus in processing Chinese classifiers , 2012, Neuropsychologia.

[52]  D. Kemmerer Word classes in the brain: Implications of linguistic typology for cognitive neuroscience , 2014, Cortex.

[53]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[54]  Denis Burnham,et al.  Comparing action gestures and classifier verbs of motion: evidence from Australian Sign Language, Taiwan Sign Language, and nonsigners' gestures without speech. , 2005, Journal of deaf studies and deaf education.

[55]  Céline R. Gillebert,et al.  Spatial attention deficits in humans: The critical role of superior compared to inferior parietal lesions , 2012, Neuropsychologia.

[56]  A. Damasioa,et al.  Neural systems behind word and concept retrieval , 2004 .

[57]  R. J. Frank,et al.  Reliability of PET activation across statistical methods, subject groups, and sample sizes , 1996, Human brain mapping.

[58]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[59]  Karen Emmorey,et al.  10 Categorical Versus Gradient Properties of Classifier Constructions in ASL , 2003 .

[60]  Karen Emmorey,et al.  Motion-sensitive cortex and motion semantics in American Sign Language , 2012, NeuroImage.

[61]  M. L. Lambon Ralph,et al.  Generalization and Differentiation in Semantic Memory , 2008, Annals of the New York Academy of Sciences.

[62]  Philip K. McGuire,et al.  Neural Correlates of British Sign Language Comprehension: Spatial Processing Demands of Topographic Language , 2002, Journal of Cognitive Neuroscience.

[63]  Bencie Woll,et al.  Testing comprehension abilities in users of British Sign Language following CVA , 2005, Brain and Language.

[64]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.