Brain activations associated with sign production using word and picture inputs in deaf signers

Effective literacy education in deaf students calls for psycholinguistic research revealing the cognitive and neural mechanisms underlying their written language processing. When learning a written language, deaf students are often instructed to sign out printed text. The present fMRI study was intended to reveal the neural substrates associated with word signing by comparing it with picture signing. Native deaf signers were asked to overtly sign in Chinese Sign Language (CSL) common objects indicated with written words or presented as pictures. Except in left inferior frontal gyrus and inferior parietal lobule where word signing elicited greater activation than picture signing, the two tasks engaged a highly overlapping set of brain regions previously implicated in sign production. The results suggest that word signing in the deaf signers relies on meaning activation from printed visual forms, followed by similar production processes from meaning to signs as in picture signing. The present study also documents the basic brain activation pattern for sign production in CSL and supports the notion of a universal core neural network for sign production across different sign languages.

[1]  Cheryl M. Capek,et al.  The signing brain: the neurobiology of sign language , 2008, Trends in Cognitive Sciences.

[2]  Karen Emmorey,et al.  The neural correlates of sign versus word production , 2007, NeuroImage.

[3]  Jenny L. Singleton,et al.  From sign to word: Considering modality constraints in ASL/English bilingual education. , 1998 .

[4]  Alan C. Evans,et al.  The neural substrates underlying word generation: a bilingual functional-imaging study. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Ursula Bellugi,et al.  The neurobiology of sign language and its implications for the neural basis of language , 1996, Nature.

[6]  M Laine,et al.  The translating brain: cerebral activation patterns during simultaneous interpreting , 2000, Neuroscience Letters.

[7]  Robin L. Thompson,et al.  The link between form and meaning in American Sign Language: lexical processing effects. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Alan C. Evans,et al.  Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[9]  J. Kroll,et al.  Category Interference in Translation and Picture Naming: Evidence for Asymmetric Connections Between Bilingual Memory Representations , 1994 .

[10]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[11]  Lynn C. Robertson,et al.  A Review of Hemispheric Asymmetry: What's Right and What's Left , 1994, Journal of Cognitive Neuroscience.

[12]  A. Braun,et al.  The neural organization of discourse: an H2 15O-PET study of narrative production in English and American sign language. , 2001, Brain : a journal of neurology.

[13]  Manuel Perea,et al.  Vocabulary teaching strategies and conceptual representations of words in L2 in children: evidence with novice learners. , 2009, Journal of experimental child psychology.

[14]  Willem J. M. Levelt,et al.  The neural correlates of language production , 2000 .

[15]  A. Braun,et al.  Neural systems for sign language production: Mechanisms supporting lexical selection, phonological encoding, and articulation , 2004, Human brain mapping.

[16]  C. Price,et al.  A functional imaging study of translation and language switching. , 1999, Brain : a journal of neurology.

[17]  J. Risberg,et al.  The cognitive neuroscience of signed language. , 2000, Acta psychologica.

[18]  Allen R. Braun,et al.  Language Lateralization in a Bimanual Language , 2003, Journal of Cognitive Neuroscience.

[19]  Neil Fox,et al.  The hands and mouth do not always slip together in British Sign Language: Dissociating articulatory channels in the lexicon , 2009 .

[20]  Philip K. McGuire,et al.  Fingerspelling, signed language, text and picture processing in deaf native signers: The role of the mid-fusiform gyrus , 2007, NeuroImage.

[21]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[22]  Richard S. J. Frackowiak,et al.  Neural correlates of thinking in sign language , 1997, Neuroreport.

[23]  Karen Emmorey,et al.  Neural systems underlying lexical retrieval for sign language , 2003, Neuropsychologia.

[24]  Marco Ferrari,et al.  Lateral frontal cortex oxygenation changes during translation and language switching revealed by non-invasive near-infrared multi-point measurements , 2002, Brain Research Bulletin.

[25]  S. Bookheimer,et al.  Regional cerebral blood flow during object naming and word reading , 1995 .

[26]  J. Cooney,et al.  An Examination of the Evidence-Based Literacy Research in Deaf Education , 2005, American annals of the deaf.

[27]  C. Price.  The functional anatomy of word comprehension and production , 1998, Trends in Cognitive Sciences.

[28]  M. Bradley,et al.  Emotional arousal and activation of the visual cortex: an fMRI analysis. , 1998, Psychophysiology.

[29]  Karen Emmorey,et al.  Motor-iconicity of sign language does not alter the neural systems underlying tool and action naming , 2004, Brain and Language.

[30]  W. Levelt,et al.  Effects of semantic context in the naming of pictures and words , 2001, Cognition.

[31]  Peter Erhard,et al.  Involvement of classical anterior and posterior language areas in sign language production, as investigated by 4 T functional magnetic resonance imaging , 2004, Neuroscience Letters.

[32]  M. J. Osberger,et al.  Effect of Age at Onset of Deafness on Children's Speech Perception Abilities with a Cochlear Implant , 1991, The Annals of otology, rhinology, and laryngology.

[33]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[34]  W. Levelt,et al.  Semantic distance effects on object and action naming , 2002, Cognition.

[35]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[36]  L. Tan,et al.  Phonological codes as early sources of constraint in Chinese word identification: A review of current discoveries and theoretical accounts , 1998 .

[37]  D Bavelier,et al.  Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[38]  R. Joseph,et al.  The right cerebral hemisphere: emotion, music, visual-spatial skills, body-image, dreams, and awareness. , 1988, Journal of clinical psychology.

[39]  C. J. Moore,et al.  How reading differs from object naming at the neuronal level , 2006, NeuroImage.

[40]  R. Sánchez-Casas,et al.  Can a Horse Be a Donkey? Semantic and Form Interference Effects in Translation Recognition in Early and Late Proficient and Nonproficient Spanish-Catalan Bilinguals. , 2006 .

[41]  C. Price,et al.  Three Distinct Ventral Occipitotemporal Regions for Reading and Object Naming , 1999, NeuroImage.

[42]  David A. Medler,et al.  Neural correlates of sensory and decision processes in auditory object identification , 2004, Nature Neuroscience.