Cracking the Language Code: Neural Mechanisms Underlying Speech Parsing

Word segmentation, detecting word boundaries in continuous speech, is a critical aspect of language learning. Previous research in infants and adults demonstrated that a stream of speech can be readily segmented based solely on the statistical and speech cues afforded by the input. Using functional magnetic resonance imaging (fMRI), the neural substrate of word segmentation was examined on-line as participants listened to three streams of concatenated syllables, containing either statistical regularities alone, statistical regularities and speech cues, or no cues. Despite the participants’ inability to explicitly detect differences between the speech streams, neural activity differed significantly across conditions, with left-lateralized signal increases in temporal cortices observed only when participants listened to streams containing statistical regularities, particularly the stream containing speech cues. In a second fMRI study, designed to verify that word segmentation had implicitly taken place, participants listened to trisyllabic combinations that occurred with different frequencies in the streams of speech they just heard (“words,” 45 times; “partwords,” 15 times; “nonwords,” once). Reliably greater activity in left inferior and middle frontal gyri was observed when comparing words with partwords and, to a lesser extent, when comparing partwords with nonwords. Activity in these regions, taken to index the implicit detection of word boundaries, was positively correlated with participants’ rapid auditory processing skills. These findings provide a neural signature of on-line word segmentation in the mature brain and an initial model with which to study developmental changes in the neural architecture involved in processing speech cues during language learning.

[1]  P. Tallal,et al.  Defects of Non-Verbal Auditory Perception in Children with Developmental Aphasia , 1973, Nature.

[2]  Anne Cutler,et al.  The predominance of strong initial syllables in the English vocabulary , 1987 .

[3]  J. S. Johnson,et al.  Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language , 1989, Cognitive Psychology.

[4]  M. E. Raichle,et al.  PET Studies of Auditory and Phonological Processing: Effects of Stimulus Characteristics and Task Demands , 1995, Journal of Cognitive Neuroscience.

[5]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[6]  E. Newport,et al.  WORD SEGMENTATION : THE ROLE OF DISTRIBUTIONAL CUES , 1996 .

[7]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[8]  Scott T. Grafton,et al.  Automated image registration: II. Intersubject validation of linear and nonlinear models. , 1998, Journal of computer assisted tomography.

[9]  C. Frith,et al.  How do we predict the consequences of our actions? a functional imaging study , 1998, Neuropsychologia.

[10]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[11]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[12]  S. Petersen,et al.  The effects of practice on the functional anatomy of task performance. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Karl J. Friston,et al.  Multisubject fMRI Studies and Conjunction Analyses , 1999, NeuroImage.

[14]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[15]  J C Mazziotta,et al.  Creation and use of a Talairach‐compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data , 1999, Human brain mapping.

[16]  S. Blumstein,et al.  The Role of Segmentation in Phonological Processing: An fMRI Investigation , 2000, Journal of Cognitive Neuroscience.

[17]  D. Poeppel,et al.  Towards a functional neuroanatomy of speech perception , 2000, Trends in Cognitive Sciences.

[18]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[19]  R. Poldrack,et al.  Disruption of the neural response to rapid acoustic stimuli in dyslexia: evidence from functional MRI. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[20]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[21]  Karen A. Daniels,et al.  Conscious and Unconscious Processing of Nonverbal Predictability in Wernicke's Area , 2000, The Journal of Neuroscience.

[22]  R. Zatorre,et al.  Functional specificity in the right human auditory cortex for perceiving pitch direction. , 2000, Brain : a journal of neurology.

[23]  R. Poldrack,et al.  Relations between the Neural Bases of Dynamic Auditory Processing and Phonological Processing: Evidence from fMRI , 2001, Journal of Cognitive Neuroscience.

[24]  H. Neville,et al.  Sensitive periods differentiate processing of open- and closed-class words: an ERP study of bilinguals. , 2001, Journal of speech, language, and hearing research : JSLHR.

[25]  K. Kiehl,et al.  Detection of Sounds in the Auditory Stream: Event-Related fMRI Evidence for Differential Activation to Speech and Nonspeech , 2001, Journal of Cognitive Neuroscience.

[26]  Sharlene D. Newman,et al.  Differences in auditory processing of words and pseudowords: An fMRI study , 2001, Human brain mapping.

[27]  Elizabeth K. Johnson,et al.  Word Segmentation by 8-Month-Olds: When Speech Cues Count More Than Statistics , 2001 .

[28]  H. Scheich,et al.  Phonetic Perception and the Temporal Cortex , 2002, NeuroImage.

[29]  Elissa L. Newport,et al.  Segmenting nonsense: an event-related potential index of perceived onsets in continuous speech , 2002, Nature Neuroscience.

[30]  Elise Temple,et al.  Brain mechanisms in normal and dyslexic readers , 2002, Current Opinion in Neurobiology.

[31]  Karsten Steinhauer,et al.  Brain signatures of artificial language processing: Evidence challenging the critical period hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Peter W. Jusczyk,et al.  How Infants Adapt Speech-Processing Capacities to Native-Language Structure , 2002 .

[33]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[34]  M. Lowe,et al.  A Cross-Linguistic fMRI Study of Spectral and Temporal Cues Underlying Phonological Processing , 2002, Journal of Cognitive Neuroscience.

[35]  P. Tallal,et al.  Infant discrimination of rapid auditory cues predicts later language impairment , 2002, Behavioural Brain Research.

[36]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[37]  Susanne M. Jaeggi,et al.  Does excessive memory load attenuate activation in the prefrontal cortex? Load-dependent processing in single and dual tasks: functional magnetic resonance imaging study , 2003, NeuroImage.

[38]  Erik D. Thiessen,et al.  When cues collide: use of stress and statistical cues to word boundaries by 7- to 9-month-old infants. , 2003, Developmental psychology.

[39]  J. Saint-Cyr Frontal-striatal circuit functions: Context, sequence, and consequence , 2003, Journal of the International Neuropsychological Society.

[40]  J. Saffran,et al.  From Syllables to Syntax: Multilevel Statistical Learning by 12-Month-Old Infants , 2003 .

[41]  Leslie G. Ungerleider,et al.  Distinct contribution of the cortico-striatal and cortico-cerebellar systems to motor skill learning , 2003, Neuropsychologia.

[42]  M. Huotilainen,et al.  Event-related potentials associated with second language learning in children , 2003, Clinical Neurophysiology.

[43]  Shinobu Masaki,et al.  Learning-induced neural plasticity associated with improved identification performance after training of a difficult second-language phonetic contrast , 2003, NeuroImage.

[44]  D R Shanks,et al.  Neuronal correlates of familiarity-driven decisions in artificial grammar learning , 2003, Neuroreport.

[45]  S. Bookheimer,et al.  Dissociating Neural Mechanisms of Temporal Sequencing and Processing Phonemes , 2003, Neuron.

[46]  S. Scott,et al.  The neuroanatomical and functional organization of speech perception , 2003, Trends in Neurosciences.

[47]  Bertram Opitz,et al.  Interactions of the hippocampal system and the prefrontal cortex in learning language-like rules , 2003, NeuroImage.

[48]  L. Osterhout,et al.  Neural correlates of second-language word learning: minimal instruction produces rapid change , 2004, Nature Neuroscience.

[49]  P. Tallal Improving language and literacy is a matter of time , 2004, Nature Reviews Neuroscience.

[50]  Mark D'Esposito,et al.  A functional MRI study of the influence of practice on component processes of working memory , 2004, NeuroImage.

[51]  A. Friederici,et al.  Brain Correlates of Language Learning: The Neuronal Dissociation of Rule-Based versus Similarity-Based Learning , 2004, The Journal of Neuroscience.

[52]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[53]  Robert J Zatorre,et al.  Learning new sounds of speech: reallocation of neural substrates , 2004, NeuroImage.

[54]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[55]  C. J. Price,et al.  An fMRI Study of Syntactic Adaptation , 2004, Journal of Cognitive Neuroscience.

[56]  Rao P. Gullapalli,et al.  An fMRI Investigation of Speech and Tone Segmentation , 2004, Journal of Cognitive Neuroscience.

[57]  R P Maguire,et al.  Cerebral activation related to skills practice in a double serial reaction time task: striatal involvement in random-order sequence learning. , 2004, Brain research. Cognitive brain research.

[58]  Kuniyoshi L Sakai,et al.  Learning letters in adulthood: direct visualization of cortical plasticity for forming a new link between orthography and phonology. , 2004, Neuron.

[59]  Shinobu Masaki,et al.  When meaningless symbols become letters: Neural activity change in learning new phonograms , 2005, NeuroImage.

[60]  A. Kelly,et al.  Human functional neuroimaging of brain changes associated with practice. , 2005, Cerebral cortex.

[61]  Xiaoping Hu,et al.  Differential activity in left inferior frontal gyrus for pseudowords and real words: An event‐related fMRI study on auditory lexical decision , 2005, Human brain mapping.

[62]  Sabrina M. Tom,et al.  The Neural Correlates of Motor Skill Automaticity , 2005, The Journal of Neuroscience.

[63]  C D Frith,et al.  On the benefits of not trying: brain activity and connectivity reflecting the interactions of explicit and implicit sequence learning. , 2005, Cerebral cortex.

[64]  Willy Serniclaes,et al.  Neural correlates of switching from auditory to speech perception , 2005, NeuroImage.

[65]  T. Hare,et al.  Changes in cerebral functional organization during cognitive development , 2005, Current Opinion in Neurobiology.