Different Neurophysiological Mechanisms Underlying Word and Rule Extraction from Speech

The initial process of identifying words from spoken language and the detection of more subtle regularities underlying their structure are mandatory processes for language acquisition. Little is known about the cognitive mechanisms that allow us to extract these two types of information and their specific time-course of acquisition following initial contact with a new language. We report time-related electrophysiological changes that occurred while participants learned an artificial language. These changes strongly correlated with the discovery of the structural rules embedded in the words. These changes were clearly different from those related to word learning and occurred during the first minutes of exposition. There is a functional distinction in the nature of the electrophysiological signals during acquisition: an increase in negativity (N400) in the central electrodes is related to word-learning and development of a frontal positivity (P2) is related to rule-learning. In addition, the results of an online implicit and a post-learning test indicate that, once the rules of the language have been acquired, new words following the rule are processed as words of the language. By contrast, new words violating the rule induce syntax-related electrophysiological responses when inserted online in the stream (an early frontal negativity followed by a late posterior positivity) and clear lexical effects when presented in isolation (N400 modulation). The present study provides direct evidence suggesting that the mechanisms to extract words and structural dependencies from continuous speech are functionally segregated. When these mechanisms are engaged, the electrophysiological marker associated with rule-learning appears very quickly, during the earliest phases of exposition to a new language.

[1]  Marina Nespor,et al.  Signal-Driven Computations in Speech Processing , 2002, Science.

[2]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[3]  Claude Alain,et al.  Perceptual learning modulates sensory evoked response during vowel segregation. , 2003, Brain research. Cognitive brain research.

[4]  Jenny R Saffran,et al.  Words in a sea of sounds: the output of infant statistical learning , 2001, Cognition.

[5]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[6]  Thomas F. Mnte,et al.  Brain Activity Associated with Syntactic Incongruencies in Words and Pseudo-Words , 1997, Journal of Cognitive Neuroscience.

[7]  Angela D. Friederici,et al.  Hierarchical and Linear Sequence Processing: An Electrophysiological Exploration of Two Different Grammar Types , 2006, Journal of Cognitive Neuroscience.

[8]  A. Friederici,et al.  Lexical integration: Sequential effects of syntactic and semantic information , 1999, Memory & cognition.

[9]  A. Rodríguez-Fornells,et al.  The effects of stress and statistical cues on continuous speech segmentation: An event-related brain potential study , 2006, Brain Research.

[10]  H. Heinze,et al.  ERP Negativities During Syntactic Processing of Written Words , 1994 .

[11]  A. Rodríguez-Fornells,et al.  Watching the brain during meaning acquisition. , 2007, Cerebral cortex.

[12]  A. Rodríguez-Fornells,et al.  Stem allomorphy in the Spanish mental lexicon: Evidence from behavioral and ERP experiments , 2006, Brain and Language.

[13]  Karsten Steinhauer,et al.  Brain signatures of artificial language processing: Evidence challenging the critical period hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Hans-Jochen Heinze,et al.  Neural circuits subserving the retrieval of stems and grammatical features in regular and irregular verbs , 2006, Human brain mapping.

[15]  Scott Sinnett,et al.  Speech segmentation by statistical learning depends on attention , 2005, Cognition.

[16]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[17]  A. Diamond Normal development of prefrontal cortex from birth to young adulthood: Cognitive functions, anatomy, and biochemistry. , 2002 .

[18]  David Caplan The Neural Basis of Syntactic Processing: A Critical Look , 2002 .

[19]  Elissa L. Newport,et al.  Segmenting nonsense: an event-related potential index of perceived onsets in continuous speech , 2002, Nature Neuroscience.

[20]  A. Endress,et al.  Rapid learning of syllable classes from a perceptually continuous speech stream , 2007, Cognition.

[21]  L. Osterhout,et al.  Neural correlates of second-language word learning: minimal instruction produces rapid change , 2004, Nature Neuroscience.

[22]  F. Perrin,et al.  Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. , 1990, Psychophysiology.

[23]  J. Mehler,et al.  Linguistic Constraints on Statistical Computations , 2005, Psychological science.

[24]  D. Mills,et al.  Two languages, one developing brain: event-related potentials to words in bilingual toddlers. , 2006, Developmental science.

[25]  N. Cowan,et al.  The Role of Large-Scale Memory Organization in the Mismatch Negativity Event-Related Brain Potential , 2001, Journal of Cognitive Neuroscience.

[26]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[27]  Marina Nespor,et al.  How to hit Scylla without avoiding Charybdis: comment on Perruchet, Tyler, Galland, and Peereman (2004). , 2006, Journal of experimental psychology. General.

[28]  D. Stuss,et al.  Principles of frontal lobe function , 2002 .

[29]  Carles Escera,et al.  Auditory event-related potentials as a function of abstract change magnitude , 2005, Neuroreport.

[30]  M. Ullman A neurocognitive perspective on language: The declarative/procedural model , 2001, Nature Reviews Neuroscience.

[31]  R. Gómez Variability and Detection of Invariant Structure , 2002, Psychological science.

[32]  R. Peereman,et al.  Do We Need Algebraic-Like Computations? A Reply to Bonatti, Pena, Nespor, and Mehler (2006). , 2006 .

[33]  Thierry Dutoit,et al.  The MBROLA project: towards a set of high quality speech synthesizers free of use for non commercial purposes , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[34]  R. Gómez,et al.  The Developmental Trajectory of Nonadjacent Dependency Learning. , 2005, Infancy : the official journal of the International Society on Infant Studies.

[35]  A. Hahne,et al.  Brain potentials to morphologically complex words during listening , 2006, Brain Research.

[36]  Jacques Mehler,et al.  The role of salience in the extraction of algebraic rules. , 2005, Journal of experimental psychology. General.

[37]  Terence W. Picton,et al.  Effects of Attention on Neuroelectric Correlates of Auditory Stream Segregation , 2006, Journal of Cognitive Neuroscience.

[38]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[39]  William D. Marslen-Wilson,et al.  Dissociating types of mental computation , 1997, Nature.

[40]  E. Newport,et al.  WORD SEGMENTATION : THE ROLE OF DISTRIBUTIONAL CUES , 1996 .

[41]  R. Baayen,et al.  Chronicling the Times: Productive Lexical Innovations in an English Newspaper , 1996 .