Neurophysiological correlates of linearization in language production

BackgroundDuring speech production the planning of a description of several events requires, among other things, a verbal sequencing of these events. During this process, referred to as linearization during conceptualization, the speaker can choose between different types of temporal connectives such as 'Before' X did A, Y did B' or 'After' Y did B, X did A'. To capture the neural events of such linearization processes, event-related potentials (ERP) were measured in native speakers of German. Utterances were elicited by presenting a sequence of two pictures on a video screen. Each picture consists of an object that is associated with a particular action (e.g. book = reading). A coloured vocalization cue indicated to describe the sequence of two actions associated with the objects in chronological (e.g. red cue: 'After' I drove the car, I read a book) or reversed order (yellow cue).ResultsBrain potentials showed reliable differences between the two conditions from 180 ms after the onset of the vocalization prompt, with ERPs from the 'After' condition being more negative. This 'Before/After' difference showed a fronto-central distribution between 180 and 230 ms. From 300 ms onwards, a parietal distribution was observed. The latter effect is interpreted as an instance of the P300 response, which is known to be modulated by task difficulty.ConclusionERPs preceding overt sentence production are sensitive to conceptual linearization. The observed early, more fronto-centrally distributed variation could be interpreted as involvement of working memory needed to order the events according to the instruction. The later parietal distributed variation relates to the complexity in linearization, with the non-chronological order being more demanding during the updating of the concepts in working memory.

[1]  R. Johnson A triarchic model of P300 amplitude. , 1986, Psychophysiology.

[2]  M. Kutas,et al.  Who Did What and When? Using Word- and Clause-Level ERPs to Monitor Working Memory Usage in Reading , 1995, Journal of Cognitive Neuroscience.

[3]  M Turennout,et al.  Brain activity during speaking: from syntax to phonology in 40 milliseconds. , 1998, Science.

[4]  P. Carey,et al.  Why five-year-olds cannot understand before and after , 1972 .

[5]  Y Agid,et al.  Planning and Script Analysis following Prefrontal Lobe Lesions a , 1995, Annals of the New York Academy of Sciences.

[6]  A. Caramazza How many levels of processing are there in lexical access , 1997 .

[7]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[8]  C. C. Wood,et al.  Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. , 1985, Electroencephalography and clinical neurophysiology.

[9]  Thomas Pechmann,et al.  The activation of word class information during speech production. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Marta Kutas,et al.  When temporal terms belie conceptual order , 1998, Nature.

[11]  Ray Johnson For Distinguished Early Career Contribution to Psychophysiology: Award Address, 1985 , 1986 .

[12]  A. Sirigu,et al.  Distinct Frontal Regions for Processing Sentence Syntax and Story Grammar , 1998, Cortex.

[13]  H. Schriefers,et al.  Lexical access in the production of noun phrases , 1992, Cognition.

[14]  P Hagoort,et al.  The Time Course of Grammatical and Phonological Processing During Speaking: Evidence from Event-Related Brain Potentials , 1999, Journal of psycholinguistic research.

[15]  R. Verleger Event-related potentials and cognition: A critique of the context updating hypothesis and an alternative interpretation of P3 , 1988, Behavioral and Brain Sciences.

[16]  E. Clark On the acquisition of the meaning of before and after , 1971 .

[17]  J. Logothetis,et al.  Algorithmic and heuristic strategies in comprehension of complement clauses by patients with Parkinson's disease , 1993, Neuropsychologia.

[18]  Willem J. M. Levelt,et al.  Linearization in Describing Spatial Networks , 1982 .

[19]  Jordan Grafman,et al.  Selective Impairments in Managerial Knowledge Following Pre-Frontal Cortex Damage , 1995, Cortex.

[20]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[21]  M. Kutas,et al.  Electrophysiological estimates of semantic and syntactic information access during tacit picture naming and listening to words , 2001, Neuroscience Research.

[22]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[23]  M. Kutas,et al.  Electrophysiological estimates of the time course of semantic and phonological encoding during implicit picture naming. , 2000, Psychophysiology.

[24]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[25]  M. Kutas,et al.  An Electrophysiological Analysis of the Time Course of Conceptual and Syntactic Encoding during Tacit Picture Naming , 2001, Journal of Cognitive Neuroscience.

[26]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[27]  J. Grafman,et al.  Category-Specific Representations of Social and Nonsocial Knowledge in the Human Prefrontal Cortex , 2003, Journal of Cognitive Neuroscience.

[28]  Stanley Peters,et al.  Processes, Beliefs, and Questions , 1982 .

[29]  Olaf Hauk,et al.  Electroencephalographic activity over temporal brain areas during phonological encoding in picture naming , 2000, Clinical Neurophysiology.

[30]  Colin M. Brown,et al.  Electrophysiological evidence on the time course of semantic and phonological processes in speech production. , 1997 .

[31]  R. R. Peterson,et al.  Lexical selection and phonological encoding during language production: Evidence for cascaded processing. , 1998 .

[32]  D Natsopoulos,et al.  Understanding of relational time terms before and after in Parkinsonian patients , 1991, Brain and Language.

[33]  H. Mayberg,et al.  An ERP study of the temporal course of the Stroop color-word interference effect , 2000, Neuropsychologia.

[34]  W. Levelt Models of word production , 1999, Trends in Cognitive Sciences.

[35]  Stéphane Lehéricy,et al.  Distinct prefrontal activations in processing sequence at the sentence and script level: An fMRI study , 1999, Neuropsychologia.

[36]  Bernadette M. Jansma,et al.  Neural correlates of conceptualisation difficulty during the preparation of complex utterances , 2007 .

[37]  R. Stevenson,et al.  The acquisition of temporal terms , 1987, Journal of Child Language.

[38]  Kathryn Bock,et al.  Toward a Cognitive Psychology of Syntax: Information Processing Contributions to Sentence Formulation , 1982 .

[39]  M. Kutas,et al.  Electrophysiological estimates of the time course of semantic and phonological encoding during listening and naming , 2002, Neuropsychologia.

[40]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[41]  Gary S. Dell,et al.  The retrieval of phonological forms in production: tests of predictions from a connectionist model , 1988 .

[42]  P. Hagoort,et al.  Electrophysiological evidence on the time course of semantic and phonological processes in speech production. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[43]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[44]  H. M. Müller,et al.  Event-related potentials elicited by spoken relative clauses. , 1997, Brain research. Cognitive brain research.

[45]  Pierre Coirier,et al.  Acquisition of the Linearization Process in Text Composition in Third to Ninth Graders: Effects of Textual Superstructure and Macrostructural Organization , 2006, Journal of psycholinguistic research.

[46]  Jordan Grafman,et al.  Brain activation in processing temporal sequence: an fMRI study , 2004, NeuroImage.

[47]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[48]  L. Feagans Children's understanding of some temporal terms denoting order, duration, and simultaneity , 1980, Journal of psycholinguistic research.

[49]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .