Brain Oscillations during Spoken Sentence Processing

Spoken sentence comprehension relies on rapid and effortless temporal integration of speech units displayed at different rates. Temporal integration refers to how chunks of information perceived at different time scales are linked together by the listener in mapping speech sounds onto meaning. The neural implementation of this integration remains unclear. This study explores the role of short and long windows of integration in accessing meaning from long samples of speech. In a cross-linguistic study, we explore the time course of oscillatory brain activity between 1 and 100 Hz, recorded using EEG, during the processing of native and foreign languages. We compare oscillatory responses in a group of Italian and Spanish native speakers while they attentively listen to Italian, Japanese, and Spanish utterances, played either forward or backward. The results show that both groups of participants display a significant increase in gamma band power (55–75 Hz) only when they listen to their native language played forward. The increase in gamma power starts around 1000 msec after the onset of the utterance and decreases by its end, resembling the time course of access to meaning during speech perception. In contrast, changes in low-frequency power show similar patterns for both native and foreign languages. We propose that gamma band power reflects a temporal binding phenomenon concerning the coordination of neural assemblies involved in accessing meaning of long samples of speech.

[1]  Van Berkum,et al.  Understanding Sentences in Context What Brain Waves Can Tell Us , 2008 .

[2]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[3]  Alessandro Angrilli,et al.  Gamma EEG activity induced by semantic violation during sentence reading , 2009, Neuroscience Letters.

[4]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[5]  Sabine Weiss,et al.  Increased neuronal communication accompanying sentence comprehension. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  Z. Harris,et al.  Foundations of language , 1941 .

[7]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[8]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[9]  P. Hagoort The fractionation of spoken language understanding by measuring electrical and magnetic brain signals , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Marcus Kaiser,et al.  Temporal Interactions between Cortical Rhythms , 2008, Front. Neurosci..

[11]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[12]  Angela D. Friederici,et al.  Mapping sentence form onto meaning: The syntax–semantic interface , 2007, Brain Research.

[13]  M. Kawato,et al.  Attentional shifts towards an expected visual target alter the level of alpha-band oscillatory activity in the human calcarine cortex. , 2005, Brain research. Cognitive brain research.

[14]  Lyn Frazier,et al.  Theories of sentence processing , 1987 .

[15]  D. Ruchkin,et al.  Neural synchronization mediates on-line sentence processing: EEG coherence evidence from filler-gap constructions. , 2002, Psychophysiology.

[16]  F. Ramus,et al.  Correlates of linguistic rhythm in the speech signal , 1999, Cognition.

[17]  Catherine Tallon-Baudry,et al.  The roles of gamma-band oscillatory synchrony in human visual cognition. , 2009, Frontiers in bioscience.

[18]  A. Jacobs,et al.  Event-Related Potentials Reveal Rapid Verification of Predicted Visual Input , 2009, PloS one.

[19]  Wolf Singer Cognition, Gamma Oscillations and Neuronal Synchrony , 2001, Clinical Neurophysiology.

[20]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[21]  D. Senkowski,et al.  Effects of task difficulty on evoked gamma activity and ERPs in a visual discrimination task , 2002, Clinical Neurophysiology.

[22]  Antoine J. Shahin,et al.  Brain oscillations during semantic evaluation of speech , 2009, Brain and Cognition.

[23]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[24]  P. Hagoort,et al.  Event-related theta power increases in the human EEG during online sentence processing , 2002, Neuroscience Letters.

[25]  Miles A Whittington,et al.  A beta2-frequency (20–30 Hz) oscillation in nonsynaptic networks of somatosensory cortex , 2006, Proceedings of the National Academy of Sciences.

[26]  Marco Buiatti,et al.  Investigating the neural correlates of continuous speech computation with frequency-tagged neuroelectric responses , 2009, NeuroImage.

[27]  S. Grossberg Cortical and subcortical predictive dynamics and learning during perception, cognition, emotion and action , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Jason Tregellas,et al.  Evidence for gamma and beta sensory gating deficits as translational endophenotypes for schizophrenia , 2013, Psychiatry Research: Neuroimaging.

[29]  P. Hagoort,et al.  EEG theta and gamma responses to semantic violations in online sentence processing , 2006, Brain and Language.

[30]  Etienne Hugues,et al.  Augmentation of induced visual gamma activity by increased task complexity , 2003, The European journal of neuroscience.

[31]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[32]  Sabine Weiss,et al.  Quantification of phase synchronization phenomena and their importance for verbal memory processes , 2005, Biological Cybernetics.

[33]  Peter Hagoort,et al.  Beyond the sentence given , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[35]  J. Palva,et al.  New vistas for α-frequency band oscillations , 2007, Trends in Neurosciences.

[36]  Ton Dijkstra,et al.  Theta Responses Are Involved in LexicalSemantic Retrieval during Language Processing , 2005, Journal of Cognitive Neuroscience.

[37]  Panagiotis G. Simos,et al.  Modulation of Gamma-Band Spectral Power by Cognitive Task Complexity , 2004, Brain Topography.

[38]  P. Fries Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[39]  D. Poeppel,et al.  Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex , 2007, Neuron.

[40]  W. Singer,et al.  Synchronization of Neural Activity across Cortical Areas Correlates with Conscious Perception , 2007, The Journal of Neuroscience.

[41]  Anne Cutler,et al.  Flow of information in the spoken word recognition system , 2003, Speech Commun..

[42]  Peter W. Culicover,et al.  The simpler syntax hypothesis , 2006, Trends in Cognitive Sciences.

[43]  Marcel Bastiaansen,et al.  Understanding counterfactuals in discourse modulates ERP and oscillatory gamma rhythms in the EEG , 2012, Brain Research.

[44]  W. Marslen-Wilson,et al.  The temporal structure of spoken language understanding , 1980, Cognition.

[45]  Paul Gorrell,et al.  Syntactic Analysis and Reanalysis in Sentence Processing , 1998 .

[46]  J. Lisman,et al.  Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. , 2002, Cerebral cortex.

[47]  Wolf Singer,et al.  Chapter 1 Cognition, gamma oscillations and neuronal synchrony , 2002 .

[48]  S Braeutigam,et al.  Phase-locked gamma band responses to semantic violation stimuli. , 2001, Brain research. Cognitive brain research.

[49]  Caspar M. Schwiedrzik,et al.  (Micro)Saccades, corollary activity and cortical oscillations , 2009, Trends in Cognitive Sciences.

[50]  Hannah Monyer,et al.  A role for fast rhythmic bursting neurons in cortical gamma oscillations in vitro. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[51]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[52]  Peter Hagoort,et al.  Syntactic Unification Operations Are Reflected in Oscillatory Dynamics during On-line Sentence Comprehension , 2010, Journal of Cognitive Neuroscience.

[53]  Sophie K. Scott,et al.  Do temporal processes underlie left hemisphere dominance in speech perception? , 2013, Brain and Language.

[54]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[55]  Jean-Luc Schwartz,et al.  Parieto-frontal gamma band activity during the perceptual emergence of speech forms , 2008, NeuroImage.

[56]  W. Singer,et al.  Temporal binding and the neural correlates of sensory awareness , 2001, Trends in Cognitive Sciences.

[57]  Ton Dijkstra,et al.  Context-dependent Semantic Processing in the Human Brain: Evidence from Idiom Comprehension , 2013, Journal of Cognitive Neuroscience.

[58]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[59]  Peter Hagoort,et al.  Syntactic Processing Modulates the θ Rhythm of the Human EEG , 2002, NeuroImage.

[60]  L. Aravind,et al.  Integration of Word Meaning and World Knowledge in Language Comprehension , 2022 .

[61]  Sabine Weiss,et al.  The contribution of EEG coherence to the investigation of language , 2003, Brain and Language.

[62]  Steven Greenberg,et al.  Temporal properties of spontaneous speech - a syllable-centric perspective , 2003, J. Phonetics.

[63]  Febo Cincotti,et al.  Sub-second "temporal attention" modulates alpha rhythms. A high-resolution EEG study. , 2004, Brain research. Cognitive brain research.

[64]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[65]  H. Barber,et al.  Grammatical agreement processing in reading: ERP findings and future directions , 2011, Cortex.

[66]  Erin Winterrowd,et al.  Abnormalities in gamma-band responses to language stimuli in first-degree relatives of children with autism spectrum disorder: an MEG study , 2012, BMC Psychiatry.

[67]  D. Furness,et al.  Abstracts of the Fourth Joint Annual Conference, Experimental and Clinical Short Papers Meetings of the British Society of Audiology , 2014 .

[68]  Robert Oostenveld,et al.  Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming , 2008, NeuroImage.

[69]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[70]  R. Oostenveld,et al.  I see what you mean: Theta power increases are involved in the retrieval of lexical semantic information , 2008, Brain and Language.

[71]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[72]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[73]  J. Palva,et al.  New vistas for alpha-frequency band oscillations. , 2007, Trends in neurosciences.

[74]  A. von Stein,et al.  Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[75]  Richard S. J. Frackowiak,et al.  Endogenous Cortical Rhythms Determine Cerebral Specialization for Speech Perception and Production , 2007, Neuron.

[76]  E. Vajda Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet , 2000 .

[77]  Caspar M. Schwiedrzik,et al.  Expectations Change the Signatures and Timing of Electrophysiological Correlates of Perceptual Awareness , 2011, The Journal of Neuroscience.

[78]  Werner Lutzenberger,et al.  Dynamics of Gamma-Band Activity during an Audiospatial Working Memory Task in Humans , 2002, The Journal of Neuroscience.

[79]  Pienie Zwitserlood,et al.  Plasticity of the human auditory cortex induced by discrimination learning of non-native, mora-timed contrasts of the Japanese language. , 2002, Learning & memory.

[80]  Peter Hagoort,et al.  Syntactic processing modulates the theta rhythm of the human EEG. , 2002, NeuroImage.

[81]  W. Klimesch,et al.  The role of theta and alpha oscillations for language comprehension in the human electroencephalogram , 2001, Neuroscience Letters.

[82]  Francisco Rodríguez-Quioñes Spanish researchers defeated by the system , 1999, Nature.

[83]  James L. McClelland,et al.  Sentence comprehension: A parallel distributed processing approach , 1989, Language and Cognitive Processes.

[84]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[85]  M. Tervaniemi,et al.  Binding symbols and sounds: evidence from event-related oscillatory gamma-band activity. , 2007, Cerebral cortex.