Neural entrainment determines the words we hear

Low-frequency neural entrainment to rhythmic input has been hypothesized as a canonical mechanism that shapes sensory perception in time. Neural entrainment is deemed particularly relevant for speech analysis, as it would contribute to the extraction of discrete linguistic elements from continuous acoustic signals. Yet, its causal influence in speech perception has been difficult to establish. Here, we provide evidence that oscillations build temporal predictions about the duration of speech tokens that directly influence perception. Using magnetoencephalography (MEG), we studied neural dynamics during listening to sentences that changed in speech rate. We observed neural entrainment to preceding speech rhythms persisting for several cycles after the change in rate. The sustained entrainment was associated with changes in the perceived duration of the last word’s vowel, resulting in the perception of words with radically different meanings. These findings support oscillatory models of speech processing, suggesting that neural oscillations actively shape speech perception.

[1]  C. Schroeder,et al.  Neuronal oscillations as a mechanistic substrate of auditory temporal prediction , 2015, Annals of the New York Academy of Sciences.

[2]  Matthias J. Sjerps,et al.  Cognitive load makes speech sound fast, but does not modulate acoustic context effects , 2017 .

[3]  A. Schnitzler,et al.  Dynamic imaging of coherent sources: Studying neural interactions in the human brain. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Eva Reinisch,et al.  The uptake of spectral and temporal cues in vowel perception is rapidly influenced by context , 2013, J. Phonetics.

[5]  Richard S. J. Frackowiak,et al.  Endogenous Cortical Rhythms Determine Cerebral Specialization for Speech Perception and Production , 2007, Neuron.

[6]  P. Schyns,et al.  Speech Rhythms and Multiplexed Oscillatory Sensory Coding in the Human Brain , 2013, PLoS biology.

[7]  Robin A. A. Ince,et al.  Frontal Top-Down Signals Increase Coupling of Auditory Low-Frequency Oscillations to Continuous Speech in Human Listeners , 2015, Current Biology.

[8]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[9]  David Poeppel,et al.  Rule-based and word-level statistics-based processing of language: insights from neuroscience , 2017, Language, cognition and neuroscience.

[10]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[11]  J. Simon,et al.  Cortical entrainment to continuous speech: functional roles and interpretations , 2014, Front. Hum. Neurosci..

[12]  A. Boemio,et al.  Hierarchical and asymmetric temporal sensitivity in human auditory cortices , 2005, Nature Neuroscience.

[13]  Joachim Gross,et al.  Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension , 2012, Cerebral cortex.

[14]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[15]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[16]  David Poeppel,et al.  Acoustic landmarks drive delta–theta oscillations to enable speech comprehension by facilitating perceptual parsing , 2014, NeuroImage.

[17]  Ankoor S. Shah,et al.  An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. , 2005, Journal of neurophysiology.

[18]  P. Schyns,et al.  Entrainment of Perceptually Relevant Brain Oscillations by Non-Invasive Rhythmic Stimulation of the Human Brain , 2011, Front. Psychology.

[19]  C. Schroeder,et al.  The Spectrotemporal Filter Mechanism of Auditory Selective Attention , 2013, Neuron.

[20]  Saskia Haegens,et al.  Temporal expectations and neural amplitude fluctuations in auditory cortex interactively influence perception , 2016, NeuroImage.

[21]  Robin A A Ince,et al.  Irregular Speech Rate Dissociates Auditory Cortical Entrainment, Evoked Responses, and Frontal Alpha , 2015, The Journal of Neuroscience.

[22]  R. Zatorre,et al.  Spectral and temporal processing in human auditory cortex. , 2001, Cerebral cortex.

[23]  Gregory Hickok,et al.  The Rhythm of Perception , 2015, Psychological science.

[24]  Floris P. de Lange,et al.  Local Entrainment of Alpha Oscillations by Visual Stimuli Causes Cyclic Modulation of Perception , 2014, The Journal of Neuroscience.

[25]  Virginie van Wassenhove,et al.  Distinct contributions of low- and high-frequency neural oscillations to speech comprehension , 2017 .

[26]  Hans Rutger Bosker,et al.  How Our Own Speech Rate Influences Our Perception of Others , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Oded Ghitza,et al.  Linking Speech Perception and Neurophysiology: Speech Decoding Guided by Cascaded Oscillators Locked to the Input Rhythm , 2011, Front. Psychology.

[28]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[29]  Y. Samson,et al.  Lateralization of Speech and Auditory Temporal Processing , 1998, Journal of Cognitive Neuroscience.

[30]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[31]  Sophie K. Scott,et al.  Do temporal processes underlie left hemisphere dominance in speech perception? , 2013, Brain and Language.

[32]  V. Jousmäki,et al.  The pace of prosodic phrasing couples the listener's cortex to the reader's voice , 2013, Human brain mapping.

[33]  Laura C. Dilley,et al.  Altering Context Speech Rate Can Cause Words to Appear or Disappear , 2010, Psychological science.

[34]  R. VanRullen.  Perceptual Cycles , 2016, Trends in Cognitive Sciences.

[35]  Björn Herrmann,et al.  Neural Oscillations in Speech: Don't be Enslaved by the Envelope , 2012, Front. Hum. Neurosci..

[36]  Alexander T Sack,et al.  Oscillatory phase shapes syllable perception , 2015, Proceedings of the National Academy of Sciences.

[37]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[38]  D. Poeppel,et al.  Cortical Tracking of Hierarchical Linguistic Structures in Connected Speech , 2015, Nature Neuroscience.

[39]  E Ahissar,et al.  Speech comprehension is correlated with temporal response patterns recorded from auditory cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[40]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[41]  Jonathan Z. Simon,et al.  Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech , 2013, The Journal of Neuroscience.

[42]  Alexandre Gramfort,et al.  Encoding of event timing in the phase of neural oscillations , 2014, NeuroImage.

[43]  Jérémie Lefebvre,et al.  Modulation of Cortical Oscillations by Low-Frequency Direct Cortical Stimulation Is State-Dependent , 2016, PLoS biology.

[44]  J. McQueen,et al.  Speaking rate from proximal and distal contexts is used during word segmentation. , 2011, Journal of experimental psychology. Human perception and performance.

[45]  Alexandre Hyafil,et al.  Speech encoding by coupled cortical theta and gamma oscillations , 2015, eLife.

[46]  D. Abrams,et al.  Right-Hemisphere Auditory Cortex Is Dominant for Coding Syllable Patterns in Speech , 2008, The Journal of Neuroscience.

[47]  Anahita Basirat,et al.  High-frequency neural activity predicts word parsing in ambiguous speech streams. , 2016, Journal of neurophysiology.

[48]  Titia Benders,et al.  Native, non-native and L2 perceptual cue weighting for Dutch vowels: The case of Dutch, German, and Spanish listeners , 2009, J. Phonetics.

[49]  Rufin VanRullen,et al.  The Role of High-Level Processes for Oscillatory Phase Entrainment to Speech Sound , 2015, Front. Hum. Neurosci..

[50]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[51]  Matthew H. Davis,et al.  Neural Oscillations Carry Speech Rhythm through to Comprehension , 2012, Front. Psychology.

[52]  H. Bosker.  Accounting for rate-dependent category boundary shifts in speech perception , 2016, Attention, Perception, & Psychophysics.

[53]  Edmund C. Lalor,et al.  Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing , 2015, Current Biology.