Neural Encoding of Attended Continuous Speech under Different Types of Interference

We examined how attention modulates the neural encoding of continuous speech under different types of interference. In an EEG experiment, participants attended to a narrative in English while ignoring a competing stream in the other ear. Four different types of interference were presented to the unattended ear: a different English narrative, a narrative in a language unknown to the listener (Spanish), a well-matched nonlinguistic acoustic interference (Musical Rain), and no interference. Neural encoding of attended and unattended signals was assessed by calculating cross-correlations between their respective envelopes and the EEG recordings. Findings revealed more robust neural encoding for the attended envelopes compared with the ignored ones. Critically, however, the type of the interfering stream significantly modulated this process, with the fully intelligible distractor (English) causing the strongest encoding of both attended and unattended streams and latest dissociation between them and nonintelligible distractors causing weaker encoding and early dissociation between attended and unattended streams. The results were consistent over the time course of the spoken narrative. These findings suggest that attended and unattended information can be differentiated at different depths of processing analysis, with the locus of selective attention determined by the nature of the competing stream. They provide strong support to flexible accounts of auditory selective attention.

[1]  D. Poeppel,et al.  Speech Perception from a Neurophysiological Perspective , 2012 .

[2]  John J. Foxe,et al.  Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution , 2010, The European journal of neuroscience.

[3]  S. Scott,et al.  Enhancing the Sensitivity of a Sustained Attention Task to Frontal Damage: Convergent Clinical and Functional Imaging Evidence , 2003, Neurocase.

[4]  Charles Darwin,et al.  Effect of voice characteristics on the attended and unattended processing of two concurrent messages , 2008 .

[5]  S. Rosen.  Temporal information in speech: acoustic, auditory and linguistic aspects. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[7]  D. Abrams,et al.  Right-Hemisphere Auditory Cortex Is Dominant for Coding Syllable Patterns in Speech , 2008, The Journal of Neuroscience.

[8]  Steven A. Hillyard,et al.  Semantic processing and memory for attended and unattended words in dichotic listening: behavioral and electrophysiological evidence. , 1995, Journal of experimental psychology. Human perception and performance.

[9]  Antoine J. Shahin,et al.  Attentional Gain Control of Ongoing Cortical Speech Representations in a “Cocktail Party” , 2010, The Journal of Neuroscience.

[10]  R. Plomp,et al.  Effect of temporal envelope smearing on speech reception. , 1994, The Journal of the Acoustical Society of America.

[11]  David Poeppel,et al.  The effects of selective attention and speech acoustics on neural speech-tracking in a multi-talker scene , 2015, Cortex.

[12]  M. D'Zmura.  EEG reveals divergent paths for speech envelopes during selective attention , 2011 .

[13]  William D Marslen-Wilson,et al.  Processing interactions and lexical access during word recognition in continuous speech , 1978, Cognitive Psychology.

[14]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[15]  A. Bronkhorst.  The cocktail-party problem revisited: early processing and selection of multi-talker speech , 2015, Attention, Perception, & Psychophysics.

[16]  Ulrich H. Frauenfelder,et al.  The process of spoken word recognition: An introduction , 1987, Cognition.

[17]  Steven Greenberg,et al.  Temporal properties of spontaneous speech - a syllable-centric perspective , 2003, J. Phonetics.

[18]  T. Picton,et al.  Human Cortical Responses to the Speech Envelope , 2008, Ear and hearing.

[19]  Joachim Gross,et al.  Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension , 2012, Cerebral cortex.

[20]  R. Zatorre,et al.  Where is 'where' in the human auditory cortex? , 2002, Nature Neuroscience.

[21]  Sandra Murphy,et al.  Perceptual load does not modulate auditory distractor processing , 2013, Cognition.

[22]  Roy D. Patterson,et al.  Locating the initial stages of speech–sound processing in human temporal cortex , 2006, NeuroImage.

[23]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[24]  WILLIAM MARSLEN-WILSON,et al.  Linguistic Structure and Speech Shadowing at Very Short Latencies , 1973, Nature.

[25]  N. Cowan,et al.  The cocktail party phenomenon revisited: how frequent are attention shifts to one's name in an irrelevant auditory channel? , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[26]  E. Eich,et al.  Memory for unattended events: Remembering with and without awareness , 1984, Memory & cognition.

[27]  Emmanuel Dupoux,et al.  Lexical access without attention? Explorations using dichotic priming. , 2003, Journal of experimental psychology. Human perception and performance.

[28]  Jonathan Z. Simon,et al.  Robust cortical entrainment to the speech envelope relies on the spectro-temporal fine structure , 2014, NeuroImage.

[29]  T W Picton,et al.  Human auditory evoked potentials. II. Effects of attention. , 1974, Electroencephalography and clinical neurophysiology.

[30]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[31]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[32]  Ying-Yee Kong,et al.  Differential modulation of auditory responses to attended and unattended speech in different listening conditions , 2014, Hearing Research.

[33]  Anna S. Hasting,et al.  Syntax as a reflex: Neurophysiological evidence for early automaticity of grammatical processing , 2008, Brain and Language.

[34]  Jennifer Aydelott,et al.  Semantic processing of unattended speech in dichotic listening. , 2015, The Journal of the Acoustical Society of America.

[35]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[36]  D. Broadbent.  Perception and communication , 1958 .

[37]  Lorraine K. Tyler,et al.  The Time Course of Activation of Semantic Information during Spoken Word Recognition , 1997 .

[38]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[39]  John J. Foxe,et al.  At what time is the cocktail party? A late locus of selective attention to natural speech , 2012, The European journal of neuroscience.

[40]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[41]  J. R. Doyle.  Semantic activation without conscious identification in dichotic listening , parafoveal vision , and visual masking : A survey and appraisal , 2008 .

[42]  W. J. Langford.  Statistical Methods , 1959, Nature.

[43]  Roy D. Patterson,et al.  Tracking cortical entrainment in neural activity: auditory processes in human temporal cortex , 2015, Front. Comput. Neurosci..

[44]  David Poeppel,et al.  Acoustic landmarks drive delta–theta oscillations to enable speech comprehension by facilitating perceptual parsing , 2014, NeuroImage.

[45]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[46]  W. Johnston,et al.  Flexibility and capacity demands of attention , 1978 .

[47]  M. Kutas,et al.  Semantic processing and memory for attended and unattended words in dichotic listening: behavioral and electrophysiological evidence. , 1995, Journal of experimental psychology. Human perception and performance.

[48]  Lucas S. Baltzell,et al.  Attention selectively modulates cortical entrainment in different regions of the speech spectrum , 2016, Brain Research.

[49]  M. Husain,et al.  Role of right posterior parietal cortex in maintaining attention to spatial locations over time , 2009, Brain : a journal of neurology.

[50]  N. Cowan,et al.  Is there implicit memory without attention? A reexamination of task demands in Eich’s (1984) procedure , 1997, Memory & cognition.

[51]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[52]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[53]  R. Plomp,et al.  Effect of reducing slow temporal modulations on speech reception. , 1994, The Journal of the Acoustical Society of America.

[54]  D. T. Ives,et al.  Bihemispheric foundations for human speech comprehension , 2010, Proceedings of the National Academy of Sciences.

[55]  E. C. Cherry.  Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[56]  J. Duncan.  The locus of interference in the perception of simultaneous stimuli. , 1980, Psychological review.

[57]  Douglas S Brungart,et al.  Effect of target-masker similarity on across-ear interference in a dichotic cocktail-party listening task. , 2007, The Journal of the Acoustical Society of America.

[58]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[59]  R. Burkard.  Human Auditory Evoked Potentials , 2010 .

[60]  D. Poeppel,et al.  Temporal context in speech processing and attentional stream selection: A behavioral and neural perspective , 2012, Brain and Language.

[61]  Matthew S. Tata,et al.  Theta-band phase tracking in the two-talker problem , 2014, Brain and Language.

[62]  J. Bendat,et al.  Random Data: Analysis and Measurement Procedures , 1987 .

[63]  Ramesh Srinivasan,et al.  Suppression of competing speech through entrainment of cortical oscillations. , 2013, Journal of neurophysiology.

[64]  Stephen E. Newstead,et al.  Lexical and Grammatical Processing of Unshadowed Messages: A Re-Examination of the Mackay Effect , 1979 .

[65]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[66]  C. Koch.  Strategies and Models of Selective Attention , 2010 .

[67]  Jonathan R. Folstein,et al.  Novelty and conflict in the categorization of complex stimuli. , 2008, Psychophysiology.

[68]  D. Kahneman,et al.  Attention and Effort , 1973 .

[69]  M. D'Zmura,et al.  Envelope responses in single-trial EEG indicate attended speaker in a ‘cocktail party’ , 2014, Journal of Neural Engineering.

[70]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .