Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG.

How humans solve the cocktail party problem remains unknown. However, progress has been made recently thanks to the realization that cortical activity tracks the amplitude envelope of speech. This has led to the development of regression methods for studying the neurophysiology of continuous speech. One such method, known as stimulus-reconstruction, has been successfully utilized with cortical surface recordings and magnetoencephalography (MEG). However, the former is invasive and gives a relatively restricted view of processing along the auditory hierarchy, whereas the latter is expensive and rare. Thus it would be extremely useful for research in many populations if stimulus-reconstruction was effective using electroencephalography (EEG), a widely available and inexpensive technology. Here we show that single-trial (≈60 s) unaveraged EEG data can be decoded to determine attentional selection in a naturalistic multispeaker environment. Furthermore, we show a significant correlation between our EEG-based measure of attention and performance on a high-level attention task. In addition, by attempting to decode attention at individual latencies, we identify neural processing at ∼200 ms as being critical for solving the cocktail party problem. These findings open up new avenues for studying the ongoing dynamics of cognition using EEG and for developing effective and natural brain-computer interfaces.

[1]  A. Treisman VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[2]  T W Picton,et al.  Human auditory evoked potentials. II. Effects of attention. , 1974, Electroencephalography and clinical neurophysiology.

[3]  S. Hillyard,et al.  Human auditory evoked potentials. I. Evaluation of components. , 1974, Electroencephalography and clinical neurophysiology.

[4]  S. Hillyard,et al.  Auditory evoked potentials during selective listening to dichotic speech messages , 1976 .

[5]  S. Hillyard,et al.  Event-related brain potentials reveal similar attentional mechanisms during selective listening and shadowing. , 1984, Journal of experimental psychology. Human perception and performance.

[6]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[7]  Wolfgang Teder,et al.  Auditory attention and selective input modulation: A topographical ERP study , 1992, Neuroreport.

[8]  R. Näätänen,et al.  Selection of speech messages in free-field listening. , 1993, Neuroreport.

[9]  W. Bialek,et al.  Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  P Berg,et al.  New concepts of brain source imaging and localization. , 1996, Electroencephalography and clinical neurophysiology. Supplement.

[11]  G B Stanley,et al.  Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus , 1999, The Journal of Neuroscience.

[12]  Risto Näätänen,et al.  Effects of Haloperidol on Selective Attention A Combined Whole-Head MEG and High-Resolution EEG Study , 2001, Neuropsychopharmacology.

[13]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[14]  E. C. Cmm,et al.  on the Recognition of Speech, with , 2008 .

[15]  S. David,et al.  Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex. , 2009, Journal of neurophysiology.

[16]  John J. Foxe,et al.  Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution , 2010, The European journal of neuroscience.

[17]  Antoine J. Shahin,et al.  Attentional Gain Control of Ongoing Cortical Speech Representations in a “Cocktail Party” , 2010, The Journal of Neuroscience.

[18]  Preben Kidmose,et al.  Towards estimating selective auditory attention from EEG using a novel time-frequency-synchronisation framework , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[19]  R. Burkard Human Auditory Evoked Potentials , 2010 .

[20]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[21]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[22]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[23]  N. Mesgarani,et al.  Selective cortical representation of attended speaker in multi-talker speech perception , 2012, Nature.

[24]  John J. Foxe,et al.  At what time is the cocktail party? A late locus of selective attention to natural speech , 2012, The European journal of neuroscience.

[25]  Matthew H. Davis,et al.  Neural Oscillations Carry Speech Rhythm through to Comprehension , 2012, Front. Psychology.

[26]  Lenny A. Varghese,et al.  Quantifying attentional modulation of auditory-evoked cortical responses from single-trial electroencephalography , 2013, Front. Hum. Neurosci..

[27]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[28]  David Poeppel,et al.  Neuronal oscillations and speech perception: critical-band temporal envelopes are the essence , 2013, Front. Hum. Neurosci..

[29]  Samuel Kaski,et al.  Identifying fragments of natural speech from the listener's MEG signals , 2013, Human brain mapping.

[30]  Jonathan Z. Simon,et al.  Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech , 2013, The Journal of Neuroscience.

[31]  D. Manahan‐Vaughan,et al.  Locus Coeruleus Stimulation Facilitates Long-Term Depression in the Dentate Gyrus That Requires Activation of β-Adrenergic Receptors , 2014, Cerebral cortex.

[32]  张静,et al.  Banana Ovate family protein MaOFP1 and MADS-box protein MuMADS1 antagonistically regulated banana fruit ripening , 2015 .

[33]  N. Maurits,et al.  A Brain-Wide Study of Age-Related Changes in Functional Connectivity. , 2015, Cerebral cortex.

[34]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .