Target of selective auditory attention can be robustly followed with MEG

Selective auditory attention enables filtering relevant from irrelevant acoustic information. Specific auditory responses, measurable by electro- and magnetoencephalography (EEG/MEG), are known to be modulated by attention to the evoking stimuli. However, these attention effects are typically demonstrated in averaged responses and their robustness in single trials is not studied extensively. We applied decoding algorithms to MEG to investigate how well the target of auditory attention could be determined from single responses and which spatial and temporal aspects of the responses carry most of the information regarding the target of attention. To this end, we recorded brain responses of 15 healthy subjects with MEG when they selectively attended to one of the simultaneously presented auditory streams of words “Yes” and “No”. A support vector machine was trained on the MEG data both at the sensor and source level to predict at every trial which stream was attended. Sensor-level decoding of the attended stream using the entire 2-s epoch resulted in a mean accuracy of 93%±1% (range 83–99% across subjects). Time-resolved decoding revealed that the highest accuracies were obtained 200–350 ms after the stimulus onset. Spatially-resolved source-level decoding indicated that the cortical sources most informative of the attended stream were located primarily in the auditory cortex, especially in the right hemi-sphere. Our result corroborates attentional modulation of auditory evoked responses also to naturalistic stimuli. The achieved high decoding accuracy could enable the use of our experimental paradigm and classification method in a brain–computer interface.

[1]  S. Kochen,et al.  Expectation and Attention in Hierarchical Auditory Prediction , 2013, The Journal of Neuroscience.

[2]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[3]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[4]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[5]  G. Rizzolatti,et al.  Selective visual attention. , 1987, Neuropsychologia.

[6]  Isao Nambu,et al.  Improving the Performance of an Auditory Brain-Computer Interface Using Virtual Sound Sources by Shortening Stimulus Onset Asynchrony , 2018, Front. Neurosci..

[7]  E. C. Cherry Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[8]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Sebastian Halder,et al.  An Evaluation of Training with an Auditory P300 Brain-Computer Interface for the Japanese Hiragana Syllabary , 2016, Front. Neurosci..

[11]  G. Kidd,et al.  Enhancing Auditory Selective Attention Using a Visually Guided Hearing Aid. , 2017, Journal of speech, language, and hearing research : JSLHR.

[12]  Hyun Jae Baek,et al.  Music and natural sounds in an auditory steady-state response based brain-computer interface to increase user acceptance , 2017, Comput. Biol. Medicine.

[13]  S. Dehaene,et al.  Neural signature of the conscious processing of auditory regularities , 2009, Proceedings of the National Academy of Sciences.

[14]  Riitta Hari,et al.  Removal of magnetoencephalographic artifacts with temporal signal‐space separation: Demonstration with single‐trial auditory‐evoked responses , 2009, Human brain mapping.

[15]  V. A. Konyshev,et al.  A P300-based brain—computer interface , 2007, Meditsinskaia tekhnika.

[16]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[17]  Isao Nambu,et al.  Estimating the Intended Sound Direction of the User: Toward an Auditory Brain-Computer Interface Using Out-of-Head Sound Localization , 2013, PloS one.

[18]  M. Kamrunnahar,et al.  Single Trial Predictors for Gating Motor-Imagery Brain-Computer Interfaces Based on Sensorimotor Rhythm and Visual Evoked Potentials , 2016, Front. Neurosci..

[19]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[20]  J. Wolpaw,et al.  P300-based brain-computer interface (BCI) event-related potentials (ERPs): People with amyotrophic lateral sclerosis (ALS) vs. age-matched controls , 2015, Clinical Neurophysiology.

[21]  Chang-Hwan Im,et al.  Classification of selective attention to auditory stimuli: Toward vision-free brain–computer interfacing , 2011, Journal of Neuroscience Methods.

[22]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[23]  N. Birbaumer,et al.  An auditory oddball brain–computer interface for binary choices , 2010, Clinical Neurophysiology.

[24]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[25]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[26]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[27]  Sebastian Halder,et al.  Comparison of Four Control Methods for a Five-Choice Assistive Technology , 2018, Front. Hum. Neurosci..

[28]  Klaus-Robert Müller,et al.  An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity , 2014, PloS one.

[29]  Elaine Astrand,et al.  Selective visual attention to drive cognitive brain–machine interfaces: from concepts to neurofeedback and rehabilitation applications , 2014, Front. Syst. Neurosci..

[30]  Gerwin Schalk,et al.  Communication and Control by Listening: Toward Optimal Design of a Two-Class Auditory Streaming Brain-Computer Interface , 2012, Front. Neurosci..

[31]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[32]  J. Wolpaw,et al.  A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening , 2014, Journal of neural engineering.

[33]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Tjerk P. Straatsma,et al.  NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations , 2010, Comput. Phys. Commun..

[35]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[36]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[37]  Sungho Jo,et al.  A novel hybrid auditory BCI paradigm combining ASSR and P300 , 2017, Journal of Neuroscience Methods.

[38]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[39]  G. Kidd,et al.  Analogy of Selective Attention Acting as a light Shined on the Source of Interest r Volitional Control , 2017 .

[40]  Jonathan Westley Peirce,et al.  Neuroinformatics Original Research Article Generating Stimuli for Neuroscience Using Psychopy , 2022 .

[41]  Dennis J. McFarland,et al.  P 300-based brain-computer interface ( BCI ) event-related potentials ( ERPs ) : People with amyotrophic lateral sclerosis ( ALS ) vs . age-matched controls , 2015 .

[42]  Michael Tangermann,et al.  Eyes-Closed Increases the Usability of Brain-Computer Interfaces Based on Auditory Event-Related Potentials , 2018, Front. Hum. Neurosci..

[43]  Karim Jerbi,et al.  Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy , 2015, Journal of Neuroscience Methods.

[44]  Bruno A. Olshausen,et al.  Selective visual attention , 1998 .

[45]  Hasan Ayaz,et al.  A P300-based EEG-BCI for spatial navigation control , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.