Covert attention allows for continuous control of brain–computer interfaces

While brain‐computer interfaces (BCIs) can be used for controlling external devices, they also hold the promise of providing a new tool for studying the working brain. In this study we investigated whether modulations of brain activity by changes in covert attention can be used as a continuous control signal for BCI. Covert attention is the act of mentally focusing on a peripheral sensory stimulus without changing gaze direction. The ongoing brain activity was recorded using magnetoencephalography in subjects as they covertly attended to a moving cue while maintaining fixation. Based on posterior alpha power alone, the direction to which subjects were attending could be recovered using circular regression. Results show that the angle of attention could be predicted with a mean absolute deviation of 51° in our best subject. Averaged over subjects, the mean deviation was ∼70°. In terms of information transfer rate, the optimal data length used for recovering the direction of attention was found to be 1700 ms; this resulted in a mean absolute deviation of 60° for the best subject. The results were obtained without any subject‐specific feature selection and did not require prior subject training. Our findings demonstrate that modulations of posterior alpha activity due to the direction of covert attention has potential as a control signal for continuous control in a BCI setting. Our approach will have several applications, including a brain‐controlled computer mouse and improved methods for neuro‐feedback that allow direct training of subjects’ ability to modulate posterior alpha activity.

[1]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[2]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[3]  Nicholas I. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[4]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[5]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[6]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[7]  Thomas R Knösche,et al.  Tangential derivative mapping of axial MEG applied to event-related desynchronization research , 2000, Clinical Neurophysiology.

[8]  G. V. Simpson,et al.  Anticipatory Biasing of Visuospatial Attention Indexed by Retinotopically Specific α-Bank Electroencephalography Increases over Occipital Cortex , 2000, The Journal of Neuroscience.

[9]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[10]  S. Schiff,et al.  Interplay of Electroencephalogram Phase and Auditory-Evoked Neural Activity , 2003, The Journal of Neuroscience.

[11]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[12]  John J. Foxe,et al.  Independent Brain Computer Interface Control using Visual Spatial Attention-Dependent Modulations of Parieto-occipital Alpha , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[13]  John J. Foxe,et al.  Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Simon P. Kelly,et al.  Visual spatial attention control in an independent brain-computer interface , 2005, IEEE Transactions on Biomedical Engineering.

[15]  Manuel Schabus,et al.  Increasing Individual Upper Alpha Power by Neurofeedback Improves Cognitive Performance in Human Subjects , 2005, Applied psychophysiology and biofeedback.

[16]  John J. Foxe,et al.  Increases in alpha oscillatory power reflect an active retinotopic mechanism for distracter suppression during sustained visuospatial attention. , 2006, Journal of neurophysiology.

[17]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[18]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[19]  Christa Neuper,et al.  Motor imagery and EEG-based control of spelling devices and neuroprostheses. , 2006, Progress in brain research.

[20]  Christa Neuper,et al.  Future prospects of ERD/ERS in the context of brain-computer interface (BCI) developments. , 2006, Progress in brain research.

[21]  N. Birbaumer.  Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[22]  Simon Hanslmayr,et al.  Prestimulus oscillations predict visual perception performance between and within subjects , 2007, NeuroImage.

[23]  Marc Wildi,et al.  Test–retest reliability of resting EEG spectra validates a statistical signature of persons , 2007, Clinical Neurophysiology.

[24]  O. Jensen,et al.  Modulation of Gamma and Alpha Activity during a Working Memory Task Engaging the Dorsal or Ventral Stream , 2007, The Journal of Neuroscience.

[25]  Jonathan R Wolpaw,et al.  Brain–computer interfaces as new brain output pathways , 2007, The Journal of physiology.

[26]  G. Thut,et al.  Mechanisms of selective inhibition in visual spatial attention are indexed by α‐band EEG synchronization , 2007, The European journal of neuroscience.

[27]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[28]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[29]  C. Cinel,et al.  P300-Based BCI Mouse With Genetically-Optimized Analogue Control , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Pascal Fries,et al.  Gamma-Band Activity in Human Posterior Parietal Cortex Encodes the Motor Goal during Delayed Prosaccades and Antisaccades , 2008, The Journal of Neuroscience.

[31]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[32]  Dean J Krusienski,et al.  Emulation of computer mouse control with a noninvasive brain–computer interface , 2008, Journal of neural engineering.

[33]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[34]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[35]  M. Schoonheim,et al.  Sleep benefits subsequent hippocampal functioning , 2009, Nature Neuroscience.

[36]  John J. Foxe,et al.  The strength of anticipatory spatial biasing predicts target discrimination at attended locations: a high‐density EEG study , 2009, The European journal of neuroscience.

[37]  C. Braun,et al.  A review on directional information in neural signals for brain-machine interfaces , 2009, Journal of Physiology-Paris.

[38]  Christoph M. Michel,et al.  A bias for posterior α-band power suppression versus enhancement during shifting versus maintenance of spatial attention , 2009, NeuroImage.

[39]  Miguel A. L. Nicolelis,et al.  A Brain-Machine Interface Instructed by Direct Intracortical Microstimulation , 2009, Front. Integr. Neurosci..

[40]  N. Logothetis,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Directed Interactions between Auditory and Superior Temporal Cortices and Their Role in Sensory Integration , 2022 .

[41]  R. Veit,et al.  Self‐regulation of regional cortical activity using real‐time fMRI: The right inferior frontal gyrus and linguistic processing , 2009, Human brain mapping.

[42]  Tom Heskes,et al.  Selecting features for BCI control based on a covert spatial attention paradigm , 2009, Neural Networks.

[43]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[44]  M. V. Gerven,et al.  Attention modulations of posterior alpha as a control signal for two-dimensional brain–computer interfaces , 2009, Journal of Neuroscience Methods.

[45]  Johannes Gräff,et al.  Epigenetic dysregulation in cognitive disorders , 2009, The European journal of neuroscience.

[46]  C. Spearman.  The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[47]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.