A cognitive brain–computer interface monitoring sustained attentional variations during a continuous task

We introduce a cognitive brain–computer interface based on a continuous performance task for the monitoring of variations of visual sustained attention, i.e. the self-directed maintenance of cognitive focus in non-arousing conditions while possibly ignoring distractors and avoiding mind wandering. We introduce a visual sustained attention continuous performance task with three levels of task difficulty. Pairwise discrimination of these task difficulties from electroencephalographic features was performed using a leave-one-subject-out cross validation approach. Features were selected using the orthogonal forward regression supervised feature selection method. Cognitive load was best predicted using a combination of prefrontal theta power, broad spatial range gamma power, fronto-central beta power, and fronto-central alpha power. Generalization performance estimates for pairwise classification of task difficulty using these features reached 75% for 5 s epochs, and 85% for 30 s epochs.

[1]  Rajesh P. N. Rao,et al.  A Direct Brain-to-Brain Interface in Humans , 2014, PloS one.

[2]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[3]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[4]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[5]  John J. Foxe,et al.  Anticipatory Attentional Suppression of Visual Features Indexed by Oscillatory Alpha-Band Power Increases:A High-Density Electrical Mapping Study , 2010, The Journal of Neuroscience.

[6]  Dewen Hu,et al.  Usage of drip drops as stimuli in an auditory P300 BCI paradigm , 2018, Cognitive Neurodynamics.

[7]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[8]  Miguel Nicolelis Beyond Boundaries: The New Neuroscience of Connecting Brains with Machines---and How It Will Change Our Lives , 2011 .

[9]  D. Berlyne Conflict, arousal, and curiosity , 2014 .

[10]  Damien Coyle,et al.  Games, Gameplay, and BCI: The State of the Art , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[11]  Roshan Cools,et al.  Region-specific modulations in oscillatory alpha activity serve to facilitate processing in the visual and auditory modalities , 2014, NeuroImage.

[12]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[13]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[14]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[15]  Guojun Dai,et al.  EEG classification of driver mental states by deep learning , 2018, Cognitive Neurodynamics.

[16]  Michael E. Smith,et al.  Neurophysiological measures of cognitive workload during human-computer interaction , 2003 .

[17]  Charan Ranganath,et al.  Frontal midline theta oscillations during working memory maintenance and episodic encoding and retrieval , 2014, NeuroImage.

[18]  S. Fairclough,et al.  The effect of task demand and incentive on neurophysiological and cardiovascular markers of effort. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Matti S. Hämäläinen,et al.  Dynamic Oscillatory Processes Governing Cued Orienting and Allocation of Auditory Attention , 2013, Journal of Cognitive Neuroscience.

[20]  Antoine Gaume,et al.  Towards cognitive brain-computer interfaces : real-time monitoring of visual processing and control using electroencephalography , 2016 .

[21]  Antoine Gaume,et al.  Towards cognitive BCI: Neural correlates of sustained attention in a continuous performance task , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[22]  M Congedo,et al.  Neurofeedback: One of today's techniques in psychiatry? , 2017, L'Encephale.

[23]  Keinosuke Fukunaga,et al.  Statistical Pattern Recognition , 1993, Handbook of Pattern Recognition and Computer Vision.

[24]  Sayan Nag,et al.  Music of brain and music on brain: a novel EEG sonification approach , 2018, Cognitive Neurodynamics.

[25]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[26]  C. Reynolds,et al.  The continuous performance test: a window on the neural substrates for attention? , 2002, Archives of Clinical Neuropsychology.

[27]  W. Klimesch,et al.  EEG alpha synchronization and functional coupling during top‐down processing in a working memory task , 2005, Human brain mapping.

[28]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[29]  A. Gaume,et al.  A psychoengineering paradigm for the neurocognitive mechanisms of biofeedback and neurofeedback , 2016, Neuroscience & Biobehavioral Reviews.

[30]  P A Hancock,et al.  Vigilance on the move: video game-based measurement of sustained attention , 2014, Ergonomics.

[31]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[32]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[33]  A Konar,et al.  Analyzing text recognition from tactually evoked EEG , 2017, Cognitive Neurodynamics.

[34]  N. Mackworth The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[35]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[36]  Haixian Wang,et al.  Regularized common spatial patterns with subject-to-subject transfer of EEG signals , 2017, Cognitive Neurodynamics.

[37]  Anne Treisman,et al.  Monitoring and storage of irrelevant messages in selective attention , 1964 .

[38]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[39]  A. Wróbel,et al.  Beta activity: a carrier for visual attention. , 2000, Acta neurobiologiae experimentalis.

[40]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[41]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[42]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[43]  W. James,et al.  The Principles of Psychology. , 1983 .

[44]  K. R. Ridderinkhof,et al.  Sure I'm Sure: Prefrontal Oscillations Support Metacognitive Monitoring of Decision Making , 2017, The Journal of Neuroscience.

[45]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[46]  F Lotte,et al.  Advances in user-training for mental-imagery-based BCI control: Psychological and cognitive factors and their neural correlates. , 2016, Progress in brain research.

[47]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[48]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[49]  Gérard Dreyfus,et al.  Ranking a Random Feature for Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[50]  Yodchanan Wongsawat,et al.  Quantitative EEG evaluation for performance level analysis of professional female soccer players , 2017, Cognitive Neurodynamics.

[51]  Dong Pyo Jang,et al.  The Investigation of the Relationship between Eye Blink and Visual Attention with Video Clip , 2014 .

[52]  M. Ding,et al.  Top-Down Control of Visual Alpha Oscillations: Sources of Control Signals and Their Mechanisms of Action , 2016, Front. Hum. Neurosci..

[53]  M. Ding,et al.  Attentional modulation of the somatosensory mu rhythm , 2011, Neuroscience.

[54]  E. Knudsen Fundamental components of attention. , 2007, Annual review of neuroscience.

[55]  Camarin E. Rolle,et al.  Video game training enhances cognitive control in older adults , 2013, Nature.

[56]  É. Moulines,et al.  Second Order Blind Separation of Temporally Correlated Sources , 1993 .

[57]  Ernest Mas-Herrero,et al.  Theta oscillations integrate functionally segregated sub-regions of the medial prefrontal cortex , 2016, NeuroImage.

[58]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[59]  Yu-Chi Ho The no free lunch theorem and the human-machine interface , 1999 .

[60]  C. Schroeder,et al.  Neuronal Mechanisms of Cortical Alpha Oscillations in Awake-Behaving Macaques , 2008, The Journal of Neuroscience.

[61]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[62]  W. Johnston,et al.  Flexibility and capacity demands of attention , 1978 .

[63]  D. Norman Toward a theory of memory and attention. , 1968 .

[64]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[65]  N. Yeung,et al.  The roles of cortical oscillations in sustained attention , 2015, Trends in Cognitive Sciences.

[66]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[67]  Hong Wang,et al.  Graph analysis of functional brain network topology using minimum spanning tree in driver drowsiness , 2018, Cognitive Neurodynamics.

[68]  Matteo Toscani,et al.  Alpha waves: a neural signature of visual suppression , 2010, Experimental Brain Research.

[69]  Á. Pascual-Leone,et al.  Conscious Brain-to-Brain Communication in Humans Using Non-Invasive Technologies , 2014, Brain Stimulation.

[70]  J. Ford,et al.  Relationships between pre-stimulus γ power and subsequent P300 and reaction time breakdown in schizophrenia. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[71]  T. Shallice,et al.  A Multidisciplinary Approach to Anterior Attentional Functions a , 1995, Annals of the New York Academy of Sciences.

[72]  Robert T. Knight,et al.  Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing , 2014, NeuroImage.

[73]  Takayuki Nozawa,et al.  Spatiotemporal Dynamics of High-Gamma Activities during a 3-Stimulus Visual Oddball Task , 2013, PloS one.

[74]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[75]  Wolfgang Rosenstiel,et al.  Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach , 2014, Front. Neurosci..

[76]  D. Kahneman Attention and Effort , 1973 .

[77]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.