Classification of EEG signals to identify variations in attention during motor task execution

BACKGROUND Brain-computer interface (BCI) systems in neuro-rehabilitation use brain signals to control external devices. User status such as attention affects BCI performance; thus detecting the user's attention drift due to internal or external factors is essential for high detection accuracy. NEW METHOD An auditory oddball task was applied to divert the users' attention during a simple ankle dorsiflexion movement. Electroencephalogram signals were recorded from eighteen channels. Temporal and time-frequency features were projected to a lower dimension space and used to analyze the effect of two attention levels on motor tasks in each participant. Then, a global feature distribution was constructed with the projected time-frequency features of all participants from all channels and applied for attention classification during motor movement execution. RESULTS Time-frequency features led to significantly better classification results with respect to the temporal features, particularly for electrodes located over the motor cortex. Motor cortex channels had a higher accuracy in comparison to other channels in the global discrimination of attention level. COMPARING WITH EXISTING METHODS Previous methods have used the attention to a task to drive external devices, such as the P300 speller. However, here we focus for the first time on the effect of attention drift while performing a motor task. CONCLUSIONS It is possible to explore user's attention variation when performing motor tasks in synchronous BCI systems with time-frequency features. This is the first step towards an adaptive real-time BCI with an integrated function to reveal attention shifts from the motor task.

[1]  Tao Wu,et al.  Cerebellum and integration of neural networks in dual-task processing , 2013, NeuroImage.

[2]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. , 1998, Brain : a journal of neurology.

[3]  Mads Jochumsen,et al.  Comparison of Features for Movement Prediction from Single-Trial Movement-Related Cortical Potentials in Healthy Subjects and Stroke Patients , 2015, Comput. Intell. Neurosci..

[4]  Simon B. Eickhoff,et al.  Differential modulation of motor network connectivity during movements of the upper and lower limbs , 2015, NeuroImage.

[5]  Mads Jochumsen,et al.  Comparison of spatial filters and features for the detection and classification of movement-related cortical potentials in healthy individuals and stroke patients , 2015, Journal of neural engineering.

[6]  B. Harrison,et al.  Functional Connectivity Bias in the Prefrontal Cortex of Psychopaths , 2015, Biological Psychiatry.

[7]  J. Rauschecker,et al.  A Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind , 2000, The Journal of Neuroscience.

[8]  Alberto Prieto,et al.  Statistical Characterization of Steady-State Visual Evoked Potentials and Their Use in Brain–Computer Interfaces , 2009, Neural Processing Letters.

[9]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[10]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[11]  Ning Jiang,et al.  Robustness of movement detection techniques from motor execution: Single trial movement related cortical potential , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[12]  M Hallett,et al.  Movement-related cortical potentials. , 1994, Electromyography and clinical neurophysiology.

[13]  Marie-Françoise Lucas,et al.  Optimization of wavelets for classification of movement-related cortical potentials generated by variation of force-related parameters , 2007, Journal of Neuroscience Methods.

[14]  Nir Giladi,et al.  Increased frontal brain activation during walking while dual tasking: an fNIRS study in healthy young adults , 2014, Journal of NeuroEngineering and Rehabilitation.

[15]  Dario Farina,et al.  Detection of movement-related cortical potentials based on subject-independent training , 2013, Medical & Biological Engineering & Computing.

[16]  M Honda,et al.  Cortical mechanism underlying externally cued gait initiation studied by contingent negative variation. , 1997, Electroencephalography and clinical neurophysiology.

[17]  D. Farina,et al.  Detection of movement intention from single-trial movement-related cortical potentials , 2011, Journal of neural engineering.

[18]  S. Ben Hamed,et al.  Attention to baseline: does orienting visuospatial attention really facilitate target detection? , 2011, Journal of neurophysiology.

[19]  L. Montesano,et al.  Asynchronous detection of kinesthetic attention during mobilization of lower limbs using EEG measurements , 2016, Journal of neural engineering.

[20]  G. de Marco,et al.  Assessment of brain interactivity in the motor cortex from the concept of functional connectivity and spectral analysis of fMRI data , 2008, Biological Cybernetics.

[21]  G. Galbraith,et al.  Selective attention affects human brain stem frequency-following response , 2003, Neuroreport.

[22]  Andrea Petracca,et al.  A real-time classification algorithm for EEG-based BCI driven by self-induced emotions , 2015, Comput. Methods Programs Biomed..

[23]  F. Lenz,et al.  Painful cutaneous laser stimuli induce event-related gamma-band activity in the lateral thalamus of humans. , 2015, Journal of neurophysiology.

[24]  J. Rauschecker,et al.  A PET study of human auditory spatial processing , 1999, Neuroscience Letters.

[25]  John J. Foxe,et al.  Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG. , 2015, Cerebral cortex.

[26]  Marie-Françoise Lucas,et al.  Identification of task parameters from movement-related cortical potentials , 2009, Medical & Biological Engineering & Computing.

[27]  Dario Farina,et al.  Movement-Related Cortical Potentials Allow Discrimination of Rate of Torque Development in Imaginary Isometric Plantar Flexion , 2008, IEEE Transactions on Biomedical Engineering.

[28]  J. Kleim,et al.  Motor cortex stimulation enhances motor recovery and reduces peri-infarct dysfunction following ischemic insult , 2003, Neurological research.

[29]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[30]  Mourad Barkat,et al.  Signal detection and estimation , 1991 .

[31]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[32]  Ricardo Ron-Angevin,et al.  Concentration on performance with P300-based BCI systems: a matter of interface features. , 2016, Applied ergonomics.

[33]  Sung-Bae Cho,et al.  Machine learning approaches for cognitive state classification and brain activity prediction: A survey , 2015 .

[34]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[35]  Stéphane Bonnet,et al.  Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[37]  Steven P. Wise,et al.  Motor Cortex , 2013 .

[38]  Robert Oostenveld,et al.  Modulation of Posterior Alpha Activity by Spatial Attention Allows for Controlling A Continuous Brain–Computer Interface , 2014, Brain Topography.

[39]  Atsuo Murata,et al.  Evaluation of mental fatigue using feature parameter extracted from event-related potential , 2002 .

[40]  Alicia Casals,et al.  Detection of movements with attention or distraction to the motor task during robot-assisted passive movements of the upper limb , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Vicente Mut,et al.  Attention-level transitory response: a novel hybrid BCI approach. , 2015, Journal of neural engineering.

[42]  George R. Mangun,et al.  Sustained visual-spatial attention produces costs and benefits in response time and evoked neural activity , 1998, Neuropsychologia.

[43]  Dong Ming,et al.  Optimizing visual-to-auditory delay for multimodal BCI speller , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[44]  T. Eddy,et al.  What is a pet? , 2003 .

[45]  Long Chen,et al.  A visual parallel-BCI speller based on the time–frequency coding strategy , 2014, Journal of neural engineering.

[46]  J. del R. Millán,et al.  Time-dependent approach for single trial classification of covert visuospatial attention , 2012, Journal of neural engineering.

[47]  Yi-Hung Liu,et al.  Emotion Recognition from Single-Trial EEG Based on Kernel Fisher's Emotion Pattern and Imbalanced Quasiconformal Kernel Support Vector Machine , 2014, Sensors.

[48]  K. Hiraoka Movement-Related Cortical Potentials Associated with Saliva and Water Bolus Swallowing , 2004, Dysphagia.

[49]  A. Engel,et al.  Generators and Connectivity of the Early Auditory Evoked Gamma Band Response , 2015, bioRxiv.

[50]  Javier Gomez-Pilar,et al.  Adaptive Stacked Generalization for Multiclass Motor Imagery-Based Brain Computer Interfaces , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  K. Stefan,et al.  Modulation of associative human motor cortical plasticity by attention. , 2004, Journal of neurophysiology.

[52]  Ning Jiang,et al.  The Changing Brain: Bidirectional Learning Between Algorithm and User , 2015, Brain-Computer Interface Research.

[53]  L Tonin,et al.  An online EEG BCI based on covert visuospatial attention in absence of exogenous stimulation , 2013, Journal of neural engineering.

[54]  Jeff Miller,et al.  Selection and preparation of hand and foot movements: Cz activity as a marker of limb system preparation. , 2012, Psychophysiology.

[55]  Gernot R. Müller-Putz,et al.  Effects of mental workload and fatigue on the P300, alpha and theta band power during operation of an ERP (P300) brain–computer interface , 2014, Biological Psychology.

[56]  Larissa C. Schudlo,et al.  Single-trial classification of near-infrared spectroscopy signals arising from multiple cortical regions , 2015, Behavioural Brain Research.

[57]  Takeshi Ogawa,et al.  High-gamma activity in an attention network predicts individual differences in elderly adults' behavioral performance , 2014, NeuroImage.

[58]  寺田 清人 Movement-related cortical potentials associated with voluntary muscle relaxation , 1996 .

[59]  F Auricchio,et al.  Fatigue life assessment of cardiovascular balloon-expandable stents: a two-scale plasticity-damage model approach. , 2012, Journal of the mechanical behavior of biomedical materials.

[60]  A. Berardelli,et al.  Attention influences the excitability of cortical motor areas in healthy humans , 2007, Experimental Brain Research.