Affective Aspects of Perceived Loss of Control and Potential Implications for Brain-Computer Interfaces

Most brain-computer interfaces (BCIs) focus on detecting single aspects of user states (e.g., motor imagery) in the electroencephalogram (EEG) in order to use these aspects as control input for external systems. This communication can be effective, but unaccounted mental processes can interfere with signals used for classification and thereby introduce changes in the signal properties which could potentially impede BCI classification performance. To improve BCI performance, we propose deploying an approach that potentially allows to describe different mental states that could influence BCI performance. To test this approach, we analyzed neural signatures of potential affective states in data collected in a paradigm where the complex user state of perceived loss of control (LOC) was induced. In this article, source localization methods were used to identify brain dynamics with source located outside but affecting the signal of interest originating from the primary motor areas, pointing to interfering processes in the brain during natural human-machine interaction. In particular, we found affective correlates which were related to perceived LOC. We conclude that additional context information about the ongoing user state might help to improve the applicability of BCIs to real-world scenarios.

[1]  Klaus Gramann,et al.  Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity , 2016, Proceedings of the National Academy of Sciences.

[2]  T. Chau,et al.  Effects of user mental state on EEG-BCI performance , 2015, Front. Hum. Neurosci..

[3]  Wolfgang Rosenstiel,et al.  Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach , 2014, Front. Neurosci..

[4]  Christian Mühl,et al.  Valence, arousal and dominance in the EEG during game play , 2013, Int. J. Auton. Adapt. Commun. Syst..

[5]  M. Ruz,et al.  Cognitive and affective control in a flanker word task: Common and dissociable brain mechanisms , 2013, Neuropsychologia.

[6]  Miyoung Kim,et al.  A Review on the Computational Methods for Emotional State Estimation from the Human EEG , 2013, Comput. Math. Methods Medicine.

[7]  Rafael Ramírez,et al.  Detecting Emotion from EEG Signals Using the Emotive Epoc Device , 2012, Brain Informatics.

[8]  W. Notebaert,et al.  Cognitive and affective control , 2012, Front. Psychology.

[9]  Mariano Sigman,et al.  CUDAICA: GPU Optimization of Infomax-ICA EEG Analysis , 2012, Comput. Intell. Neurosci..

[10]  O. Güntürkün,et al.  The motor side of emotions: investigating the relationship between hemispheres, motor reactions and emotional stimuli , 2012, Psychological research.

[11]  Cuntai Guan,et al.  Fast emotion detection from EEG using asymmetric spatial filtering , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  T O Zander,et al.  Context-aware brain–computer interfaces: exploring the information space of user, technical system and environment , 2012, Journal of neural engineering.

[13]  Arnaud Delorme,et al.  EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing , 2011, Comput. Intell. Neurosci..

[14]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[15]  A Belitski,et al.  P300 audio-visual speller , 2011, Journal of neural engineering.

[16]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[17]  J. Sweeney,et al.  Fronto-limbic dysfunction in mania pre-treatment and persistent amygdala over-activity post-treatment in pediatric bipolar disorder , 2011, Psychopharmacology.

[18]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[19]  S. Makeig,et al.  Human Brain Dynamics Accompanying Use of Egocentric and Allocentric Reference Frames during Navigation , 2010, Journal of Cognitive Neuroscience.

[20]  Philip A. Gable,et al.  The role of asymmetric frontal cortical activity in emotion-related phenomena: A review and update , 2010, Biological Psychology.

[21]  Anatole Lécuyer,et al.  Exploring Large Virtual Environments by Thoughts Using a BrainComputer Interface Based on Motor Imagery and High-Level Commands , 2010, PRESENCE: Teleoperators and Virtual Environments.

[22]  Thorsten O. Zander,et al.  Detecting affective covert user states with passive brain-computer interfaces , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[23]  Kevin N. Ochsner,et al.  Neural Systems Supporting the Control of Affective and Cognitive Conflicts , 2009, Journal of Cognitive Neuroscience.

[24]  Anton Nijholt,et al.  Affective Pacman: A Frustrating Game for Brain-Computer Interface Experiments , 2009, INTETAIN.

[25]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[26]  Yuan-Pin Lin,et al.  Support vector machine for EEG signal classification during listening to emotional music , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[27]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.

[28]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[29]  H. Demaree,et al.  Brain lateralization of emotional processing: historical roots and a future incorporating "dominance". , 2005, Behavioral and cognitive neuroscience reviews.

[30]  John J. B. Allen,et al.  Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion , 2004, Biological Psychology.

[31]  Chris H. Q. Ding,et al.  K-means clustering via principal component analysis , 2004, ICML.

[32]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[33]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  K. Luan Phan,et al.  Valence, gender, and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging , 2003, NeuroImage.

[35]  C. Babiloni,et al.  Influence of the supplementary motor area on primary motor cortex excitability during movements triggered by neutral or emotionally unpleasant visual cues , 2003, Experimental Brain Research.

[36]  R. Oostenveld,et al.  Validating the boundary element method for forward and inverse EEG computations in the presence of a hole in the skull , 2002, Human brain mapping.

[37]  I. Jolliffe Principal Component Analysis , 2005 .

[38]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[39]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[40]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[41]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[42]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[43]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[44]  R. Davidson Anterior cerebral asymmetry and the nature of emotion , 1992, Brain and Cognition.

[45]  G. Schwartz,et al.  Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysis , 1985, Neuropsychologia.

[46]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[47]  Dirk Heylen,et al.  Affective brain-computer interfaces: neuroscientific approaches to affect detection , 2015 .

[48]  Thorsten O. Zander,et al.  Automated detection of bluffing in a game: revealing a complex covert user state with a passive BCI , 2010 .

[49]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[50]  Christa Neuper,et al.  Future prospects of ERD/ERS in the context of brain-computer interface (BCI) developments. , 2006, Progress in brain research.

[51]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.