Context-aware brain–computer interfaces: exploring the information space of user, technical system and environment

Brain-computer interface (BCI) systems are usually applied in highly controlled environments such as research laboratories or clinical setups. However, many BCI-based applications are implemented in more complex environments. For example, patients might want to use a BCI system at home, and users without disabilities could benefit from BCI systems in special working environments. In these contexts, it might be more difficult to reliably infer information about brain activity, because many intervening factors add up and disturb the BCI feature space. One solution for this problem would be adding context awareness to the system. We propose to augment the available information space with additional channels carrying information about the user state, the environment and the technical system. In particular, passive BCI systems seem to be capable of adding highly relevant context information-otherwise covert aspects of user state. In this paper, we present a theoretical framework based on general human-machine system research for adding context awareness to a BCI system. Building on that, we present results from a study on a passive BCI, which allows access to the covert aspect of user state related to the perceived loss of control. This study is a proof of concept and demonstrates that context awareness could beneficially be implemented in and combined with a BCI system or a general human-machine system. The EEG data from this experiment are available for public download at www.phypa.org.

[1]  G. Pfurtscheller,et al.  Evaluation of event-related desynchronization (ERD) preceding and following voluntary self-paced movement. , 1979, Electroencephalography and clinical neurophysiology.

[2]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[3]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[4]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[5]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[6]  G. Pfurtscheller,et al.  On-line EEG classification during externally-paced hand movements using a neural network-based classifier. , 1996, Electroencephalography and clinical neurophysiology.

[7]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[8]  L. Deecke,et al.  Neuroimage of Voluntary Movement: Topography of the Bereitschaftspotential, a 64-Channel DC Current Source Density Study , 1999, NeuroImage.

[9]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[10]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[11]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Gabriel Curio,et al.  Speeding up classification of multi-channel brain-computer interfaces: common spatial patterns for slow cortical potentials , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[14]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .

[15]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[16]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[17]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Guido Dornhege,et al.  Increasing information transfer rates for brain-computer interfacing , 2006 .

[19]  D.J. McFarland,et al.  The wadsworth BCI research and development program: at home with BCI , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[21]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[22]  Terrence J. Sejnowski,et al.  Toward Brain-Computer Interfacing (Neural Information Processing) , 2007 .

[23]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[24]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[25]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[26]  T. Sejnowski,et al.  Linking brain, mind and behavior. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  Sandra Trösterer,et al.  Implicit Interaction in Multimodal Human-Machine Systems , 2009 .

[28]  M Roetting,et al.  Single-Trial Detection of Cognitive Processes for Increasing Traffic Safety , 2009 .

[29]  K. Jellinger Toward Brain-Computer Interfacing , 2009 .

[30]  Yasuharu Koike,et al.  Application of Covariate Shift Adaptation Techniques in Brain–Computer Interfaces , 2010, IEEE Transactions on Biomedical Engineering.

[31]  Thorsten O. Zander,et al.  Combining Eye Gaze Input With a Brain–Computer Interface for Touchless Human–Computer Interaction , 2010, Int. J. Hum. Comput. Interact..

[32]  Klas Ihme,et al.  A public data hub for benchmarking common brain–computer interface algorithms , 2011, Journal of neural engineering.

[33]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[34]  A. Nijholt,et al.  The Impact of Loss of Control on Movement BCIs , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.