Playing Pinball with non-invasive BCI

Compared to invasive Brain-Computer Interfaces (BCI), non-invasive BCI systems based on Electroencephalogram (EEG) signals have not been applied successfully for precisely timed control tasks. In the present study, however, we demonstrate and report on the interaction of subjects with a real device: a pinball machine. Results of this study clearly show that fast and well-timed control well beyond chance level is possible, even though the environment is extremely rich and requires precisely timed and complex predictive behavior. Using machine learning methods for mental state decoding, BCI-based pinball control is possible within the first session without the necessity to employ lengthy subject training. The current study shows clearly that very compelling control with excellent timing and dynamics is possible for a non-invasive BCI.

[1]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[2]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[3]  G. Pfurtscheller,et al.  Evidence for distinct beta resonance frequencies in human EEG related to specific sensorimotor cortical areas , 2001, Clinical Neurophysiology.

[4]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[5]  Klaus-Robert Müller,et al.  Reducing Calibration Time For Brain-Computer Interfaces: A Clustering Approach , 2006, NIPS.

[6]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[7]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[8]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[9]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[10]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[11]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[12]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[13]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[15]  José del R. Millán,et al.  General Signal Processing and Machine Learning Tools for BCI Analysis , 2007 .

[16]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[17]  R. Bernhaupt,et al.  Characterising and measuring user experiences in digital games , 2007 .

[18]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[19]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[20]  Klaus-Robert Müller,et al.  Optimizing spatio-temporal filters for improving Brain-Computer Interfacing , 2005, NIPS.

[21]  José del R. Millán,et al.  An Introduction to Brain-Computer Interfacing , 2007 .

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[24]  Bernhard Schölkopf,et al.  Classifying Event-Related Desynchronization in EEG, ECoG and MEG Signals , 2006, DAGM-Symposium.

[25]  K.-R. Muller,et al.  Linear and nonlinear methods for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Benjamin Blankertz,et al.  Robustifying EEG data analysis by removing outliers , 2009 .

[27]  H. L. Andrews,et al.  ELECTRO-ENCEPHALOGRAPHY: III. NORMAL DIFFERENTIATION OF OCCIPITAL AND PRECENTRAL REGIONS IN MAN , 1938 .

[28]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[29]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[30]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[31]  Z J Koles,et al.  The quantitative extraction and topographic mapping of the abnormal components in the clinical EEG. , 1991, Electroencephalography and clinical neurophysiology.