Bandit Algorithms boost Brain Computer Interfaces for motor-task selection of a brain-controlled button

A brain-computer interface (BCI) allows users to “communicate” with a computer without using their muscles. BCI based on sensori-motor rhythms use imaginary motor tasks, such as moving the right or left hand to send control signals. The performances of a BCI can vary greatly across users but also depend on the tasks used, making the problem of appropriate task selection an important issue. This study presents a new procedure to automatically select as fast as possible a discriminant motor task for a brain-controlled button. We develop for this purpose an adaptive algorithm UCB-classif based on the stochastic bandit theory. This shortens the training stage, thereby allowing the exploration of a greater variety of tasks. By not wasting time on inefficient tasks, and focusing on the most promising ones, this algorithm results in a faster task selection and a more efficient use of the BCI training session. Comparing the proposed method to the standard practice in task selection, for a fixed time budget, UCB-classif leads to an improve classification rate, and for a fix classification rate, to a reduction of the time spent in training by 50%.

[1]  Andrew W. Moore,et al.  Hoeffding Races: Accelerating Model Selection Search for Classification and Function Approximation , 1993, NIPS.

[2]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[3]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[7]  José del R. Millán,et al.  Brain-actuated interaction , 2004, Artif. Intell..

[8]  W. Penfield,et al.  Electrocorticograms in man: Effect of voluntary movement upon the electrical activity of the precentral gyrus , 2005, Archiv für Psychiatrie und Nervenkrankheiten.

[9]  H. Robbins Some aspects of the sequential design of experiments , 1952 .

[10]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[11]  John Langford,et al.  Exploration scavenging , 2008, ICML '08.

[12]  Monica-Claudia Dobrea,et al.  The selection of proper discriminative cognitive tasks — A necessary prerequisite in high-quality BCI applications , 2009, 2009 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies.

[13]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[14]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[15]  Jonathan R Wolpaw,et al.  A comparison of regression techniques for a two-dimensional sensorimotor rhythm-based brain–computer interface , 2010, Journal of neural engineering.

[16]  Clemens Brunner,et al.  Analysis of sensorimotor rhythms for the implementation of a brain switch for healthy subjects , 2010, Biomed. Signal Process. Control..

[17]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[18]  Dimitrie Alexa,et al.  Spectral EEG features and tasks selection process: Some considerations toward BCI applications , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[19]  Dominik D. Freydenberger,et al.  Can We Learn to Gamble Efficiently? , 2010, COLT.

[20]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[21]  Rémi Munos,et al.  Bandit view on noisy optimization , 2011 .

[22]  T. Papadopoulo,et al.  Preliminary study for an offline hybrid BCI using sensorimotor rhythms and beta rebound. , 2011 .

[23]  Rémi Munos,et al.  Automatic motor task selection via a bandit algorithm for a brain-controlled button , 2013, Journal of neural engineering.