User-customized brain computer interfaces using Bayesian optimization

OBJECTIVE The brain characteristics of different people are not the same. Brain computer interfaces (BCIs) should thus be customized for each individual person. In motor-imagery based synchronous BCIs, a number of parameters (referred to as hyper-parameters) including the EEG frequency bands, the channels and the time intervals from which the features are extracted should be pre-determined based on each subject's brain characteristics. APPROACH To determine the hyper-parameter values, previous work has relied on manual or semi-automatic methods that are not applicable to high-dimensional search spaces. In this paper, we propose a fully automatic, scalable and computationally inexpensive algorithm that uses Bayesian optimization to tune these hyper-parameters. We then build different classifiers trained on the sets of hyper-parameter values proposed by the Bayesian optimization. A final classifier aggregates the results of the different classifiers. MAIN RESULTS We have applied our method to 21 subjects from three BCI competition datasets. We have conducted rigorous statistical tests, and have shown the positive impact of hyper-parameter optimization in improving the accuracy of BCIs. Furthermore, We have compared our results to those reported in the literature. SIGNIFICANCE Unlike the best reported results in the literature, which are based on more sophisticated feature extraction and classification methods, and rely on prestudies to determine the hyper-parameter values, our method has the advantage of being fully automated, uses less sophisticated feature extraction and classification methods, and yields similar or superior results compared to the best performing designs in the literature.

[1]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[2]  Rabab K. Ward,et al.  ResearchArticle Towards Development of a 3-State Self-Paced Brain-Computer Interface , 2007 .

[3]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[4]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[5]  Cuntai Guan,et al.  Multi-class filter bank common spatial pattern for four-class motor imagery BCI , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[7]  Jonas Mockus,et al.  Application of Bayesian approach to numerical methods of global and stochastic optimization , 1994, J. Glob. Optim..

[8]  R. Leeb,et al.  BCI Competition 2008 { Graz data set B , 2008 .

[9]  Gary E. Birch,et al.  Sparse spatial filter optimization for EEG channel reduction in brain-computer interface , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[11]  Gary E. Birch,et al.  Towards Development of a 3-State Self-Paced Brain-Computer Interface , 2007, Comput. Intell. Neurosci..

[12]  Jinglu Hu,et al.  A novel frequency band selection method for Common Spatial Pattern in Motor Imagery based Brain Computer Interface , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[13]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[15]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[16]  J. Shotton,et al.  Decision Forests for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2011 .

[17]  Francesca Bovolo,et al.  Automatic selection of frequency and time intervals for classification of EEG signals , 2007 .

[18]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  T.M. McGinnity,et al.  Comparative Analysis of Spectral Approaches to Feature Extraction for EEG-Based Motor Imagery Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[21]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[22]  Anatole Lécuyer,et al.  Comparative study of band-power extraction techniques for Motor Imagery classification , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[23]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[24]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[25]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[26]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[27]  Qingfu Zhang,et al.  Multi-objective evolutionary methods for channel selection in Brain-Computer Interfaces: Some preliminary experimental results , 2010, IEEE Congress on Evolutionary Computation.

[28]  Anatole Lécuyer,et al.  Classifying EEG for brain computer interfaces using Gaussian processes , 2008, Pattern Recognit. Lett..

[29]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[30]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[31]  Tian Lan,et al.  Salient EEG Channel Selection in Brain Computer Interfaces by Mutual Information Maximization , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[32]  Rabab K. Ward,et al.  Comparing Different Classifiers in Sensory Motor Brain Computer Interfaces , 2015, PloS one.

[33]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[34]  Kwang-Eun Ko,et al.  Optimal EEG Channel Selection for Motor Imagery BCI System Using BPSO and GA , 2012, RiTA.

[35]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[36]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[37]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[38]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[39]  Anatole Lécuyer,et al.  Exploring two novel features for EEG-based brain-computer interfaces: Multifractal cumulants and predictive complexity , 2010, Neurocomputing.

[40]  Heung-Il Suk,et al.  Subject and class specific frequency bands selection for multiclass motor imagery classification , 2011, Int. J. Imaging Syst. Technol..

[41]  Bernard Zenko,et al.  Is Combining Classifiers with Stacking Better than Selecting the Best One? , 2004, Machine Learning.