Ensemble learning based classification for BCI applications

This paper reports the use of combinations of multiple learning models, a type of structure called ensemble system in the classification of movement imagination, an interesting topic in the Brain Computer Interface (BCI) field. The considered models are the well-known Multilayer Perceptron (MLP), perhaps the most often used Neural Network (NN) based models. The proposed method has been applied on the Graze data set 2b of the BCI competition IV. The data was pre-processed by selecting the most appropriate frequency range, correcting the most relevant artifacts such as EOG interference and source decorrelation by using PCA. Experimental results show that an ensemble system of MLP models can outperform a single MLP model if adequate training strategies are employed. For the current database and in the absence of other changes in the system the ensemble strategy outperforms conventional classification, both using MLPs in about 2% when a linear combination of the outputs of the ensemble components was adopted and in about 4% when a non-linear combination was used.

[1]  André L. V. Coelho,et al.  On the evolutionary design of heterogeneous Bagging models , 2010, Neurocomputing.

[2]  Huanhuan Chen,et al.  Trade-Off Between Diversity and Accuracy in Ensemble Generation , 2006, Multi-Objective Machine Learning.

[3]  Terence W. Picton,et al.  Blinks, Saccades, Extraocular Muscles and Visual Evoked Potentials (Reply to Verleger) , 2000 .

[4]  Teresa B. Culver,et al.  Bootstrapped artificial neural networks for synthetic flow generation with a small data sample , 2006 .

[5]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[6]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[7]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[8]  Jizhen Liu,et al.  A novel least squares support vector machine ensemble model for NOx emission prediction of a coal-fired boiler , 2013 .

[9]  Nikola Kasabov,et al.  Foundations Of Neural Networks, Fuzzy Systems, And Knowledge Engineering [Books in Brief] , 1996, IEEE Transactions on Neural Networks.

[10]  Rui Araújo,et al.  An on-line weighted ensemble of regressor models to handle concept drifts , 2015, Eng. Appl. Artif. Intell..

[11]  Rolf Verleger Should We Really Use Different Estimates for Correcting EEG Artefacts Produced by Blinks and by Saccades , 2000 .

[12]  R. Barry,et al.  EOG correction: a comparison of four methods. , 2005, Psychophysiology.

[13]  R. Barry,et al.  EOG correction: a new aligned-artifact average solution. , 1998, Electroencephalography and clinical neurophysiology.