Bayesian inference for an adaptive Ordered Probit model: An application to Brain Computer Interfacing

This paper proposes an algorithm for adaptive, sequential classification in systems with unknown labeling errors, focusing on the biomedical application of Brain Computer Interfacing (BCI). The method is shown to be robust in the presence of label and sensor noise. We focus on the inference and prediction of target labels under a nonlinear and non-Gaussian model. In order to handle missing or erroneous labeling, we model observed labels as a noisy observation of a latent label set with multiple classes (≥ 2). Whilst this paper focuses on the method's application to BCI systems, the algorithm has the potential to be applied to many application domains in which sequential missing labels are to be imputed in the presence of uncertainty. This dynamic classification algorithm combines an Ordered Probit model and an Extended Kalman Filter (EKF). The EKF estimates the parameters of the Ordered Probit model sequentially with time. We test the performance of the classification approach by processing synthetic datasets and real experimental EEG signals with multiple classes (2, 3 and 4 labels) for a Brain Computer Interfacing (BCI) experiment.

[1]  J. Geweke,et al.  Alternative computational approaches to inference in the multinomial probit model , 1994 .

[2]  Mübeccel Demirekler,et al.  Analysis of single Gaussian approximation of Gaussian mixtures in Bayesian filtering applied to mixed multiple-model estimation , 2007, Int. J. Control.

[3]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[4]  K.-R. Muller,et al.  Linear and nonlinear methods for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[6]  J Pardey,et al.  A review of parametric modelling techniques for EEG analysis. , 1996, Medical engineering & physics.

[7]  Pravin K. Trivedi,et al.  Regression Analysis of Count Data , 1998 .

[8]  Roman Liesenfeld,et al.  Time series of count data: modeling, estimation and diagnostics , 2006, Comput. Stat. Data Anal..

[9]  M J Stokes,et al.  EEG-based communication: a pattern recognition approach. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  Stephen J. Roberts,et al.  Sequential Bayesian estimation for adaptive classification , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[11]  Gerd Ronning,et al.  Efficient Estimation of Ordered Probit Models , 1996 .

[12]  Andrew A. Weiss,et al.  Specification tests in ordered logit and probit models , 1997 .

[13]  John Aitchison,et al.  THE GENERALIZATION OF PROBIT ANALYSIS TO THE CASE OF MULTIPLE RESPONSES , 1957 .

[14]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[15]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[16]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[17]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[18]  G Pfurtscheller,et al.  Using time-dependent neural networks for EEG classification. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[19]  Peter E. Rossi,et al.  An exact likelihood analysis of the multinomial probit model , 1994 .

[20]  Stephen J. Roberts,et al.  Adaptive classification for Brain Computer Interface systems using Sequential Monte Carlo sampling , 2009, Neural Networks.

[21]  Roman Garnett,et al.  Sequential non-stationary dynamic classification with sparse feedback , 2010, Pattern Recognit..

[22]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[23]  Pravin K. Trivedi,et al.  Bayesian analysis of the ordered probit model with endogenous selection , 2008 .

[24]  Stephen J. Roberts,et al.  Adaptive Classification by Hybrid EKF with Truncated Filtering: Brain Computer Interfacing , 2008, IDEAL.

[25]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[26]  Stephen J. Roberts,et al.  Adaptive BCI based on variational Bayesian Kalman filtering: an empirical evaluation , 2004, IEEE Transactions on Biomedical Engineering.

[27]  E R Dougherty,et al.  Multi-class cancer classification using multinomial probit regression with Bayesian gene selection. , 2006, Systems biology.

[28]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[30]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..