An online EEG-based brain-computer interface for controlling hand grasp using an adaptive probabilistic neural network.

This paper presents a new online single-trial EEG-based brain-computer interface (BCI) for controlling hand holding and sequence of hand grasping and opening in an interactive virtual reality environment. The goal of this research is to develop an interaction technique that will allow the BCI to be effective in real-world scenarios for hand grasp control. One of the major challenges in the BCI research is the subject training. Currently, in most online BCI systems, the classifier was trained offline using the data obtained during the experiments without feedback, and used in the next sessions in which the subjects receive feedback. We investigated whether the subject could achieve satisfactory online performance without offline training while the subjects receive feedback from the beginning of the experiments during hand movement imagination. Another important issue in designing an online BCI system is the machine learning to classify the brain signal which is characterized by significant day-to-day and subject-to-subject variations and time-varying probability distributions. Due to these variabilities, we introduce the use of an adaptive probabilistic neural network (APNN) working in a time-varying environment for classification of EEG signals. The experimental evaluation on ten naïve subjects demonstrated that an average classification accuracy of 75.4% was obtained during the first experiment session (day) after about 3 min of online training without offline training, and 81.4% during the second session (day). The average rates during third and eighth sessions are 79.0% and 84.0%, respectively, using previously calculated classifier during the first sessions, without online training and without the need to calibrate. The results obtained from more than 5000 trials on ten subjects showed that the method could provide a robust performance over different experiment sessions and different subjects.

[1]  Steven Lemm,et al.  BCI competition 2003-data set III: probabilistic modeling of sensorimotor /spl mu/ rhythms for classification of imaginary hand movements , 2004, IEEE Transactions on Biomedical Engineering.

[2]  A. Erfanian,et al.  suppression using recurrent neural network for electro-encephalogram based brain-computer interface , 2005 .

[3]  Justin Werfel,et al.  BCI competition 2003-data set Ia: combining gamma-band power with slow cortical potentials to improve single-trial classification of electroencephalographic signals , 2004, IEEE Transactions on Biomedical Engineering.

[4]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[5]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Ivan Krekule,et al.  EEG patterns in theta and gamma frequency range and their probable relation to human voluntary movement organization , 1999, Neuroscience Letters.

[7]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  F. L. D. Silva,et al.  Beta rebound after different types of motor imagery in man , 2005, Neuroscience Letters.

[9]  J R Wolpaw,et al.  EEG-based communication and control: short-term role of feedback. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[11]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[12]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[13]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[14]  G.F. Inbar,et al.  Feature selection for the classification of movements from single movement-related potentials , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  Donald F. Specht,et al.  Probabilistic neural networks and the polynomial Adaline as complementary techniques for classification , 1990, IEEE Trans. Neural Networks.

[17]  J. R. Wolpaw,et al.  Brain–computer interfaces (BCIs): Detection instead of classification , 2008, Journal of Neuroscience Methods.

[18]  Gary E. Birch,et al.  Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch , 2004, IEEE Transactions on Biomedical Engineering.

[19]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[20]  G. Pfurtscheller,et al.  Conversion of EEG activity into cursor movement by a brain-computer interface (BCI) , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[22]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[23]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[24]  Wee Ser,et al.  Probabilistic neural-network structure determination for pattern classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[25]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[26]  Gabriel Curio,et al.  Brain-computer communication and slow cortical potentials , 2004, IEEE Transactions on Biomedical Engineering.

[27]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[28]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[30]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[31]  J.R. Wolpaw,et al.  A $\mu $-Rhythm Matched Filter for Continuous Control of a Brain-Computer Interface , 2007, IEEE Transactions on Biomedical Engineering.

[32]  Hans G. C. Tråvén,et al.  A neural network approach to statistical pattern classification by 'semiparametric' estimation of probability density functions , 1991, IEEE Trans. Neural Networks.

[33]  H. Flor,et al.  A multimodal brain-based feedback and communication system , 2004, Experimental Brain Research.

[34]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[35]  Aristidis Likas,et al.  An incremental training method for the probabilistic RBF network , 2006, IEEE Trans. Neural Networks.

[36]  Anatole Lécuyer,et al.  Classifying EEG for brain computer interfaces using Gaussian processes , 2008, Pattern Recognit. Lett..

[37]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  Roy L. Streit,et al.  Maximum likelihood training of probabilistic neural networks , 1994, IEEE Trans. Neural Networks.

[39]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[40]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[41]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[43]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[44]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[45]  Babak Mahmoudi,et al.  Electro-encephalogram based brain–computer interface: improved performance by mental practice and concentration skills , 2006, Medical and Biological Engineering and Computing.

[46]  Mikko Sams,et al.  Online Classification of Single EEG Trials During Finger Movements , 2008, IEEE Transactions on Biomedical Engineering.

[47]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[48]  Babak Mahmoudi,et al.  Single-channel EEG-based prosthetic hand grasp control for amputee subjects , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[49]  Leszek Rutkowski,et al.  Adaptive probabilistic neural networks for pattern classification in time-varying environment , 2004, IEEE Transactions on Neural Networks.

[50]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[51]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[52]  Gernot R. Müller-Putz,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3152–3155 c ○ 2005 Hindawi Publishing Corporation EEG-Based Asynchronous BCI Controls Functional Electrical Stimulation in a Tetraplegic Patient , 2004 .

[53]  J. Callaghan.  Medical engineering & physics. , 2005, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[54]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Clemens Brunner,et al.  Online Control of a Brain-Computer Interface Using Phase Synchronization , 2006, IEEE Transactions on Biomedical Engineering.

[56]  Virginia R. de Sa,et al.  Preprocessing and Meta-Classification for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.