Feature selection for brain-computer interfaces

Brain-Computer Interface (BCI) systems are a means of establishing communication for severely paralyzed patients. Based on the brain activity signals during the execution of mental tasks by a user, a computer system translates those signals first into higher-level features and finally into control commands for communication interfaces. This involves a number of algorithmic steps that have to be optimized individually for each patient in order to attain high performance of the BCI. One of these steps is the choice of a suitable set of brain signal features. This set is supposed to provide good discriminability of the mental tasks, allow for introspection, simplify the experimental effort and thus increase acceptance in patients. In terms of EEG electrodes, a smaller feature set entails a reduction of the immense effort of the daily setting-up of electrodes prior to the start of an experiment. The problem of feature selection is hard to tackle as optimal features may vary between subjects and even between sessions with the same subject. This thesis proposes a new signal processing framework for BCI that incorporates a quick and fully algorithmic feature selection step combined with an SVM classification in embedded form. For the evaluation of this new methodology, the results of own online and offline studies with electroencephalogram (EEG), electrocorticogram (ECoG) and magnetoencephalogram (MEG) will be presented, including the first ever implementation of a motor-imagery BCI system in MEG. In addition, the framework has been evaluated against several existing filter and wrapper approaches for feature selection. According to these results, the new method is capable of adapting to the changing signal characteristics of BCI users, can be used without prior neurophysiological knowledge about underlying mental tasks, reduces the number of features from several hundreds to just about 10% of the original features all while remaining highly accurate in terms of classification performance. Furthermore, the results of the feature selection step prove to be plausible in terms of neurophysiology, i.e. chosen EEG channels agree well with the expected underlying cortical activity patterns during the mental tasks. Under restricted conditions, it is shown that the optimized feature sets determined by the new signal processing framework can be transferred across subjects with only a small drop in performance.

[1]  Bernhard Schölkopf,et al.  Training Invariant Support Vector Machines , 2002, Machine Learning.

[2]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[3]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[4]  D Lehmann,et al.  [Controlled EEG alpha feedback training in normals and headache patients (author's transl)]. , 1976, Archiv fur Psychiatrie und Nervenkrankheiten.

[5]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Gabriel Curio,et al.  MACHINE LEARNING TECHNIQUES FOR BRAIN-COMPUTER INTERFACES , 2004 .

[7]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[8]  Gabriel Curio,et al.  Speeding up classification of multi-channel brain-computer interfaces: common spatial patterns for slow cortical potentials , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[9]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[10]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[11]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[12]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[13]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[14]  Benjamin Blankertz,et al.  MATHEMATICAL ENGINEERING TECHNICAL REPORTS Spectrally weighted Common Spatial Pattern algorithm for single trial EEG classification , 2006 .

[15]  G. Pfurtscheller,et al.  EEG-Based Communication: Evaluation of Alternative Signal Prediction Methods - EEG-basierte Kommunikation: Evaluierung alternativer Methoden zur Signalprädiktion , 1997, Biomedizinische Technik. Biomedical engineering.

[16]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[17]  W. Penfield,et al.  Electrocorticograms in man: Effect of voluntary movement upon the electrical activity of the precentral gyrus , 2005, Archiv für Psychiatrie und Nervenkrankheiten.

[18]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  Bernhard Schölkopf,et al.  Methods Towards Invasive Human Brain Computer Interfaces , 2004, NIPS.

[21]  Bernhard Schölkopf,et al.  Optimizing Spatial Filters for BCI: Margin- and Evidence-Maximization Approaches , 2006 .

[22]  D. Lehmann,et al.  Kontrolliertes EEG-Alpha-Feedback-Training bei Gesunden und Kopfschmerzpatientinnen , 1976, Archiv für Psychiatrie und Nervenkrankheiten.

[23]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[24]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[25]  Tarmo Lipping,et al.  Comparison of entropy and complexity measures for the assessment of depth of sedation , 2006, IEEE Transactions on Biomedical Engineering.

[26]  H. Jasper,et al.  Electrocorticograms in man: Effect of voluntary movement upon the electrical activity of the precentral gyrus , 1949 .

[27]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[28]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[29]  Ronald L. Rivest,et al.  Training a 3-node neural network is NP-complete , 1988, COLT '88.

[30]  N. Birbaumer,et al.  Anwendungen der Selbstkontrolle langsamer kortikaler Potentiale , 2000, Verhaltenstherapie.

[31]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[32]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[33]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[34]  Klaus Mainzer,et al.  Künstliche Intelligenz (KI) , 1997 .

[35]  W. Penfield,et al.  The Cerebral Cortex of Man: A Clinical Study of Localization of Function , 1968 .

[36]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface (BBCI) – towards a new communication channel for online control in gaming applications , 2007, Multimedia Tools and Applications.

[37]  Thomas Hofmann,et al.  A brain computer interface with online feedback based on magnetoencephalography , 2005, ICML.

[38]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[39]  Bernhard Schölkopf,et al.  Classifying Event-Related Desynchronization in EEG, ECoG and MEG Signals , 2006, DAGM-Symposium.

[40]  N. Birbaumer,et al.  The thought-translation device (TTD): neurobehavioral mechanisms and clinical outcome , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[42]  G. Pfurtscheller,et al.  Graz-BCI: state of the art and clinical applications , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  A. Schlogl,et al.  Information transfer of an EEG-based brain computer interface , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[44]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[45]  Bernhard Graimann,et al.  Toward a direct brain interface based on human subdural recordings and wavelet-packet analysis , 2004, IEEE Transactions on Biomedical Engineering.

[46]  Klaus-Robert Müller,et al.  Optimizing spatio-temporal filters for improving Brain-Computer Interfacing , 2005, NIPS.

[47]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[48]  T. Hinterberger,et al.  Automated EEG feature selection for brain computer interfaces , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[49]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[50]  Selina Wriessnegger,et al.  Regularised CSP for Sensor Selection in BCI , 2006 .

[51]  D. Cohen,et al.  MEG versus EEG localization test using implanted sources in the human brain , 1990, Annals of neurology.

[52]  B. Rockstroh,et al.  Operant control of EEG and event-related and slow brain potentials , 1984, Biofeedback and self-regulation.

[53]  Gian Domenico Borasio,et al.  Individual quality of life is not correlated with health-related quality of life or physical function in patients with amyotrophic lateral sclerosis. , 2004, Journal of palliative medicine.

[54]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[55]  Wolfgang Rosenstiel,et al.  Brain-Computer Interfaces for Communication in Paralysis: A Clinical Experimental Approach , 2007 .

[56]  Weigeldt Archiv für Psychiatrie und Nervenkrankheiten , 2005, Deutsche Zeitschrift für Nervenheilkunde.

[57]  D. Cohen Magnetoencephalography: Evidence of Magnetic Fields Produced by Alpha-Rhythm Currents , 1968, Science.

[58]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Machine Learning Based Detection of User Specific Brain States , 2006, J. Univers. Comput. Sci..

[59]  Bernhard Schölkopf,et al.  Use of the Zero-Norm with Linear Models and Kernel Methods , 2003, J. Mach. Learn. Res..

[60]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[61]  Benjamin Blankertz,et al.  THE BERLIN BRAIN-COMPUTER INTERFACE PRESENTS THE NOVEL MENTAL TYPEWRITER HEX-O-SPELL , 2006 .

[62]  W. Penfield The Cerebral Cortex of Man , 1950 .

[63]  G Pfurtscheller,et al.  Exploring Virtual Environments with an EEG-based BCI through Motor Imagery / Erkundung von virtuellen Welten durch Bewegungsvorstellungen mit Hilfe eines EEG-basierten BCI , 2005, Biomedizinische Technik. Biomedical engineering.

[64]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[65]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[66]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[67]  G. Deuschl,et al.  Corticomuscular coherence in the 6–15 Hz band: is the cortex involved in the generation of physiologic tremor? , 2001, Experimental Brain Research.

[68]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[69]  N Birbaumer,et al.  A binary spelling interface with random errors. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[70]  Huan Liu,et al.  Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution , 2003, ICML.

[71]  Conrad V. Kufta,et al.  Event-related desynchronization and movement-related cortical potentials on the ECoG and EEG. , 1994, Electroencephalography and clinical neurophysiology.

[72]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[73]  K.-R. Muller,et al.  Improving speed and accuracy of brain-computer interfaces using readiness potential features , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[74]  Touradj Ebrahimi,et al.  Direct Brain-Computer Communication Through EEG Signals , 2004 .

[75]  U. Strehl,et al.  Modification of Slow Cortical Potentials in Patients with Refractory Epilepsy: A Controlled Outcome Study , 2001, Epilepsia.

[76]  Klaus-Robert Müller,et al.  Reducing Calibration Time For Brain-Computer Interfaces: A Clustering Approach , 2006, NIPS.

[77]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[78]  D.J. McFarland,et al.  The Wadsworth Center brain-computer interface (BCI) research and development program , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[79]  Thierry Pun,et al.  Analysis of bit-rate definitions for Brain-Computer Interfaces , 2005, CSREA HCI.

[80]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.