Online control of a humanoid robot through hand movement imagination using CSP and ECoG based features

Intention recognition through decoding brain activity could lead to a powerful and independent Brain-Computer-Interface (BCI) allowing for intuitive control of devices like robots. A common strategy for realizing such a system is the motor imagery (MI) BCI using electroencephalography (EEG). Changing to invasive recordings like electrocorticography (ECoG) allows extracting very robust features and easy introduction of an idle state, which might simplify the mental task and allow the subject to focus on the environment. Especially for multi-channel recordings like ECoG, common spatial patterns (CSP) provide a powerful tool for feature optimization and dimensionality reduction. This work focuses on an invasive and independent MI BCI that allows triggering from an idle state, and therefore facilitates tele-operation of a humanoid robot. The task was to lift a can with the robot's hand. One subject participated and reached 95.4 % mean online accuracy after six runs of 40 trials. To our knowledge, this is the first online experiment with a MI BCI using CSPs from ECoG signals.

[1]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[2]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[3]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[4]  G. Pfurtscheller,et al.  Could the beta rebound in the EEG be suitable to realize a “brain switch”? , 2009, Clinical Neurophysiology.

[5]  G Pfurtscheller,et al.  Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Eric Leuthardt,et al.  Real-time detection of event-related brain activity , 2008, NeuroImage.

[7]  Xiaoming Wu,et al.  Classification of Imaginary Movements in ECoG , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[8]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[9]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[10]  H. Yokoi,et al.  Real-time control of a prosthetic hand using human electrocorticography signals. , 2011, Journal of neurosurgery.

[11]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Rupert Ortner,et al.  Single trial detection of hand poses in human ECoG using CSP based feature extraction , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  E. Fetz,et al.  Decoupling the Cortical Power Spectrum Reveals Real-Time Representation of Individual Finger Movements in Humans , 2009, The Journal of Neuroscience.

[14]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[15]  Rajesh P. N. Rao,et al.  Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[16]  Milena Korostenskaja,et al.  CortiQ-based Real-Time Functional Mapping for Epilepsy Surgery , 2015, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[17]  Rupert Ortner,et al.  How many people can control a motor imagery based BCI using common spatial patterns? , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).