Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb

A Brain–Computer Interface (BCI) is a device that transforms brain signals, which are intentionally modulated by a user, into control commands. BCIs based on motor imagery (MI) and steady-state visual evoked potentials (SSVEP) can partially restore motor control in spinal cord injured patients. To determine whether these BCIs can be combined for grasp and elbow function control independently, we investigated a control method where the beta rebound after brisk feet MI is used to control the grasp function, and a two-class SSVEP-BCI the elbow function of a 2 degrees-of-freedom artificial upper limb. Subjective preferences for the BCI control were assessed with a questionnaire. The results of the initial evaluation of the system suggests that this is feasible.

[1]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[2]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[3]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[4]  G Pfurtscheller,et al.  Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data , 2002, Clinical Neurophysiology.

[5]  Reinhold Scherer,et al.  Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components , 2005, Journal of neural engineering.

[6]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[7]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[8]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[9]  A. Engel,et al.  An independent brain–computer interface using covert non-spatial visual selective attention , 2010, Journal of neural engineering.

[10]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[11]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[12]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[13]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[14]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Christa Neuper,et al.  Asynchronous steady-state visual evoked potential based BCI control of a 2-DoF artificial upper limb , 2010, Biomedizinische Technik. Biomedical engineering.

[16]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[17]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[18]  Thorsten O. Zander,et al.  BC(eye): Combining Eye-Gaze Input with Brain-Computer Interaction , 2009, HCI.

[19]  Wei Wu,et al.  Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs , 2006, IEEE Transactions on Biomedical Engineering.

[20]  Christa Neuper,et al.  Temporal Coding of Brain Patterns for Direct Limb Control in Humans , 2010, Front. Neurosci..

[21]  Gernot R. Müller-Putz,et al.  Comparison of DFT and lock-in amplifier features and search for optimal electrode positions in SSVEP-based BCI , 2008, Journal of Neuroscience Methods.

[22]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[23]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Clemens Brunner,et al.  Analysis of sensorimotor rhythms for the implementation of a brain switch for healthy subjects , 2010, Biomed. Signal Process. Control..

[25]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction , 2011 .

[26]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[27]  J. Bohorquez,et al.  Neuromonitoring of cochlea and auditory nerve with multiple extracted parameters during induced hypoxia and nerve manipulation , 2005, Journal of neural engineering.

[28]  B. Hjorth.  An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[29]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.

[30]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[31]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[32]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[33]  D. Regan.  Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[34]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[35]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  G. Pfurtscheller,et al.  Could the beta rebound in the EEG be suitable to realize a “brain switch”? , 2009, Clinical Neurophysiology.