A combination strategy based brain–computer interface for two-dimensional movement control

OBJECTIVE Two-dimensional (2D) movement control is an important issue in brain-computer interfaces (BCIs) research because being able to move, for example, a cursor with the brain will enable patients with motor disabilities to control their environment. However, it is still a challenge to continuously control 2D movement with a non-invasive BCI system. In this paper, we developed a 2D cursor control with motor imagery BCI tasks allowing users to move a cursor to any position by using a combination strategy. With this strategy, a user can combine multiple motor imagery tasks, alternatively or simultaneously, to control 2D movements. APPROACH After a training session, six participants took part in the first control strategy experiment (the center-out experiment) to verify the effectiveness of the cursor control. Three of the six participants performed an additional experiment, in which they were required to move the cursor to hit five targets in a given sequence. MAIN RESULTS The average hit rate was more than [Formula: see text] and the trajectories were close to the shortest path. The average hit rate was more than 95.6% and the trajectories were close to the shortest path in the center-out experiment. In the additional experiment, three participants achieved a 100% hit rate with a short trajectory. SIGNIFICANCE The results demonstrated that users were able to effectively control the 2D movement using the proposed strategy. The present system may be used as a tool to interact with the external world.

[1]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[3]  Brendan Z. Allison,et al.  Improved signal processing approaches in an offline simulation of a hybrid brain–computer interface , 2010, Journal of Neuroscience Methods.

[4]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[5]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[6]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[7]  Hong Xie,et al.  A Motor Imagery Based Brain-Computer Interface Speller , 2013, IWANN.

[8]  Trent J. Bradberry,et al.  Fast attainment of computer cursor control with noninvasively acquired brain signals , 2011, Journal of neural engineering.

[9]  B. Allison,et al.  The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP's): toward a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[11]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[12]  Yuanqing Li,et al.  Surfing the internet with a BCI mouse , 2012, Journal of neural engineering.

[13]  Jie Li,et al.  Evaluation and Application of a Hybrid Brain Computer Interface for Real Wheelchair Parallel Control with Multi-Degree of Freedom , 2014, Int. J. Neural Syst..

[14]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[15]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[17]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[19]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[20]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[22]  C. A. Ruf,et al.  Brain communication in the locked-in state. , 2013, Brain : a journal of neurology.

[23]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[24]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[25]  G. Pfurtscheller,et al.  Graz-BCI: state of the art and clinical applications , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[27]  Brendan Z. Allison,et al.  Journal of Neuroscience Methods , 2022 .

[28]  C Neuper,et al.  A comparison of three brain–computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals , 2011, Journal of neural engineering.

[29]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.