EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies

Films like Firefox, Surrogates, and Avatar have explored the possibilities of using brain-computer interfaces (BCIs) to control machines and replacement bodies with only thought. Real world BCIs have made great progress toward that end. Invasive BCIs have enabled monkeys to fully explore 3-D space using neuroprosthetics. However, noninvasive BCIs have not been able to demonstrate such mastery of 3-D space. Here, we report our work, which demonstrates that human subjects can use a noninvasive BCI to fly a virtual helicopter to any point in a 3-D world. Through use of intelligent control strategies, we have facilitated the realization of controlled flight in 3-D space. We accomplished this through a reductionist approach that assigns subject-specific control signals to the crucial components of 3-D flight. Subject control of the helicopter was comparable when using either the BCI or a keyboard. By using intelligent control strategies, the strengths of both the user and the BCI system were leveraged and accentuated. Intelligent control strategies in BCI systems such as those presented here may prove to be the foundation for complex BCIs capable of doing more than we ever imagined.

[1]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[2]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[3]  Bin He,et al.  Relationship between speed and EEG activity during imagined and executed hand movements , 2010, Journal of neural engineering.

[4]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[5]  Bin He,et al.  Cortical Imaging of Event-Related (de)Synchronization During Online Control of Brain-Computer Interface Using Minimum-Norm Estimates in Frequency Domain , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[7]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[9]  Bin He,et al.  BRAIN^COMPUTER INTERFACE , 2007 .

[10]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[11]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[12]  A. Karim,et al.  Neural Internet: Web Surfing with Brain Potentials for the Completely Paralyzed , 2006, Neurorehabilitation and neural repair.

[13]  Bin He,et al.  Classifying EEG-based motor imagery tasks by means of time–frequency synthesized spatial patterns , 2004, Clinical Neurophysiology.

[14]  Ricardo Ron-Angevin,et al.  Brain–computer interface: Changes in performance using virtual reality techniques , 2009, Neuroscience Letters.

[15]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[16]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[17]  Bin He,et al.  Goal selection versus process control in a brain–computer interface based on sensorimotor rhythms , 2009, Journal of neural engineering.

[18]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[19]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[20]  Mandayam A. Srinivasan,et al.  Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces , 2006, IEEE Transactions on Biomedical Engineering.

[21]  Horst Bischof,et al.  The Self-Paced Graz Brain-Computer Interface: Methods and Applications , 2007, Comput. Intell. Neurosci..

[22]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[23]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.