Using SSVEP-BCI to Continuous Control a Quadcopter with 4-DOF Motions*

Brain-computer interfaces (BCIs) allow for translating electroencephalogram (EEG) into control commands, e.g., to control a quadcopter. This study, we developed a practical BCI based on steady-state visually evoked potential (SSVEP) for continuous control of a quadcopter from the first-person perspective. Users watched with the video stream from a camera on the quadcopter. An innovative user interface was developed by embedding 12 SSVEP flickers into the video stream, which corresponded to the flight commands of ‘take-off,’ ‘land,’ ‘hover,’ ‘keep-going,’ ‘clockwise,’ ‘counter-clockwise’ and rectilinear motions in six directions, respectively. The command was updated every 400ms by decoding the collected EEG data using a combined classification algorithm based on task-related component analysis (TRCA) and linear discriminant analysis (LDA). The quadcopter flew in the 3-D space according to the control vector that was determined by the latest four commands. Three novices participated in this study. They were asked to control the quadcopter by either the brain or hands to fly through a circle and land on the target zone. As a result, the time consumption ratio of brain-control to hand-control was as low as 1.34, which means the BCI performance was close to hands. The information transfer rate reached a peak of 401.79 bits/min in the simulated online experiment. These results demonstrate the proposed SSVEP-BCI system is efficient for controlling the quadcopter.

[1]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[2]  Qiang Gao,et al.  Noninvasive Electroencephalogram Based Control of a Robotic Arm for Writing Task Using Hybrid BCI System , 2017, BioMed research international.

[3]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[5]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[6]  Zhao Xu,et al.  Quadcopter Flight Control Using a Non-invasive Multi-Modal Brain Computer Interface , 2019, Front. Neurorobot..

[7]  Meng Wang,et al.  A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device , 2018, IEEE Access.

[8]  Yijun Wang,et al.  Enhance decoding of pre-movement EEG patterns for Brain-Computer Interfaces. , 2019, Journal of neural engineering.

[9]  Xiaogang Chen,et al.  Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm , 2019, Journal of neural engineering.

[10]  Tzyy-Ping Jung,et al.  A Brain–Computer Interface Based on Miniature-Event-Related Potentials Induced by Very Small Lateral Visual Stimuli , 2018, IEEE Transactions on Biomedical Engineering.

[11]  Yijun Wang,et al.  Implementing Over 100 Command Codes for a High-Speed Hybrid Brain-Computer Interface Using Concurrent P300 and SSVEP Features , 2020, IEEE Transactions on Biomedical Engineering.

[12]  Tianwei Shi,et al.  Brain Computer Interface system based on indoor semi-autonomous navigation and motor imagery for Unmanned Aerial Vehicle control , 2015, Expert Syst. Appl..

[13]  Yijun Wang,et al.  Discriminative Canonical Pattern Matching for Single-Trial Classification of ERP Components , 2019, IEEE Transactions on Biomedical Engineering.