A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device

Restoring the interaction between disabled people and the 3-D physical world via a brain-computer interface (BCI) is an exciting topic. To this end, we designed a wearable BCI system based on the steady-state visual evoked potential (SSVEP), which enables 3-D navigation of quadcopter flight with immersive first-person visual feedback using a head-mounted device. In addition, to alleviate the user’s operational burden, this paper provides asynchronous switch control for the users. The transitional state due to head movement in an asynchronous BCI was isolated online and translated into hover to eliminate its influence. The experimental results in the physical environment showed that the subjects could accomplish the 3-D flight tasks accurately and smoothly using our system. In particular, in this paper, we proposed an information transfer rate metric that is suitable for the asynchronous task. We demonstrated the feasibility of using the head-mounted device and a proper control strategy to facilitate the portability and practicability of the SSVEP-based BCI system for its navigation utility.

[1]  P. Varona,et al.  Assisted closed-loop optimization of SSVEP-BCI efficiency , 2012, Front. Neural Circuits.

[2]  Po-Lei Lee,et al.  Development of a Low-Cost FPGA-Based SSVEP BCI Multimedia Control System , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[3]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Piotr Stawicki,et al.  Driving a Semiautonomous Mobile Robotic Car Controlled by an SSVEP-Based BCI , 2016, Comput. Intell. Neurosci..

[5]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Peng Yuan,et al.  A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces , 2013, Journal of neural engineering.

[7]  최승진,et al.  Immersive BCI with SSVEP in VR head-mounted display , 2015 .

[8]  Xingyu Wang,et al.  Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis , 2013, Int. J. Neural Syst..

[9]  Dingguo Zhang,et al.  Brain-Computer Interface Controlled Cyborg: Establishing a Functional Information Transfer Pathway from Human Brain to Cockroach Brain , 2016, PloS one.

[10]  Chin-Teng Lin,et al.  Development of Wireless Brain Computer Interface With Embedded Multitask Scheduling and its Application on Real-Time Driver's Drowsiness Detection and Warning , 2008, IEEE Transactions on Biomedical Engineering.

[11]  Li-Wei Ko,et al.  Research on steady-state visual evoked potentials in 3D displays , 2015, Commercial + Scientific Sensing and Imaging.

[12]  Ross Cunnington,et al.  Stimulus specificity of a steady-state visual-evoked potential-based brain–computer interface , 2012, Journal of neural engineering.

[13]  Thierry Pun,et al.  Information-transfer rate modeling of EEG-based synchronized brain-computer interfaces , 2005 .

[14]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[15]  Tzyy-Ping Jung,et al.  A Cell-Phone Based Brain-Computer Interface for Communication in Daily Life , 2010, AICI.

[16]  Feng Wan,et al.  Flashing color on the performance of SSVEP-based brain-computer interfaces , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[18]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[19]  Peng Yuan,et al.  Enhancing performances of SSVEP-based brain–computer interfaces via exploiting inter-subject information , 2015, Journal of neural engineering.

[20]  Yili Liu,et al.  Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle , 2014, IEEE Transactions on Intelligent Transportation Systems.

[21]  Piotr Stawicki,et al.  Autonomous Parameter Adjustment for SSVEP-Based BCIs with a Novel BCI Wizard , 2015, Front. Neurosci..

[22]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[23]  G. McArthur,et al.  Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs , 2013, PeerJ.

[24]  Ivan Volosyak,et al.  SSVEP-based Bremen–BCI interface—boosting information transfer rates , 2011, Journal of neural engineering.

[25]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[26]  Yang Yu,et al.  A Dynamically Optimized SSVEP Brain–Computer Interface (BCI) Speller , 2015, IEEE Transactions on Biomedical Engineering.

[27]  A Graser,et al.  BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI? , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  W. A. Sarnacki,et al.  Brain–computer interface (BCI) operation: optimizing information transfer rates , 2003, Biological Psychology.

[29]  Mandayam A. Srinivasan,et al.  Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces , 2006, IEEE Transactions on Biomedical Engineering.

[30]  Wei Li,et al.  Comparative Study of SSVEP- and P300-Based Models for the Telepresence Control of Humanoid Robots , 2015, PloS one.

[31]  Wei Wu,et al.  Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs , 2006, IEEE Transactions on Biomedical Engineering.

[32]  Xingyu Wang,et al.  Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Brendan Z. Allison,et al.  A feasibility study on SSVEP-based interaction with motivating and immersive virtual and augmented reality , 2017, ArXiv.