Efficient Quadcopter Flight Control Using Hybrid SSVEP + P300 Visual Brain Computer Interface

ABSTRACT The objective of this study was to assess the feasibility of hybrid SSVEP + P300 visual BCI systems for quad-copter flight control in physical world. Existing BCI-based quad-copter flight control has limitations of slow navigation, lower system accuracy, rigorous user training requirement and lesser number of independent control commands. So, there is need of hybrid BCI design that combines evoked SSVEP and P300 potentials to control flight direction of quad-copter movement. GUI design is developed such that user can effectively control quad-copter flight by gazing at visual stimuli buttons that produce SSVEP & P300 potentials simultaneously in human cortex. We compare the performance metrics of the proposed flight control systems with other existing BCI-based flight control as conventional SSVEP BCI and P300 BCI and commercially available keyboard flight control systems. Results proved that the proposed system outperforms the existing BCI-based flight control systems but has slightly lower performance efficiency than the commercial keyboard flight control systems. Further, the proposed quad-copter flight control system proved its suitability for patients with severe motor disabilities.

[1]  Eric W. Sellers,et al.  P300 brain-computer interface: comparing faces to size matched non-face stimuli , 2018 .

[2]  Yili Liu,et al.  A speed and direction-based cursor control system with P300 and SSVEP , 2014, Biomed. Signal Process. Control..

[3]  Wenwei Yu,et al.  Influence of Stimulus Color on Steady State Visual Evoked Potentials , 2016, IAS.

[4]  D. Nandagopal,et al.  Computational Neuroengineering Approaches to Characterise Cognitive Activity in EEG Data , 2015 .

[5]  Franck Tarpin-Bernard,et al.  Towards Brain Computer Interfaces for Recreational Activities: Piloting a Drone , 2015, INTERACT.

[6]  B. Rossion,et al.  Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. , 2011, Journal of vision.

[7]  Meng Wang,et al.  A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device , 2018, IEEE Access.

[8]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[9]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[10]  Urmila Shrawankar,et al.  An optimized facial stimuli paradigm for hybrid SSVEP+P300 brain computer interface , 2020, Cognitive Systems Research.

[11]  Teodiano Bastos,et al.  Comparison of the influence of stimuli color on Steady-State Visual Evoked Potentials , 2015 .

[12]  Piotr Milanowski,et al.  Towards an Optimization of Stimulus Parameters for Brain-Computer Interfaces Based on Steady State Visual Evoked Potentials , 2014, PloS one.

[13]  Christa Neuper,et al.  Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb , 2011, Medical & Biological Engineering & Computing.

[14]  Aboul Ella Hassanien,et al.  Linear discriminant analysis: A detailed tutorial , 2017, AI Commun..

[15]  J. Charles,et al.  A Sino-German λ 6 cm polarization survey of the Galactic plane I . Survey strategy and results for the first survey region , 2006 .

[16]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Feng Duan,et al.  Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module , 2015, IEEE Transactions on Autonomous Mental Development.

[18]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[19]  Jakob Jakobsen,et al.  Mind Controlled Drone: An Innovative Multiclass SSVEP based Brain Computer Interface , 2019, 2019 7th International Winter Conference on Brain-Computer Interface (BCI).

[20]  Keum Shik Hong,et al.  Hybrid EEG–fNIRS-Based Eight-Command Decoding for BCI: Application to Quadcopter Control , 2017, Front. Neurorobot..

[21]  D. Tanner,et al.  A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension , 2018, PloS one.

[22]  Minho Kim,et al.  Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking , 2014, Comput. Biol. Medicine.

[23]  G. Kovács,et al.  The face evoked steady-state visual potentials are sensitive to the orientation, viewpoint, expression and configuration of the stimuli. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  Dante Tezza,et al.  The State-of-the-Art of Human–Drone Interaction: A Survey , 2019, IEEE Access.

[25]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[26]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[27]  Henry W. W. Potts,et al.  Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record , 2015, Int. J. Medical Informatics.

[28]  Aurel Gontean,et al.  Brain-Computer Interface review , 2016, 2016 12th IEEE International Symposium on Electronics and Telecommunications (ISETC).

[29]  Zhao Xu,et al.  Quadcopter Flight Control Using a Non-invasive Multi-Modal Brain Computer Interface , 2019, Front. Neurorobot..

[30]  Andrzej Cichocki,et al.  Emotional faces boost up steady-state visual responsesforbrain–computer interface , 2011, Neuroreport.

[31]  Andreas Keil,et al.  Face-Evoked Steady-State Visual Potentials: Effects of Presentation Rate and Face Inversion , 2012, Front. Hum. Neurosci..

[32]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[33]  Thorsten O. Zander,et al.  A Survey on Unmanned Aerial Vehicle Remote Control Using Brain–Computer Interface , 2018, IEEE Transactions on Human-Machine Systems.

[34]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[35]  Tianwei Shi,et al.  Brain Computer Interface system based on indoor semi-autonomous navigation and motor imagery for Unmanned Aerial Vehicle control , 2015, Expert Syst. Appl..

[36]  Sadasivan Puthusserypady,et al.  An Improved Five Class MI Based BCI Scheme for Drone Control Using Filter Bank CSP , 2019, 2019 7th International Winter Conference on Brain-Computer Interface (BCI).