An SSVEP Stimuli Design using Real-time Camera View with Object Recognition

Most SSVEP-based stimuli BCIs are pre-defined using the white blocks. This kind of scenario lead less flexibility in the real life. To represent the flickers with the location, types and configurations of the objects in real world, this paper proposes an SSVEP-based BCI using real-time camera view with object recognition algorithm to provide intuitive BCI for users. A deep learning-based object recognition algorithm is used to calculate the location of the objects on the online camera view from a depth camera. After the bounding box of the objects is estimated, the location of the SSVEP flickers are designed to overlap on the object locations. An overlapping FFT and SVM is used to recognize the EEG signals into corresponding classes. In experimental results, the classification rate for camera view scenario is more than 94.1%. The results show that proposed SSVEP stimuli design is available to create an intuitive and reliable human machine interaction. The proposed results can be used for the users who have motor disabilities to further used to interact with assistive devices, such as: robotic arm and wheelchairs.

[1]  Kazumi Ishizuka,et al.  LSTM-based Classification of Multiflicker-SSVEP in Single Channel Dry-EEG for Low-power/High-accuracy Quadcopter-BMI System , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[2]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[3]  Ediana Sutjiredjeki,et al.  A prototype of SSVEP-based BCI for home appliances control , 2016, 2016 1st International Conference on Biomedical Engineering (IBIOMED).

[4]  Chin-Teng Lin,et al.  A Wireless Multifunctional SSVEP-Based Brain–Computer Interface Assistive System , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[5]  Arun Khosla,et al.  Influence of stimuli colour in SSVEP-based BCI wheelchair control using support vector machines , 2014, Journal of medical engineering & technology.

[6]  Mingzhou Liu,et al.  Human motion segmentation and recognition using machine vision for mechanical assembly operation , 2016, SpringerPlus.

[7]  Xiaogang Chen,et al.  Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm , 2019, Journal of neural engineering.

[8]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[11]  Yu-Te Wang,et al.  A cell-phone-based brain–computer interface for communication in daily life , 2010, AICI.

[12]  An H. Do,et al.  Brain-Computer Interface Controlled Functional Electrical Stimulation System for Ankle Movement , 2011, Journal of NeuroEngineering and Rehabilitation.

[13]  Mian Muhammad Awais,et al.  Learning from demonstration in robots: Experimental comparison of neural architectures , 2011 .

[14]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[15]  Kemal Polat,et al.  A cascade learning system for classification of diabetes disease: Generalized Discriminant Analysis and Least Square Support Vector Machine , 2008, Expert Syst. Appl..

[16]  Rajesh Singla,et al.  Comparison of SSVEP Signal Classification Techniques Using SVM and ANN Models for BCI Applications , 2014 .

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.