Design of an SSVEP-based BCI system with visual servo module for a service robot to execute multiple tasks

Brain-computer interface (BCI) systems can translate the human mind into control commands, which makes it feasible to improve the life quality of physically challenged people. However, in real-life situations, it is still difficult for users to utilize robots to provide basic services with BCI systems. We aimed to propose a BCI-based system with a visual servo module to operate a service robot. We recorded single-channel steady-state visual evoked potentials (SSVEP) as input signals for the BCI system of this study. The visual stimuli for inducing SSVEP were modulated at seven different frequencies with the sampled sinusoidal method. Correspondingly, this SSVEP-based BCI system can generate seven control commands for the operation of the service robot, which can provide three fundamental services: mobility, manipulation, and delivery. The visual servo module was established to reduce the burden of users and accelerate service procedures. To evaluate the performance of this system, subjects were recruited to participate in the experiments. All the participants succeed in operating the robot to provide the basic services. According to the experimental results, this SSVEP-based BCI system that incorporates the visual servo module can be effectively used to operate service robots with reduced number of channels and increased ability to perform multiple tasks.

[1]  Rui Zhang,et al.  Enhanced Motor Imagery Training Using a Hybrid BCI With Feedback , 2015, IEEE Transactions on Biomedical Engineering.

[2]  Jianjun Meng,et al.  Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI , 2014, IEEE Transactions on Biomedical Engineering.

[3]  Bin He,et al.  EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks , 2016, IEEE Transactions on Biomedical Engineering.

[4]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[5]  Adi Panca Saputra Iskandar,et al.  Analysis of Shopping Cart At Drugs Store By Using An Apriori Algorithm , 2017 .

[6]  A Graser,et al.  BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI? , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[8]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[9]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[10]  Michael Bensch,et al.  Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Gwi-Tae Park,et al.  Study on the Mobility of Service Robots , 2012 .

[12]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[13]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[14]  Yili Liu,et al.  Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle , 2014, IEEE Transactions on Intelligent Transportation Systems.

[15]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[17]  Mário Sarcinelli-Filho,et al.  Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface. , 2013, Medical engineering & physics.

[18]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Rakesh Gupta,et al.  Smoothed Sarsa: Reinforcement learning for robot delivery tasks , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[21]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[22]  Feng Guo,et al.  Brain–machine interface control of a manipulator using small-world neural network and shared control strategy , 2014, Journal of Neuroscience Methods.

[23]  Chulhee Lee,et al.  Fast object detection based on color histograms and local binary patterns , 2012, TENCON 2012 IEEE Region 10 Conference.

[24]  Massimo Callegari,et al.  Analysis and Design of a Reconfigurable 3-DoF Parallel Manipulator for Multimodal Tasks , 2015, IEEE/ASME Transactions on Mechatronics.

[25]  Sungho Jo,et al.  A Low-Cost EEG System-Based Hybrid Brain-Computer Interface for Humanoid Robot Navigation and Recognition , 2013, PloS one.