Brain-robot Shared Control Based on Motor Imagery and Improved Bayes Filter*

Brain-controlled robots are an innovative means of interacting and can also provide new solutions for disabled and stroke patients to communicate with the outside world. Since the poor real-time performance and poor accuracy of brain-computer interface (BCI) is not precise to control the robot directly, in order to avoid damage to the robot and humans in the process, this paper designs a brain-robot shared control system based on brain-computer interface. The motion direction of the robot controlled via four types of motor imagery (MI) signals. Feature extraction of MI signals is performed using common space pattern (CSP) combined with local characteristic-scale decomposition (LCD). The classification results are obtained with the appropriate features processed by the spectral regression discriminant analysis (SRDA) classifier. The Bayes filter algorithm is used to implement the robot shared control method, the belief of the robot's motion direction is calculated, and then the control ratio of the robot's autonomous motion and the BCI are assigned automatically. Considering that each control instruction given by BCI cost at least 1.5 seconds. To achieve better control effect at the interval between two instructions, the relationship with two steps of Bayes filter is redesigned, even if a new control data is not received, the robot will continuously update the measurement according to the previous control data, assign a new control ratio and execute the corresponding instruction, so that the robot can continuously adjust the movement intention and proportion during the instruction interval of BCI. The control effect was verified by online experiments. Using the improved Bayes filter algorithm, the success rate of the experiment is greatly improved, and the number of instructions used in single trial is reduced by 50%.

[1]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[2]  Angelika Peer,et al.  Goal-recognition-based adaptive brain-computer interface for navigating immersive robotic systems , 2017, Journal of neural engineering.

[3]  Ricardo Chavarriaga,et al.  Long-Term Stable Control of Motor-Imagery BCI by a Locked-In User Through Adaptive Assistance , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Peter K. Allen,et al.  Task level hierarchical system for BCI-enabled shared autonomy , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[5]  Chunfang Liu,et al.  A hybrid EEG-based BCI for robot grasp controlling , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Jingchuan Wang,et al.  Dynamic shared control for human-wheelchair cooperation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Lucas Beyer,et al.  Towards a Principled Integration of Multi-camera Re-identification and Tracking Through Optimal Bayes Filters , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Manfred Wieser,et al.  Evaluation of smartphone-based indoor positioning using different Bayes filters , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[9]  Lin Zhang,et al.  An FDES-Based Shared Control Method for Asynchronous Brain-Actuated Robot , 2016, IEEE Transactions on Cybernetics.

[10]  Tom Carlson,et al.  Comparing shared control approaches for alternative interfaces: A wheelchair simulator experiment , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[11]  Luzheng Bi,et al.  A shared controller for brain-controlled assistive vehicles , 2016, 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[12]  Xinjun Sheng,et al.  Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance , 2019, Robotics Auton. Syst..

[13]  M. Moghavvemi,et al.  Development of a steady state visual evoked potential (SSVEP)-based brain computer interface (BCI) system , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[14]  Deng Cai,et al.  Unsupervised feature selection for multi-cluster data , 2010, KDD.

[15]  Qingsong Ai,et al.  Feature Selection for Motor Imagery EEG Classification Based on Firefly Algorithm and Learning Automata , 2017, Sensors.