An FDES-Based Shared Control Method for Asynchronous Brain-Actuated Robot

The asynchronous brain-computer interface (BCI) offers more natural human-machine interaction. However, it is still considered insufficient to control rapid and complex sequences of movements for a robot without any advanced control method. This paper proposes a new shared controller based on the supervisory theory of fuzzy discrete event system (FDES) for brain-actuated robot control. The developed supervisory theory allows the more reliable control mode to play a dominant role in the robot control which is beneficial to reduce misoperation and improve the robustness of the system. The experimental procedures consist of real-time direct manual control and BCI control tests from ten volunteers. Both tests have shown that the proposed method significantly improves the performance and robustness of the robotic control. In an online BCI experiment, eight of the participants successfully controlled the robot to circumnavigate obstacles and reached the target with a three mental states asynchronous BCI while the other two participants failed in all the BCI control sessions. Furthermore, the FDES-based shared control method also helps to reduce the workload. It can be stated that the asynchronous BCI, in combination with FDES-based shared controller, is feasible for the real-time and robust control of robotics.

[1]  Sandra G. Hart,et al.  NASA Task Load Index (TLX) , 2013 .

[2]  Sandra G. Hart NASA Task Load Index (TLX). Volume 1.0; Computerized Version , 1986 .

[3]  Yili Liu,et al.  A speed and direction-based cursor control system with P300 and SSVEP , 2014, Biomed. Signal Process. Control..

[4]  Liqing Zhang,et al.  EEG-based asynchronous BCI control of a car in 3D virtual reality environments , 2009 .

[5]  Huosheng Hu,et al.  A self-paced online BCI for mobile robot control , 2010 .

[6]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[7]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[8]  Paolo Pirjanian,et al.  Behavior Coordination Mechanisms - State-of-the-art , 1999 .

[9]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[10]  Tao Geng,et al.  A 3-class Asynchronous BCI Controlling A Simulated Mobile Robot , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Brenan J. McCarragher,et al.  Modeling and constraining human interactions in shared control utilizing a discrete event framework , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[13]  George K. I. Mann,et al.  Behavior-modulation technique in mobile robotics using fuzzy discrete event system , 2006, IEEE Transactions on Robotics.

[14]  Zbigniew Dziong,et al.  Reliable Decentralized Control of Fuzzy Discrete-Event Systems and a Test Algorithm , 2013, IEEE Transactions on Cybernetics.

[15]  Guoqing Chen,et al.  State-Based Control of Fuzzy Discrete-Event Systems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Xiaoming Hu,et al.  A hybrid control approach to action coordination for mobile robots , 1999, Autom..

[17]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[18]  J. Mourino,et al.  Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[20]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[21]  Feng Lin,et al.  Modeling and control of fuzzy discrete event systems , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[22]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[23]  José del R. Millán,et al.  The role of shared-control in BCI-based telepresence , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[24]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[25]  Yongzhi Cao,et al.  Supervisory control of fuzzy discrete event systems , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Ming Yue,et al.  Shared control of robot based on Fuzzy Discrete Event System , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[27]  Yiannis S. Boutalis,et al.  Fuzzy Discrete Event Systems for Multiobjective Control: Framework and Application to Mobile Robot Navigation , 2012, IEEE Transactions on Fuzzy Systems.

[28]  A Graser,et al.  BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI? , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Girijesh Prasad,et al.  Self-paced brain-controlled wheelchair methodology with shared and automated assistive control , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[30]  Pablo F. Diez,et al.  Mobile robot navigation with a self-paced brain–computer interface based on high-frequency SSVEP , 2013, Robotica.

[31]  George K. I. Mann,et al.  Behavior Coordination of Mobile Robotics Using Supervisory Control of Fuzzy Discrete Event Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Jaeseung Jeong,et al.  Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI , 2012, IEEE Transactions on Robotics.

[33]  Lin Zhang,et al.  Mobile robot navigation based on shared control of Fuzzy Discrete Event System , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[34]  George K. I. Mann,et al.  Generalizing the Decentralized Control of Fuzzy Discrete Event Systems , 2012, IEEE Transactions on Fuzzy Systems.