Brain–Machine Interfacing-Based Teleoperation of Multiple Coordinated Mobile Robots

This paper describes the development of a teleoperation control framework of multiple coordinated mobile robots through a brain–machine interface (BMI). Utilizing the remote images of an environment, transferred to the human operator, visual compressive feedback loop produces imagine errors in nonvector space, where images are considered as a set without image processing of feature extraction. Given an initial set and a goal set, visual evoked potentials are used to generate EEG motion commands to make the image set converge to the goal set. The online BMI, utilizing steady-state visually evoked potentials, analyzes the human EEG data in such a format that human intentions can be recognized by AdaBoostSVM classifier and motion commands produced for the teleoperated robot. Bezier curve is utilized to parameterize the motion commands and leader–follower formation control is proposed to guarantee a good reference trajectory tracking performance. Extensive experimental studies have been carried out to assess the effectiveness of the proposed approaches.

[1]  José del R. Millán,et al.  Non-Invasive Brain-Actuated Control of a Mobile Robot , 2003, IJCAI.

[2]  Jing-Sin Liu,et al.  Practical and flexible path planning for car-like mobile robot using maximal-curvature cubic spiral , 2005, Robotics Auton. Syst..

[3]  Javier Minguez,et al.  A Telepresence Mobile Robot Controlled With a Noninvasive Brain–Computer Interface , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Igor Skrjanc,et al.  Time optimal path planning considering acceleration limits , 2003, Robotics Auton. Syst..

[5]  Takayuki Kanda,et al.  A Teleoperation Approach for Mobile Social Robots Incorporating Automatic Gaze Control and Three-Dimensional Spatial Visualization , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[7]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[8]  Yue Zhao,et al.  A Wireless BCI and BMI System for Wearable Robots , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Éric Marchand,et al.  Feature tracking for visual servoing purposes , 2005, Robotics Auton. Syst..

[10]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[11]  Christian Laugier,et al.  Controlling a Wheelchair Indoors Using Thought , 2007, IEEE Intelligent Systems.

[12]  Francesco Piccione,et al.  User adaptive BCIs: SSVEP and P300 based interfaces , 2003, PsychNology J..

[13]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[14]  Guo-Xing Wen,et al.  Neural-network-based adaptive leader-following consensus control for second-order non-linear multi-agent systems , 2015 .

[15]  Imad H. Elhajj,et al.  Tele-coordinated control of multi-robot systems via the Internet , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[16]  Bo Song,et al.  Compressive Feedback-Based Motion Control for Nanomanipulation—Theory and Applications , 2014, IEEE Transactions on Robotics.

[17]  E. Donchin,et al.  EEG-based communication: prospects and problems. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Chenguang Yang,et al.  Guest Editorial An Overview of Biomedical Robotics and Bio-Mechatronics Systems and Applications , 2016, IEEE Trans. Syst. Man Cybern. Syst..

[19]  Gabriel Hugh Elkaim,et al.  Contin uous Curvature Path Generation Based on Bezier Curves for Autonomous Vehicles , 2010 .

[20]  Mark W. Spong,et al.  Semiautonomous control of multiple networked Lagrangian systems , 2009 .

[21]  Igor Skrjanc,et al.  Optimal cooperative collision avoidance between multiple robots based on Bernstein-Bézier curves , 2010, Robotics Auton. Syst..

[22]  Yuanqing Xia,et al.  Adaptive Fuzzy Control for Multilateral Cooperative Teleoperation of Multiple Robotic Manipulators Under Random Network-Induced Delays , 2014, IEEE Transactions on Fuzzy Systems.

[23]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[24]  Robert E. Mahony,et al.  Dynamic Kinesthetic Boundary for Haptic Teleoperation of VTOL Aerial Robots in Complex Environments , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[26]  Robert Meyers,et al.  Real-time photorealistic virtualized reality interface for remote mobile robot control , 2010, ISRR.

[27]  Jonathan Rogers,et al.  Bezier Curve Path Planning for Parafoil Terminal Guidance , 2013 .

[28]  Evangelos Papadopoulos,et al.  Polynomial-based obstacle avoidance techniques for nonholonomic mobile manipulator systems , 2005, Robotics Auton. Syst..

[29]  Shuxiang Guo,et al.  A Kinect-Based Real-Time Compressive Tracking Prototype System for Amphibious Spherical Robots , 2015, Sensors.

[30]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[31]  José del R. Millán,et al.  Brain-actuated interaction , 2004, Artif. Intell..

[32]  Urbano Nunes,et al.  Assisted navigation for a brain-actuated intelligent wheelchair , 2013, Robotics Auton. Syst..

[33]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[34]  R. Acharya,et al.  Analysis of EEG signals during epileptic and alcoholic states using AR modeling techniques , 2008 .

[35]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[36]  T. Martin McGinnity,et al.  EEG-Based Mobile Robot Control Through an Adaptive Brain–Robot Interface , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  M. Rudelson,et al.  On sparse reconstruction from Fourier and Gaussian measurements , 2008 .

[38]  John Langford,et al.  Multi-Label Prediction via Compressed Sensing , 2009, NIPS.

[39]  Chun-Yi Su,et al.  Neural-Adaptive Control of Single-Master–Multiple-Slaves Teleoperation for Coordinated Multiple Mobile Manipulators With Time-Varying Communication Delays and Input Uncertainties , 2013, IEEE Transactions on Neural Networks and Learning Systems.