Adaptive Neural Control of a Kinematically Redundant Exoskeleton Robot Using Brain–Machine Interfaces

In this paper, a closed-loop control has been developed for the exoskeleton robot system based on brain–machine interface (BMI). Adaptive controllers in joint space, a redundancy resolution method at the velocity level, and commands that generated from BMI in task space have been integrated effectively to make the robot perform manipulation tasks controlled by human operator’s electroencephalogram. By extracting the features from neural activity, the proposed intention decoding algorithm can generate the commands to control the exoskeleton robot. To achieve optimal motion, a redundancy resolution at the velocity level has been implemented through neural dynamics optimization. Considering human–robot interaction force as well as coupled dynamics during the exoskeleton operation, an adaptive controller with redundancy resolution has been designed to drive the exoskeleton tracking the planned trajectory in human brain and to offer a convenient method of dynamics compensation with minimal knowledge of the dynamics parameters of the exoskeleton robot. Extensive experiments which employed a few subjects have been carried out. In the experiments, subjects successfully fulfilled the given manipulation tasks with convergence of tracking errors, which verified that the proposed brain-controlled exoskeleton robot system is effective.

[1]  Shuzhi Sam Ge,et al.  Contact-Force Distribution Optimization and Control for Quadruped Robots Using Both Gradient and Adaptive Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  D. Regan Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[3]  Shuai Li,et al.  Decentralized kinematic control of a class of collaborative redundant manipulators via recurrent neural networks , 2012, Neurocomputing.

[4]  Francis Eng Hock Tay,et al.  Barrier Lyapunov Functions for the control of output-constrained nonlinear systems , 2009, Autom..

[5]  Shuzhi Sam Ge,et al.  Adaptive Neural Network Control of Robotic Manipulators , 1999, World Scientific Series in Robotics and Intelligent Systems.

[6]  Andrés Úbeda,et al.  Visual evoked potential-based brain-machine interface applications to assist disabled people , 2012, Expert Syst. Appl..

[7]  Aaron M. Dollar,et al.  Lower Extremity Exoskeletons and Active Orthoses: Challenges and State-of-the-Art , 2008, IEEE Transactions on Robotics.

[8]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[10]  Zhiliang Xu,et al.  Multiclass Least Squares Wavelet Support Vector Machines , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[11]  C. L. Philip Chen,et al.  Brain-Actuated Control of Dual-Arm Robot Manipulation With Relative Motion , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[12]  Jun Wang,et al.  A dual neural network for redundancy resolution of kinematically redundant manipulators subject to joint limits and joint velocity limits , 2003, IEEE Trans. Neural Networks.

[13]  Yunong Zhang,et al.  A dual neural network for convex quadratic programming subject to linear equality and inequality constraints , 2002 .

[14]  Xiaolin Hu,et al.  Motion planning with obstacle avoidance for kinematically redundant manipulators based on two recurrent neural networks , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[15]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[16]  Wolfgang Rosenstiel,et al.  Control of an Internet Browser Using the P300 Event- Related Potential , 2008 .

[17]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Keng Peng Tee,et al.  Control of state-constrained nonlinear systems using Integral Barrier Lyapunov Functionals , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[19]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[20]  Shuzhi Sam Ge,et al.  Adaptive Control of a Flexible Crane System With the Boundary Output Constraint , 2014, IEEE Transactions on Industrial Electronics.

[21]  Antonio Bicchi,et al.  Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations , 2018, IEEE Transactions on Robotics.

[22]  Chang B. Joo,et al.  Optimal motion planning of redundant manipulators with controlled task infeasibility , 2013 .

[23]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[24]  Huijun Gao,et al.  Saturated Adaptive Robust Control for Active Suspension Systems , 2013, IEEE Transactions on Industrial Electronics.

[25]  Jing Zhou,et al.  Robust Adaptive Control of Uncertain Nonlinear Systems in the Presence of Input Saturation and External Disturbance , 2011, IEEE Transactions on Automatic Control.

[26]  Jian-Xin Xu,et al.  Iterative learning control for output-constrained systems with both parametric and nonparametric uncertainties , 2013, Autom..

[27]  Olivier Stasse,et al.  Time-Optimal Path Parameterization for Redundantly Actuated Robots: A Numerical Integration Approach , 2015, IEEE/ASME Transactions on Mechatronics.

[28]  Pyung Hun Chang,et al.  A cost function inspired by human arms movement for a bimanual robotic machining , 2012, 2012 IEEE International Conference on Robotics and Automation.

[29]  Peter C. Müller,et al.  Global Asymptotic Saturated PID Control for Robot Manipulators , 2010, IEEE Transactions on Control Systems Technology.

[30]  Makoto Sasaki,et al.  Development of a 3DOF mobile exoskeleton robot for human upper-limb motion assist , 2008, Robotics Auton. Syst..

[31]  Bin Yao,et al.  Online constrained optimization based adaptive robust control of a class of MIMO nonlinear systems with matched uncertainties and input/state constraints , 2014, Autom..

[32]  Renquan Lu,et al.  Development and Learning Control of a Human Limb With a Rehabilitation Exoskeleton , 2014, IEEE Transactions on Industrial Electronics.

[33]  Jian-Xin Xu,et al.  State-Constrained Iterative Learning Control for a Class Of MIMO Systems , 2013, IEEE Transactions on Automatic Control.

[34]  Robert Bogue,et al.  Exoskeletons and robotic prosthetics: a review of recent developments , 2009, Ind. Robot.