An event-triggered ADP controller for single link robot arm system based on output position

In this paper, an event-triggered adaptive dynamic programming (ADP) control method is proposed for a single link robot arm system based on the output position. Firstly, we propose a state observer with the neural network (NN) technology to reconstruct the signals of the angular position and angular velocity of the robot arm. Then, in order to solve the optimal control problem of the robot arm system, an ADP controller is introduced in an event-triggered manner based on the inner states from the observer, where the ADP method exploits neural network to approximate the performance index in the system and the event-triggered mechanism is designed to update the control signal aperiodically for the reduction of the computation and transmission load. Finally, as for the continuous and the jump dynamics, the uniform ultimate boundedness (UUB) of the closed-loop system is guaranteed with the help of Lyapunov theory, and simulation results are presented to demonstrate the effectiveness of the proposed controller.

[1]  Derong Liu,et al.  Adaptive Dynamic Programming for Discrete-Time Zero-Sum Games , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Haibo He,et al.  Event-Triggered Adaptive Dynamic Programming for Continuous-Time Systems With Control Constraints , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Zhong-Ping Jiang,et al.  Adaptive Dynamic Programming for Stochastic Systems With State and Control Dependent Noise , 2016, IEEE Transactions on Automatic Control.

[4]  Xiangnan Zhong,et al.  An Event-Triggered ADP Control Approach for Continuous-Time System With Unknown Internal States. , 2017 .

[5]  Haibo He,et al.  Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming , 2017, IEEE Transactions on Industrial Electronics.

[6]  Qichao Zhang,et al.  Event-Triggered H ∞ Control for Continuous-Time Nonlinear System , 2015, ISNN.

[7]  Derong Liu,et al.  Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming , 2014, Inf. Sci..

[8]  Yun Zhang,et al.  Saturated Nussbaum Function Based Approach for Robotic Systems With Unknown Actuator Dynamics , 2016, IEEE Transactions on Cybernetics.

[9]  James E. Steck,et al.  Adaptive Feedback Control by Constrained Approximate Dynamic Programming , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Qichao Zhang,et al.  Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics , 2016, IEEE Transactions on Cybernetics.

[11]  Gang Sun,et al.  A DSC approach to adaptive neural network tracking control for pure-feedback nonlinear systems , 2013, Appl. Math. Comput..

[12]  Huiming Wang,et al.  Adaptive Command-Filtered Backstepping Control of Robot Arms With Compliant Actuators , 2018, IEEE Transactions on Control Systems Technology.

[13]  Xiaohong Cui,et al.  Data-based approximate optimal control for nonzero-sum games of multi-player systems using adaptive dynamic programming , 2018, Neurocomputing.

[14]  Tao Zhang,et al.  Adaptive neural network control of nonlinear systems by state and output feedback , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Haibo He,et al.  Event-triggered reinforcement learning approach for unknown nonlinear continuous-time system , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[16]  Yuzhu Huang,et al.  Bounded robust control design for uncertain nonlinear systems using single-network adaptive dynamic programming , 2017, Neurocomputing.

[17]  Wei He,et al.  Iterative Learning Control of a Robotic Arm Experiment Platform with Input Constraint , 2018, IEEE Transactions on Industrial Electronics.

[18]  Lu Dong,et al.  Robust optimal control for time-delay systems with dynamic uncertainties via ADP , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[19]  Huaguang Zhang,et al.  Decentralized adaptive tracking control scheme for nonlinear large-scale interconnected systems via adaptive dynamic programming , 2017, Neurocomputing.

[20]  Zhong-Ping Jiang,et al.  Adaptive dynamic programming and optimal control of nonlinear nonaffine systems , 2014, Autom..

[21]  Derong Liu,et al.  Observer based adaptive dynamic programming for fault tolerant control of a class of nonlinear systems , 2017, Inf. Sci..

[22]  Zhong-Ping Jiang,et al.  Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programming , 2016, Autom..

[23]  Sarangapani Jagannathan,et al.  Event-Triggered Distributed Approximate Optimal State and Output Control of Affine Nonlinear Interconnected Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Qichao Zhang,et al.  Event-Triggered $H_\infty $ Control for Continuous-Time Nonlinear System via Concurrent Learning , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Tao Feng,et al.  Distributed Optimal Consensus Control for Nonlinear Multiagent System With Unknown Dynamic , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Changyin Sun,et al.  An Event-Triggered Approach for Load Frequency Control With Supplementary ADP , 2017, IEEE Transactions on Power Systems.

[27]  Derong Liu,et al.  Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems , 2016, IEEE Transactions on Cybernetics.

[28]  Derong Liu,et al.  Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming , 2013, Int. J. Control.

[29]  Frank L. Lewis,et al.  A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems , 2013, Autom..