A New Approach for a Class of Continuous-Time Chaotic Systems Optimal Control by Online ADP Algorithm

In this chapter, an online adaptive dynamic programming (ADP) based optimal control scheme is developed for continuous-time chaotic systems. The idea is to use ADP algorithm to obtain the optimal control input which makes the performance index function reach the optimum. The expression of the performance index function for the chaotic system is first presented. The online ADP algorithm is presented to get the optimal control law. In the ADP structure, the neural networks are used to construct the critic network and action network, which can obtain the approximate performance index function and the control input, respectively. It is proven that the critic parameter error dynamics and the closed-loop chaotic systems are uniformly ultimately bounded exponentially. Simulation results are given to illustrate the performance of the established optimal control method.

[1]  Huaguang Zhang,et al.  Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming , 2010, Neurocomputing.

[2]  Frank L. Lewis,et al.  Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Zhang Huaguang,et al.  Exponential synchronization of stochastic impulsive perturbed chaotic Lur'e systems with time-varying delay and parametric uncertainty , 2008 .

[4]  Frank L. Lewis,et al.  Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem , 2010, Autom..

[5]  Huaguang Zhang,et al.  An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games , 2011, Autom..

[6]  Y. P. Zhang,et al.  Study of runaway electron behaviour during electron cyclotron resonance heating in the HL-2A Tokamak , 2009 .

[7]  Wei Qinglai,et al.  A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm , 2014 .

[8]  Liu Shuang,et al.  Chaos synchronization of a chain network based on a sliding mode control , 2013 .

[9]  Fu Jie,et al.  Robust lag synchronization between two different chaotic systems via dual-stage impulsive control , 2009 .

[10]  George G. Lendaris,et al.  Adaptive dynamic programming , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[11]  Haibo He,et al.  Adaptive Learning and Control for MIMO System Based on Adaptive Dynamic Programming , 2011, IEEE Transactions on Neural Networks.

[12]  Wendong Xiao,et al.  Optimal Tracking Control for a Class of Unknown Discrete-time Systems with Actuator Saturation via Data-based ADP Algorithm , 2013 .

[13]  Shuying Hao,et al.  Homoclinic orbits in three-dimensional Shilnikov-type chaotic systems , 2013 .

[14]  Huaguang Zhang,et al.  Multi-objective optimal control for a class of unknown nonlinear systems based on finite-approximation-error ADP algorithm , 2013, Neurocomputing.

[15]  Frank L. Lewis,et al.  Multi-agent differential graphical games , 2011, Proceedings of the 30th Chinese Control Conference.

[16]  Huaguang Zhang,et al.  A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration Algorithm , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  T. Chai,et al.  Adaptive synchronization between two different chaotic systems with unknown parameters , 2006 .

[18]  Huaguang Zhang,et al.  Chaotifying Fuzzy Hyperbolic Model Using Adaptive Inverse Optimal Control Approach , 2004, Int. J. Bifurc. Chaos.

[19]  Wei Qinglai,et al.  Approximation-error-ADP-based optimal tracking control for chaotic systems with convergence proof , 2013 .

[20]  浮洁,et al.  Global exponential synchronization between Lü system and Chen system with unknown parameters and channel time-delay , 2011 .

[21]  Yu-Ling Luo,et al.  A self-adapting image encryption algorithm based on spatiotemporal chaos and ergodic matrix , 2013 .

[22]  Ma Tie-Dong,et al.  An improved impulsive control approach to robust lag synchronization between two different chaotic systems , 2010 .

[23]  Jinhu Lu,et al.  Synchronization of an uncertain unified chaotic system via adaptive control , 2002 .

[24]  Giuseppe Grassi,et al.  Continuous-time chaotic systems: Arbitrary full-state hybrid projective synchronization via a scalar signal , 2013 .