Constrained optimal control of affine nonlinear discrete-time systems using GHJB method

The infinite-horizon optimal control problem of nonlinear discrete-time systems with actuator saturation is considered in this paper. In order to deal with actuator saturation, a novel nonquadratic functional is introduced, and the constrained Generalized Hamilton-Jacobi-Bellman (GHJB) equation and Hamilton-Jacobi-Bellman (HJB) equation for nonlinear discrete-time systems are derived in terms of non-quadratic functionals. The optimal saturated controller is obtained by a novel iterative algorithm based on the constrained GHJB equation, and a convergence proof is presented, where a neural network is used to approximate the value function. Finally, a nearly optimal saturated controller is obtained. The effectiveness of this algorithm is demonstrated by a numerical example.

[1]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[2]  Zheng Chen,et al.  Neural Network -based Nearly Optimal Hamilton-Jacobi-Bellman Solution for Affine Nonlinear Discrete-Time Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[3]  Dimitri P. Bertsekas,et al.  Neuro-Dynamic Programming , 2009, Encyclopedia of Optimization.

[4]  George N. Saridis,et al.  An Approximation Theory of Optimal Control for Trainable Manipulators , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Frank L. Lewis,et al.  A Neural Network Solution for Fixed-Final Time Optimal Control of Nonlinear Systems , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[6]  Victor M. Becerra,et al.  Optimal control , 2008, Scholarpedia.

[7]  Andrew R. Teel,et al.  Control of linear systems with saturating actuators , 1996 .

[8]  D. Kleinman.  On an iterative technique for Riccati equation computations , 1968 .

[9]  P. K. Jain,et al.  Lebesgue measure and integration , 1986 .

[10]  George G. Lendaris,et al.  Adaptive dynamic programming , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[11]  S. Lyshevski.  Optimal control of nonlinear continuous-time systems: design of bounded controllers via generalized nonquadratic functionals , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[12]  Frank L. Lewis,et al.  Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach , 2005, Autom..

[13]  Eduardo Sontag,et al.  A general result on the stabilization of linear systems using bounded controls , 1994, IEEE Trans. Autom. Control..

[14]  Frank L. Lewis,et al.  Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Frank L. Lewis,et al.  Fixed-Final Time Constrained Optimal Control of Nonlinear Systems Using Neural Network HJB Approach , 2006, CDC.

[16]  D. Bernstein.  Optimal nonlinear, but continuous, feedback control of systems with saturating actuators , 1995 .