Gradient-flow approach for computing a nonlinear-quadratic optimal-output feedback gain matrix

In this paper, an approach is proposed for solving a nonlinear-quadratic optimal regulator problem with linear static state feedback and infinite planning horizon. For such a problem, approximate problems are introduced and considered, which are obtained by combining a finite-horizon problem with an infinite-horizon linear problem in a certain way. A gradient-flow based algorithm is derived for these approximate problems. It is shown that an optimal solution to the original problem can be found as the limit of a sequence of solutions to the approximate problems. Several important properties are obtained. For illustration, two numerical examples are presented.

[1]  Kok Lay Teo,et al.  A Unified Computational Approach to Optimal Control Problems , 1991 .

[2]  A Miele,et al.  Primal-dual properties of sequential gradient-restoration algorithms for optimal control problems, Part 1: basic problem , 1986 .

[3]  K. Teo,et al.  Nonlinear optimal control problems with continuous state inequality constraints , 1989 .

[4]  A. Miele,et al.  Primal-dual properties of sequential gradient-restoration algorithms for optimal control problems 2. General problem , 1986 .

[5]  N. U. Ahmed,et al.  Elements of Finite-dimensional Systems and Control Theory , 1988 .

[6]  L. Hasdorff.  Gradient Optimization and Nonlinear Control , 1976 .

[7]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[8]  N. Ahmed,et al.  Optimal feedback control of power systems governed by non‐linear dynamics , 1986 .

[9]  H. Sirisena,et al.  Convergence of the control parameterization Ritz method for nonlinear optimal control problems , 1979 .

[10]  A. Miele,et al.  Sequential gradient-restoration algorithm for optimal control problems with nondifferential constraints , 1974 .

[11]  A. Miele,et al.  Sequential gradient-restoration algorithm for optimal control problems with general boundary conditions , 1978 .

[12]  Lamberto Cesari,et al.  Optimization-Theory And Applications , 1983 .

[13]  A constrained optimal control problem , 1984 .

[14]  K. Teo,et al.  A suboptimal feedback stabilizing controller for a class of nonlinear regulator problems , 1993 .

[15]  Kok Lay Teo,et al.  Nonlinear Constrained Optimal control Problems , 1992 .

[16]  Y. Sakawa.  On local convergence of an algorithm for optimal control , 1981 .

[17]  John B. Moore,et al.  A gradient flow approach to computing lq optimal output feedback gains , 1994 .

[18]  Kok Lay Teo,et al.  MISER3: solving optimal control problems—an update , 1991 .

[19]  D. Mayne,et al.  A feasible directions algorithm for optimal control problems with control and terminal inequality constraints , 1977 .

[20]  B. Goh,et al.  Trajectory-following algorithms for min-max optimization problems , 1992 .