An Iterative Method for Optimal Control of Nonlinear Quadratic Tracking Problems

In this paper, we investigate an iterative method for computing optimal controls for general affine nonlinear quadratic tracking problems. The control law is computed iteratively by solving a sequence of linear quadratic tracking problems and, in particular, it consists of solving a set of coupled differential equations derived from the Hamilton-Jacobi-Bellman equation. The convergence of the iterative scheme is shown by constructing a contraction mapping and using the fixed-point theorem. The versatility and effectiveness of the proposed method is demonstrated in numerical simulations of three structurally different nonlinear systems.

[1]  Mingjun Zhang,et al.  Hybrid control of the Pendubot , 2002 .

[2]  Lino Guzzella,et al.  Implementation of Dynamic Programming for $n$-Dimensional Optimal Control Problems With Final State Constraints , 2013, IEEE Transactions on Control Systems Technology.

[3]  Bassam Bamieh,et al.  Function Space Approach for Gradient Descent in Optimal Control , 2018, 2018 Annual American Control Conference (ACC).

[4]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[5]  H. Schättler,et al.  Geometric Optimal Control: Theory, Methods and Examples , 2012 .

[6]  Jr-Shin Li,et al.  Fixed-endpoint minimum-energy control of bilinear ensemble systems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[7]  W. A. Cebuhar,et al.  Approximation procedures for the optimal control of bilinear and nonlinear systems , 1984 .

[8]  Justin Ruths,et al.  A multidimensional pseudospectral method for optimal control of quantum ensembles. , 2011, The Journal of chemical physics.

[9]  Daizhan Cheng,et al.  Output regulation for nonlinear systems: some recent theoretical and experimental results , 2005, IEEE Transactions on Control Systems Technology.

[10]  B. Tibken,et al.  An iterative method for the finite-time bilinear-quadratic control problem , 1988 .

[11]  Jr-Shin Li,et al.  Control and Synchronization of Neuron Ensembles , 2011, IEEE Transactions on Automatic Control.

[12]  Lino Guzzella,et al.  On Implementation of Dynamic Programming for Optimal Control Problems with Final State Constraints , 2010 .

[13]  L. Collatz,et al.  Differential equations: An introduction with applications , 1986 .

[14]  Jr-Shin Li,et al.  An iterative method for computing optimal controls for bilinear quadratic tracking problems , 2016, 2016 American Control Conference (ACC).

[15]  Shen Zeng.  Iterative optimal control syntheses illustrated on the Brockett integrator , 2019 .

[16]  Jr-Shin Li,et al.  Optimal pulse design in quantum control: A unified computational method , 2011, Proceedings of the National Academy of Sciences.

[17]  Anil V. Rao,et al.  ( Preprint ) AAS 09-334 A SURVEY OF NUMERICAL METHODS FOR OPTIMAL CONTROL , 2009 .

[18]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.