Dual adaptive controls for linear system with unknown constant parameters

The semi-explicit solution of a dual adaptive control problem driven by a linear system with unknown constant parameters is given. The controls are tested in the simulation experiment and analysed in contrast to the certainty equivalent controls and cautious controls. The probing feature of dual controls is discussed and accomplished with data. The probing signal generation mechanism is investigated.

[1]  N. Krylov.  On the rate of convergence of finite-difference approximations for Bellmans equations with variable coefficients , 2000 .

[2]  Y. Bar-Shalom,et al.  Wide-sense adaptive dual control for nonlinear stochastic systems , 1973 .

[3]  M. Aschwanden.  Statistics of Random Processes , 2021, Biomedical Measurement Systems and Data Science.

[4]  Alain Bensoussan,et al.  Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions , 1983 .

[5]  Robert Tenno.  Dual adaptive controls for linear system with unknown drifting parameters , 2009, 2009 European Control Conference (ECC).

[6]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[7]  Fucai Qian,et al.  Optimal nominal dual control for discrete-time linear-quadratic Gaussian problems with unknown parameters , 2008, Autom..

[8]  Heinz Unbehauen,et al.  Adaptive Dual Control: Theory and Applications , 2004 .

[9]  K. Åström,et al.  Problems of Identification and Control , 1971 .

[10]  W. Fleming,et al.  Optimal Control for Partially Observed Diffusions , 1982 .

[11]  V. Borkar.  Controlled diffusion processes , 2005, math/0511077.

[12]  Tamer Basar,et al.  Dual Control Theory , 2001 .

[13]  E. Tse,et al.  Actively adaptive control for nonlinear stochastic systems , 1976, Proceedings of the IEEE.

[14]  Yaakov Bar-Shalom,et al.  An actively adaptive control for linear systems with random parameters via the dual control approach , 1972, CDC 1972.

[15]  H. Pragarauskas.  Bellman's equation in a lattice of measures for general controlled stochastic processes. I , 1981 .

[16]  An exact formula for a linear quadratic adaptive stochastic optimal control law , 1984, The 23rd IEEE Conference on Decision and Control.

[17]  N. V. Krylov.  The Rate of Convergence of Finite-Difference Approximations for Bellman Equations with Lipschitz Coefficients , 2004 .