A Non-autonomous Stochastic Discrete Time System with Uniform Disturbances

The main objective of this article is to present Bayesian optimal control over a class of non-autonomous linear stochastic discrete time systems with disturbances belonging to a family of the one parameter uniform distributions. It is proved that the Bayes control for the Pareto priors is the solution of a linear system of algebraic equations. For the case that this linear system is singular, we apply optimization techniques to gain the Bayesian optimal control. These results are extended to generalized linear stochastic systems of difference equations and provide the Bayesian optimal control for the case where the coefficients of these type of systems are non-square matrices. The paper extends the results of the authors developed for system with disturbances belonging to the exponential family.

[1]  W. Rugh.  Linear System Theory , 1992 .

[2]  H. Kushner.  Introduction to stochastic control , 1971 .

[3]  Günther Sawitzki,et al.  Exact filtering in exponential families: Discrete time , 1981 .

[4]  A. Wald.  Contributions to the Theory of Statistical Estimation and Testing Hypotheses , 1939 .

[5]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[6]  P. Glynn.  Optimization of stochastic systems via simulation , 1989, WSC '89.

[7]  B. Pasik-Duncan,et al.  Adaptive Control of a Partially Observed Discrete Time Markov Process , 1998 .

[8]  K. Szajowski,et al.  Minimax control of a stochastic system with the loss fun ction dependent on parameter of distrubances , 1987 .

[9]  Darius Walczak.  Bayesian Control of a Discrete-Time Linear System with Uniformly Distributed Disturbances , 2016 .

[10]  Leigh Tesfatsion,et al.  A dual approach to Bayesian inference and adaptive control , 1982 .

[11]  David Lindley,et al.  Statistical Decision Functions , 1951, Nature.

[12]  E. Polak,et al.  System Theory , 1963 .

[13]  Kartik B. Ariyur,et al.  Adaptive Systems: History, Techniques, Problems, and Perspectives , 2014, Syst..

[14]  青木 正直.  Optimization of stochastic systems : topics in discrete-time dynamics , 1967 .

[15]  Jerzy Zabczyk,et al.  Stochastic Systems and Optimization , 1989 .

[16]  Doreen Eichel.  Estimation Theory With Applications To Communications And Control , 2016 .

[17]  Tyrone E. Duncan,et al.  Discrete Time Linear Quadratic Control With Arbitrary Correlated Noise , 2013, IEEE Transactions on Automatic Control.

[18]  Ioannis K. Dassios,et al.  Bayesian optimal control for a non-autonomous stochastic discrete time system , 2016, Appl. Math. Comput..

[19]  David Sworder,et al.  Optimal adaptive control systems , 1966 .

[20]  Krzysztof Szajowski,et al.  A minimax control of linear systems , 1989 .

[21]  D. D. Sworder,et al.  Minimax Control of Discrete Time Stochastic Systems , 1964 .