Solution of the stochastic optimal control problem in the s-domain for systems with time delay

The design of linear stochastic optimal tracking and regulating systems is considered for systems with time delay. A transfer-function solution for the optimal closed-loop controller is obtained in the s-domain. This solution can be realised physically, but involves the complex-domain delay operator. The state-space realisation of the controller is also obtained. The optimal controllers for both tracking and regulating systems include a Kalman predictor and state estimate feedback. This shows that a form of the separation principle holds for this class of problem. The design technique applies to multivariable systems which may be unstable, nonminimum phase and non-square. The process and measuring system noise terms may be correlated and be coloured or white. The linear quadratic performance criterion to be minimised includes a crossproduct weighting term. The solution to the usual stochastic regulator problem is obtained first and this result is then used to obtain the solution to the optimal tracking problem. Time delays in the control and in the measurement system are shown to have the same effect on the controller design, provided that the performance criterion is chosen appropriately. An expression for the minimum value of the performance criterion, that shows how the minimum cost is increased by the presence of the time delays, is obtained.

[1]  David L. Kleinman,et al.  Optimal control of linear systems with time-delay and observation noise , 1969 .

[2]  Michael G. Strintzis,et al.  A solution to the matrix factorization problem , 1972, IEEE Trans. Inf. Theory.

[3]  A. Lindquist.  On Feedback Control of Linear Stochastic Systems , 1973 .

[4]  U. Shaked.  A general transfer function approach to linear stationary filtering and steady-state optimal control problems , 1976 .

[5]  A. Fuller.  Optimal nonlinear control of systems with pure delay , 1968 .

[6]  E. Tse.  On the optimal control of stochastic linear systems , 1971 .

[7]  M. J. Grimble.  Solution of the Kalman filtering problem for stationary noise and finite data records , 1979 .

[8]  O. J. M. Smith,et al.  A controller to overcome dead time , 1959 .

[9]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[10]  M. J. Grimble,et al.  Optimal control of linear systems with crossproduct weighting , 1979 .

[11]  Karl Johan Åström,et al.  Frequency domain properties of Otto Smith regulators , 1977 .

[12]  J. E. Marshall,et al.  Application of the sensitivity points method to a linear predictor control system , 1975 .

[13]  M. J. Grimble,et al.  Definition of a Complex Domain Adjoint for Use in Optimal Control Problems , 1978 .

[14]  Uri Shaked,et al.  A general transfer-function approach to the steady-state linear quadratic Gaussian stochastic control problem , 1976 .

[15]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[16]  D. H. Mee.  An extension of predictor control for systems with control time-delays , 1973 .

[17]  R. E. Schmotzer,et al.  A simple proof of the separation theorem for linear stochastic systems with time delays , 1978 .

[18]  Mark H. A. Davis.  Linear estimation and stochastic control , 1977 .

[19]  M. Grimble.  The design of finite-time optimal multivariable systems , 1978 .

[20]  M. Grimble.  S-domain solution for the fixed end-point optimal-control problem , 1977 .