The problem of minimizing the variance of a quadratic performance index, in the presence of control noise whose properties are known a priori, has been studied for linear, constant systems with open-loop control. The expected value of the performance index is constrained to be a positive number, which cannot be less than the optimal mean index when variance is free. Solution is by means of the calculus of variations, which is applied to an equivalent noise-free problem. The necessary (Euler) equations are integro-differential and have a kernel matrix derived from output correlation functions. In general, these equations contain a forcing vector which depends upon the third-moment properties of the noise process. For systems in which the state vector can be chosen as the output, the existence of an inverse for the kernel matrix can be related to the total state controllability of an equivalent linear, noise-free plant which incorporates statistical data from the disturbance process. A maximum estimate for the number of eigenvalues is given, and is refined for the special case of single-input, state-output control. Necessary and sufficient conditions for a unique solution can be found in specific examples.
[1]
E. Kreindler,et al.
On the concepts of controllability and observability of linear systems
,
1964
.
[2]
E. M. Wright,et al.
Adaptive Control Processes: A Guided Tour
,
1961,
The Mathematical Gazette.
[3]
Richard J Orford.
Optimal stochastic control systems
,
1963
.
[4]
H. Kushner.
On the stochastic maximum principle: Fixed time of control
,
1965
.
[5]
L. Shaw,et al.
Optimal control of linear plants with random parameters
,
1964
.
[6]
Norbert Wiener,et al.
Extrapolation, Interpolation, and Smoothing of Stationary Time Series
,
1964
.
[7]
Walerian Kipiniak.
Dynamic Optimization and Control: A Variational Approach
,
1961
.
[8]
S. Dreyfus.
Some Types of Optimal Control of Stochastic Systems
,
1964
.
[9]
Stuart E. Dreyfus,et al.
Applied Dynamic Programming
,
1965
.
[10]
W. Wonham,et al.
Another note on the transformation to canonical (phase-variable) form
,
1964
.
[11]
The necessary and sufficient conditions for the optimal controller to be linear
,
1964
.