On the optimal control of stochastic systems with an exponential-of-integral performance index

Abstract In this paper a theory of optimal control is developed for stochastic systems whose performance is measured by the exponential of an integral form. Such a formulation of the cost function is shown to be not only general and useful but also analytically tractable. Starting with very general classes of stochastic systems, optimality conditions are obtained which exploit the multiplicative decomposability of the exponential-of-integral form. Specializing to partially observed systems of stochastic differential equations with Brownian Motion disturbances, optimality conditions are obtained which parallel those for systems with integral costs. Also treated are the special cases of linear systems with exponential of quadratic costs for which explicit optimal controls are obtainable. In addition, several general results of independent interest are obtained, which concern optimality of stochastic systems.

[1]  P. Meyer Probability and potentials , 1966 .

[2]  P. Varaiya,et al.  On the Solutions of a Stochastic Control System. II , 1971 .

[3]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[4]  I. V. Girsanov On Transforming a Certain Class of Stochastic Processes by Absolutely Continuous Substitution of Measures , 1960 .

[5]  R. Elliott The Existence of Value in Stochastic Differential Games , 1976 .

[6]  V. Benes Existence of Optimal Stochastic Control Laws , 1971 .

[7]  R. Rishel Necessary and Sufficient Dynamic Programming Conditions for Continuous Time Stochastic Optimal Control , 1970 .

[8]  Robert J. Elliott The Optimal Control of a Stochastic System , 1977 .

[9]  Jason Speyer An adaptive terminal guidance scheme based on an exponential cost criterion with application to homing missile guidance , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[10]  P. Varaiya,et al.  Dynamic Programming Conditions for Partially Observable Stochastic Systems , 1973 .

[11]  P. Varaiya N-player stochastic differential games , 1976 .

[12]  R. Bellman Dynamic programming. , 1957, Science.

[13]  A. T. Bharucha-Reid,et al.  Probabilistic methods in applied mathematics , 1968 .

[14]  Charlotte Striebel,et al.  Optimal Control of Discrete Time Stochastic Systems , 1975 .

[15]  H. Kushner On the Existence of Optimal Stochastic Controls , 1965 .

[16]  D. Jacobson,et al.  Optimization of stochastic linear systems with additive measurement and process noise using exponential performance criteria , 1974 .

[17]  W. Wonham Random differential equations in control theory , 1970 .

[18]  P. Varaiya,et al.  Optimal Control of Jump Processes , 1977 .

[19]  W. Fleming Optimal Continuous-Parameter Stochastic Control , 1969 .