Centralized and decentralized solutions of the linear-exponential-Gaussian problem

A particular class of stochastic control problems constrained to different information patterns is considered. This class consists of minimizing the expectation of an exponential cost criterion with quadratic argument subject to a discrete-time Gauss-Markov dynamic system, i.e., the linear-exponential-Gaussian (LEG) control problem. Besides the one-step delayed information pattern previously considered, the classical and the one-step delayed information-sharing (OSDIS) patterns are assumed. After determining the centralized controller based upon the classical information pattern, the optimal decentralized controller based upon the OSDIS pattern and the solution to a static team problem is found to be affine. A unifying approach to determine controllers based upon these three information patterns is obtained by noting that the value of a quadratic exponent of an exponential function is independent of the information structure. Both necessary and sufficient conditions for the controllers to be minimizing are obtained regardless of the exponential form. The negative exponential form is included which is unimodal but not convex. >

[1]  R. Radner,et al.  Team Decision Problems , 1962 .

[2]  H. Witsenhausen.  A Counterexample in Stochastic Optimum Control , 1968 .

[3]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[4]  M. Athans,et al.  Solution of some nonclassical LQG stochastic decision problems , 1974 .

[5]  D. Jacobson,et al.  Optimization of stochastic linear systems with additive measurement and process noise using exponential performance criteria , 1974 .

[6]  Steven Marcus,et al.  A decentralized team decision problem with an exponential cost criterion , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[7]  J. Speyer,et al.  The dynamic linear exponential Gaussian team problem , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[8]  J. H. van Schuppen,et al.  On the optimal control of stochastic systems with an exponential-of-integral performance index , 1981 .

[9]  P. Whittle.  Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[10]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[11]  S. Marcus,et al.  Static team problems--Part I: Sufficient conditions and the exponential cost criterion , 1982 .

[12]  A. Bensoussan,et al.  Optimal control of partially observable stochastic systems with an exponential-of-integral performance index , 1985 .

[13]  J. L. Speyer,et al.  Centralized and decentralized stochastic control problems with an exponential cost criterion , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[14]  K. Glover,et al.  State-space formulae for all stabilizing controllers that satisfy and H ∞ norm bound and relations to risk sensitivity , 1988 .

[15]  P. Khargonekar,et al.  State-space solutions to standard H/sub 2/ and H/sub infinity / control problems , 1989 .

[16]  T. Basar,et al.  Design of minimax controllers for linear systems with nonzero initial conditions and under specified information structures , 1990, 29th IEEE Conference on Decision and Control.

[17]  J. Speyer,et al.  A game-theoretic approach to a finite-time disturbance attenuation problem , 1991 .