Risk-sensitive generalizations of minimum variance estimation and control

In this paper, the risk-sensitive nonlinear stochastic filtering problem is addressed in both continuous and discrete-time for quite general finite-dimensional signal models, including also discrete state hidden Markov models (HMMs). The risk sensitive estimates are expressed in terms of the so-called information state of the model given by the Zakai equation which is linear. In the linear Gaussian signal model case, the risk-sensitive (minimum exponential variance) estimates are identical to the minimum variance Kalman filter state estimates, and are thus given by a finite dimensional estimator. The estimates are also finite dimensional for discrete-state HMMs, but otherwise, in general, are infinite dimensional. In the small noise limit, these estimates (including the minimum variance estimates) have an interpretation in terms of a worst case deterministic noise estimation problem given from a differential game. The related control task, that is the risk-sensitive generalization of minimum-variance control is studied for the discrete-time models. This is motivated by the need for robustness in the widely used (risk neutral) minimum variance control, including adaptive control, of systems which are minimum phase, that is having stable inverses.

[1]  A. Bensoussan,et al.  Optimal control of partially observable stochastic systems with an exponential-of-integral performance index , 1985 .

[2]  M. James,et al.  Output feedback risk-sensitive control and differential games for continuous-time nonlinear systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[3]  D. Sworder Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[4]  John B. Moore,et al.  Risk-sensitive filtering and smoothing via reference probability methods , 1997, IEEE Trans. Autom. Control..

[5]  Robert J. Elliott,et al.  Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[6]  P. Whittle Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[7]  J. Speyer,et al.  Optimal stochastic estimation with exponential cost criteria , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[8]  S. Dey,et al.  Risk-sensitive filtering and smoothing via reference probability methods , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[9]  K. Glover,et al.  State-space formulae for all stabilizing controllers that satisfy and H ∞ norm bound and relations to risk sensitivity , 1988 .

[10]  S.,et al.  Risk-Sensitive Control and Dynamic Games for Partially Observed Discrete-Time Nonlinear Systems , 1994 .

[11]  Matthew,et al.  An Information-State Approach to Risk Sensitive Tracking Problems , 1994 .

[12]  John B. Moore,et al.  Risk-sensitive filtering and smoothing for hidden Markov models , 1995 .