Risk-sensitive filtering and smoothing via reference probability methods

We address the risk-sensitive filtering problem which is minimizing the expectation of the exponential of the squared estimation error multiplied by a risk-sensitive parameter. Such filtering can be more robust to plant and noise uncertainty than minimum error variance filtering. Although optimizing a differently formulated performance index to that of the so-called H/sub /spl infin// filtering, risk-sensitive filtering leads to a worst case deterministic noise estimation problem given from the differential game associated with H/sub /spl infin// filtering. We consider a class of discrete-time stochastic nonlinear state-space models. We present linear recursions in the information state and the result for the filtered estimate that minimizes the risk-sensitive cost index. We also present fixed-interval smoothing results for each of these signal models. In addition, a brief discussion is included on relations of the risk-sensitive estimation problem to minimum variance estimation and a worst case estimation problem in a deterministic noise scenario related to minimax dynamic games. The technique used in this paper is the so-called reference probability method which defines a new probability measure where the observations are independent and translates the problem to the new measure. The optimization problem is solved using simple estimation theory in the new measure, and the results are interpreted as solutions in the original measure.

[1]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[2]  Adrian Segall,et al.  Recursive estimation from discrete-time point processes , 1976, IEEE Trans. Inf. Theory.

[3]  P. Whittle Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[4]  Sanjoy K. Mitter,et al.  Nonlinear Filtering and Stochastic Control , 1983 .

[5]  A. Bensoussan,et al.  Optimal control of partially observable stochastic systems with an exponential-of-integral performance index , 1985 .

[6]  Brian D. O. Anderson,et al.  Smoothing algorithms for nonlinear finite-dimensional systems , 1983 .

[7]  O. Zeitouni,et al.  On the Reference Probability Approach to the Equations of Non-Linear Filtering , 1986 .

[8]  J. Levine,et al.  Exact finite dimensional filters for a class of nonlinear discrete-time systems † , 1986 .

[9]  J. Speyer,et al.  Optimal stochastic estimation with exponential cost criteria , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[10]  Robert J. Elliott A general recursive discrete-time filter , 1993 .

[11]  M. James,et al.  Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems , 1994, IEEE Trans. Autom. Control..

[12]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[13]  John B. Moore,et al.  Risk-sensitive filtering and smoothing for hidden Markov models , 1995 .

[14]  S. Dey,et al.  Risk-sensitive filtering and smoothing via reference probability methods , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[15]  John S. Baras,et al.  Finite-dimensional optimal controllers for nonlinear plants , 1995 .

[16]  Robert J. Elliott,et al.  Risk Sensitive Generalization of Minimum Variance Estimation and Control , 1995 .

[17]  J.B. Moore,et al.  Geometric convergence of filters for hidden Markov models , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[18]  John B. Moore,et al.  On Finite-dimensional Risk-sensitive Estimation , 1996, Fourth International Symposium on Signal Processing and Its Applications.

[19]  Robert J. Elliott,et al.  Risk-sensitive generalizations of minimum variance estimation and control , 1997 .