Robust M-ary detection filters and smoothers for continuous-time jump Markov systems

In this paper, we consider a dynamic M-ary detection problem when Markov chains are observed through a Wiener process. These systems are fully specified by a candidate set of parameters, whose elements are, a rate matrix for the Markov chain and a parameter for the observation model. Further, we suppose these parameter sets can switch according to the state of an unobserved Markov chain and thereby produce an observation process generated by time varying (jump stochastic) parameter sets. Given such an observation process and a specified collection of models, we estimate the probabilities of each model parameter set explaining the observation. By defining a new augmented state process, then applying the method of reference probability, we compute matrix-valued dynamics, whose solutions estimate joint probabilities for all combinations of candidate model parameter sets and values taken by the indirectly observed state process. These matrix-valued dynamics satisfy a stochastic integral equation with a Wiener process integrator. Using the gauge transformation techniques introduced by Clark and a pointwise matrix product, we compute robust matrix-valued dynamics for the joint probabilities on the augmented state space. In these new dynamics, the observation Wiener process appears as a parameter matrix in a linear ordinary differential equation, rather than an integrator in a stochastic integral equation. It is shown that these robust dynamics, when discretised, enjoy a deterministic upper bound which ensures nonnegative probabilities for any observation sample path. In contrast, no such upper bounds can be computed for Taylor expansion approximations, such as the Euler-Maryauana and Milstein schemes. Finally, by exploiting a duality between causal and anticausal robust detector dynamics, we develop an algorithm to compute smoothed mode probability estimates without stochastic integrations. A computer simulation demonstrating performance is included.

[1]  H. P. Blom.  An efficient filter for abruptly changing systems , 1984, The 23rd IEEE Conference on Decision and Control.

[2]  N. Gordon,et al.  Optimal Estimation and Cramér-Rao Bounds for Partial Non-Gaussian State Space Models , 2001 .

[3]  Robert J. Elliott,et al.  Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[4]  Robert J. Elliott,et al.  A general smoothing equation for Poisson observations , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[5]  W. Wonham.  Some applications of stochastic difierential equations to optimal nonlinear ltering , 1964 .

[6]  W. P. Malcolm,et al.  On the numerical stability of time-discretised state estimation via Clark transformations , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[7]  E. Wong,et al.  Stochastic Processes in Engineering Systems , 1984 .

[8]  W. P Malcolm.  Robust filtering and estimation with Poisson observations , 1999 .

[9]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[10]  Robert J. Elliott,et al.  New finite-dimensional filters and smoothers for noisily observed Markov chains , 1993, IEEE Trans. Inf. Theory.

[11]  Robert J. Elliott,et al.  Reproducing Gaussian densities and linear Gaussian detection , 2000 .

[12]  Vikram Krishnamurthy,et al.  Time discretization of continuous-time filters and smoothers for HMM parameter estimation , 1996, IEEE Trans. Inf. Theory.

[13]  Robert J. Elliott,et al.  Modal estimation in hybrid systems , 2000 .

[14]  J. M. Clark.  The Design of Robust Approximations to the Stochastic Differential Equations of Nonlinear Filtering , 1978 .

[15]  Robert J. Elliott,et al.  Exact adaptive filters for Markov chains observed in Gaussian noise , 1994, Autom..

[16]  R.J. Elliott,et al.  Robust detection filters for jump Markov systems with doubly stochastic Poisson process models , 2002, Final Program and Abstracts on Information, Decision and Control.

[17]  Joseph K. Skwirzynski.  Communication Systems and Random Process Theory , 1978 .

[18]  Robert J. Elliott,et al.  Exact hybrid filters in discrete time , 1996, IEEE Trans. Autom. Control..

[19]  Robert J. Elliott,et al.  Robust smoother dynamics for Poisson processes driven by an Ito/spl circ/diffusion , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).