论文信息 - Iterative algorithms for optimal state estimation of jump Markov linear systems

Iterative algorithms for optimal state estimation of jump Markov linear systems

Jump Markov linear systems (JMLS) are linear systems whose parameters evolve with time according to a finite state Markov chain. We present three original deterministic and stochastic iterative algorithms for optimal state estimation of JMLS whose computational complexity at each iteration is linear in the data length. The first algorithm yields conditional mean estimates. The second algorithm is an algorithm that yields the marginal maximum a posteriori (MMAP) sequence estimate of the finite state Markov chain. The third algorithm is an algorithm that yields the MMAP sequence estimate of the continuous state of the JMLS. Convergence results for these three algorithms are obtained. Computer simulations are carried out to evaluate their performance.

Christophe Andrieu | Arnaud Doucet

[1] Eric Moulines,et al. Simulation-based methods for blind maximum-likelihood filter identification , 1999, Signal Process..

[2] L. Tierney. Markov Chains for Exploring Posterior Distributions , 1994 .

[3] A. Doucet,et al. State estimation of jump Markov linear systems via stochastic sampling algorithms , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[4] Jerry M. Mendel,et al. Maximum-Likelihood Deconvolution , 1989 .

[5] Jitendra Tugnait,et al. Adaptive estimation and identification for discrete systems with Markov jump parameters , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[6] Jun S. Liu,et al. Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[7] R. Kohn,et al. On Gibbs sampling for state space models , 1994 .

[8] Lawrence R. Rabiner,et al. A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9] R. Kohn,et al. Markov chain Monte Carlo in conditionally Gaussian state space models , 1996 .

[10] Yves Goussard,et al. Unsupervised deconvolution of sparse spike trains using stochastic approximation , 1996, IEEE Trans. Signal Process..

[11] Alfred O. Hero,et al. Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..