Global Sampling for Sequential Filtering over Discrete State Space

In many situations, there is a need to approximate a sequence of probability measures over a growing product of finite spaces. Whereas it is in general possible to determine analytic expressions for these probability measures, the number of computations needed to evaluate these quantities grows exponentially thus precluding real-time implementation. Sequential Monte Carlo techniques (SMC), which consist in approximating the flow of probability measures by the empirical distribution of a finite set of particles, are attractive techniques for addressing this type of problems. In this paper, we present a simple implementation of the sequential importance sampling/resampling (SISR) technique for approximating these distributions; this method relies on the fact that, the space being finite, it is possible to consider every offspring of the trajectory of particles. The procedure is straightforward to implement, and well-suited for practical implementation. A limited Monte Carlo experiment is carried out to support our findings.

[1]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[2]  Rong Chen,et al.  A Theoretical Framework for Sequential Importance Sampling with Resampling , 2001, Sequential Monte Carlo Methods in Practice.

[3]  N. Shephard.  Partial non-Gaussian state space , 1994 .

[4]  Jun S. Liu,et al.  Adaptive joint detection and decoding in flat-fading channels via mixture Kalman filtering , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[5]  Lain L. MacDonald,et al.  Hidden Markov and Other Models for Discrete- valued Time Series , 1997 .

[6]  C. Dou.  Particle Filtering for Demodulation in Fading Channels with Non-Gaussian Additive Noise. , 2001 .

[7]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[8]  Jun S. Liu,et al.  Blind Deconvolution via Sequential Imputations , 1995 .

[9]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[10]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[11]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[12]  Jitendra Tugnait,et al.  Adaptive estimation and identification for discrete systems with Markov jump parameters , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[13]  Hiromitsu Kumamoto,et al.  Random sampling approach to state estimation in switching environments , 1977, Autom..

[14]  Rong Chen,et al.  Delayed-pilot sampling for mixture Kalman filter with application in fading channels , 2002, IEEE Trans. Signal Process..

[15]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[16]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[17]  Rong Chen,et al.  Adaptive joint detection and decoding in flat-fading channels via mixture Kalman filtering , 2000, IEEE Trans. Inf. Theory.

[18]  Arnaud Doucet,et al.  Stochastic sampling algorithms for state estimation of jump Markov linear systems , 2000, IEEE Trans. Autom. Control..

[19]  A. Doucet,et al.  Particle filtering for multiuser detection in fading CDMA channels , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[20]  F. B. Salem,et al.  Réception particulaire pour canaux multi-trajets évanescents en communications radiomobiles , 2002 .

[21]  R. Kohn,et al.  Markov chain Monte Carlo in conditionally Gaussian state space models , 1996 .