Efficient particle filtering for jump Markov systems. Application to time-varying autoregressions

We present an efficient particle filtering method to perform optimal estimation in jump Markov (nonlinear) systems (JMSs). Such processes consist of a mixture of heterogeneous models and possess a natural hierarchical structure. We take advantage of these specificities in order to develop a generic filtering methodology for these models. The method relies on an original and nontrivial combination of techniques that have been presented recently in the filtering literature, namely, the auxiliary particle filter and the unscented transform. This algorithm is applied to the complex problem of time-varying autoregressive estimation with an unknown time-varying model order. More precisely, we develop an attractive and original probabilistic model that relies on a flexible pole representation that easily lends itself to interpretations. We show that this problem can be formulated as a JMS and that the associated filtering problem can be efficiently addressed using the generic methodology developed in this paper. Simulations demonstrate the performance of our method compared to standard particle filtering techniques.

[1]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[2]  Manuel Davy,et al.  Tracking of spectral lines in an ARCAP time-frequency representation , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[3]  N. Ikoma,et al.  Nonstationary spectral peak estimation by Monte Carlo filter , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[4]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[5]  Simon J. Godsill,et al.  Particle methods for Bayesian modeling and enhancement of speech signals , 2002, IEEE Trans. Speech Audio Process..

[6]  Patrick Flandrin,et al.  Time-Frequency/Time-Scale Analysis , 1998 .

[7]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[8]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[9]  G. Huerta,et al.  Time‐varying autoregressions with model order uncertainty , 2002 .

[10]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[11]  Chang‐Jin Kim,et al.  State Space Models with Regime Switching , 1999 .

[12]  G. W. Snedecor Statistical Methods , 1964 .

[13]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[14]  Jeffrey K. Uhlmann,et al.  Reduced sigma point filters for the propagation of means and covariances through nonlinear transformations , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[15]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[16]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[17]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[18]  S. Julier,et al.  A General Method for Approximating Nonlinear Transformations of Probability Distributions , 1996 .

[19]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[20]  Simon J. Julier,et al.  The scaled unscented transformation , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[21]  A. Doucet,et al.  Sequential MCMC for Bayesian model selection , 1999, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. SPW-HOS '99.