A numerical filtering method for linear state‐space models with Markov switching

A class of discrete‐time random processes arising in engineering and econometrics applications consists of a linear state‐space model whose parameters are modulated by the state of a finite‐state Markov chain. Typical filtering approaches are collapsing methods, which approximate filtered distributions by mixtures of Gaussians, each Gaussian corresponding to one possibility of the recent history of the Markov chain, and particle methods. This article presents an alternative approach to filtering these processes based on keeping track of the values of the underlying filtered density and its characteristic function on grids. We prove that it has favorable convergence properties under certain assumptions. On the other hand, as a grid method, it suffers from the curse of dimensionality, and so is only suitable for low‐dimensional systems. We compare our method to collapsing filters and a particle filter with examples, and find that it can outperform them on 1‐ and 2‐dimensional problems, but loses its speed advantage on 3‐dimensional systems. Meanwhile, our method has a proven theoretical convergence rate that is probably not achieved by collapsing and particle methods.

[1]  Hans Driessen,et al.  A multiple model multiple hypothesis filter for Markovian switching systems , 2005, Autom..

[2]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[3]  Y. Boers,et al.  Efficient particle filter for jump Markov nonlinear systems , 2005 .

[4]  D. Carlson,et al.  On real eigenvalues of complex matrices , 1965 .

[5]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[6]  Patrick Lam,et al.  The Hamilton model with a general autoregressive component , 1990 .

[7]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[8]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[9]  Jonathan H. Manton,et al.  Numerical filtering of linear state-space models with Markov switching , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  R. Bucy,et al.  Digital synthesis of non-linear filters , 1971 .

[11]  Christophe Andrieu,et al.  Efficient particle filtering for jump Markov systems. Application to time-varying autoregressions , 2003, IEEE Trans. Signal Process..

[12]  George W. Irwin,et al.  Multiple model bootstrap filter for maneuvering target tracking , 2000, IEEE Trans. Aerosp. Electron. Syst..

[13]  L. Rabiner,et al.  The chirp z-transform algorithm , 1969 .

[14]  Robert J. Elliott,et al.  Discrete time filters for doubly stochastic poisson processes and other exponential noise models , 1999 .

[15]  Wayne M. Lawton Multidimensional chirp algorithms for computing Fourier transforms , 1992, IEEE Trans. Image Process..

[16]  Jitendra K. Tugnait,et al.  Detection and estimation for abruptly changing systems , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[17]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[18]  Gustaf Hendeby,et al.  Rao-Blackwellized particle filter for Markov modulated nonlinear dynamic systems , 2014, 2014 IEEE Workshop on Statistical Signal Processing (SSP).

[19]  Sebastien Allam,et al.  Finite fast fourier transform filter for discrete linear systems with Markov jump parameters , 1999, 1999 European Control Conference (ECC).

[20]  Torsten Söderström,et al.  Anticipative grid design in point-mass approach to nonlinear state estimation , 2002, IEEE Trans. Autom. Control..

[21]  Torsten Söderström,et al.  Advanced point-mass method for nonlinear state estimation , 2006, Autom..