On Gibbs sampling for state space models

SUMMARY We show how to use the Gibbs sampler to carry out Bayesian inference on a linear state space model with errors that are a mixture of normals and coefficients that can switch over time. Our approach simultaneously generates the whole of the state vector given the mixture and coefficient indicator variables and simultaneously generates all the indicator variables conditional on the state vectors. The states are generated efficiently using the Kalman filter. We illustrate our approach by several examples and empirically compare its performance to another Gibbs sampler where the states are generated one at a time. The empirical results suggest that our approach is both practical to implement and dominates the Gibbs sampler that generates the states one at a time.

[1]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[2]  G. C. Tiao,et al.  A bayesian approach to some outlier problems. , 1968, Biometrika.

[3]  P. A. P. Moran,et al.  The estimation of standard errors in Monte Carlo simulation experiments , 1975 .

[4]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  G. Wahba.  Bayesian "Confidence Intervals" for the Cross-validated Smoothing Spline , 1983 .

[6]  G. Kitagawa,et al.  A Smoothness Priors–State Space Modeling of Time Series with Trend and Seasonality , 1984 .

[7]  R. Kohn,et al.  Estimation, Filtering, and Smoothing in State Space Models with Incompletely Specified Initial Conditions , 1985 .

[8]  R. Kohn,et al.  A new algorithm for spline smoothing based on smoothing a stochastic process , 1987 .

[9]  Richard J. Meinhold,et al.  Robustification of Kalman Filter Models , 1989 .

[10]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[11]  Robert Kohn,et al.  FILTERING AND SMOOTHING IN STATE SPACE MODELS WITH PARTIALLY DIFFUSE INITIAL CONDITIONS , 1990 .

[12]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[13]  K. Gordon,et al.  Modeling and Monitoring Biomedical Time Series , 1990 .

[14]  R. Shumway,et al.  Dynamic linear models with switching , 1991 .

[15]  Nicholas G. Polson,et al.  A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling , 1992 .

[16]  Jun S. Liu,et al.  Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[17]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .