Posterior Mode Estimation by Extended Kalman Filtering for Multivariate Dynamic Generalized Linear Models

Abstract A family of multivariate dynamic generalized linear models is introduced as a general framework for the analysis of time series with observations from the exponential family. Besides common conditionally Gaussian models, this article deals with univariate models for counted and binary data and, as the most interesting multivariate case, models for nonstationary multicategorical time series. For univariate responses, a related yet different class of models has been introduced in a Bayesian setting by West, Harrison and Migon. Assuming conjugate prior-posterior distributions for the natural parameter of the exponential family, they derive an approximate filter for estimation of time-varying states or parameters. However, their method raises some problems; in particular, in extending it to the multivariate case. A different approach to filtering and smoothing is chosen in this article. To avoid a full Bayesian analysis based on numerical integration, which becomes computationally critical for higher...

[1]  J. Hartigan.  Linear Bayesian Methods , 1969 .

[2]  Andrew P. Sage,et al.  Estimation theory with applications to communications and control , 1979 .

[3]  Robin Thompson,et al.  Composite Link Functions in Generalized Linear Models , 1981 .

[4]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Marc Nerlove,et al.  Expectations, Plans, and Realizations in Theory and Practice , 1983 .

[6]  R. Engle,et al.  Alternative Algorithms for the Estimation of Dynamic Factor , 1983 .

[7]  J. Ware,et al.  Random-effects models for serial observations with binary response. , 1984, Biometrics.

[8]  M. West,et al.  Dynamic Generalized Linear Models and Bayesian Forecasting , 1985 .

[9]  G. Y. Wong,et al.  The Hierarchical Logistic Regression Model for Multilevel Analysis , 1985 .

[10]  L. Fahrmeir,et al.  Correction: Consistency and Asymptotic Normality of the Maximum Likelihood Estimator in Generalized Linear Models , 1985 .

[11]  H. Kaufmann,et al.  Regression Models for Nonstationary Categorical Time Series: Asymptotic Estimation Theory , 1987 .

[12]  G. Kitagawa.  Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[13]  Ludwig Fahrmeir,et al.  REGRESSION MODELS FOR NON‐STATIONARY CATEGORICAL TIME SERIES , 1987 .

[14]  Adrian E. Raftery,et al.  Comment: Robustness, Computation, and Non-Euclidean Models , 1987 .

[15]  Ben Zehnwirth,et al.  A Generalization of the Kalman Filter for Models with State-Dependent Observation Variance , 1988 .

[16]  Andrew Harvey,et al.  Time Series Models for Count or Qualitative Observations , 1989 .

[17]  L. Fahrmeir,et al.  On kalman filtering, posterior mode estimation and fisher scoring in dynamic exponential family regression , 1991 .