Locally Adaptive Bayesian Multivariate Time Series

In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If such locally adaptive smoothness is not accounted for, one can obtain misleading inferences and predictions, with over-smoothing across erratic time intervals and under-smoothing across times exhibiting slow variation. This can lead to miscalibration of predictive intervals, which can be substantially too narrow or wide depending on the time. We propose a continuous multivariate stochastic process for time series having locally varying smoothness in both the mean and covariance matrix. This process is constructed utilizing latent dictionary functions in time, which are given nested Gaussian process priors and linearly related to the observed data through a sparse mapping. Using a differential equation representation, we bypass usual computational bottlenecks in obtaining MCMC and online algorithms for approximate Bayesian inference. The performance is assessed in simulations and illustrated in a financial application.

[1]  Chin-Tsang Chiang,et al.  Asymptotic Confidence Regions for Kernel Smoothing of a Varying-Coefficient Model With Longitudinal Data , 1998 .

[2]  Patrick Burns Multivariate GARCH with Only Univariate Estimation , 2005 .

[3]  J. Wooldridge,et al.  A Capital Asset Pricing Model with Time-Varying Covariances , 1988, Journal of Political Economy.

[4]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[5]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[6]  R. Engle,et al.  Multivariate Simultaneous Generalized ARCH , 1995, Econometric Theory.

[7]  Ruey S. Tsay,et al.  Analysis of Financial Time Series , 2005 .

[8]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[9]  Siem Jan Koopman,et al.  Time Series Analysis by State Space Methods , 2001 .

[10]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[11]  Andrew Gordon Wilson,et al.  Generalised Wishart Processes , 2010, UAI.

[12]  Siem Jan Koopman,et al.  A simple and efficient simulation smoother for state space time series analysis , 2002 .

[13]  Marie-France Bru,et al.  Wishart processes , 1991 .

[14]  Jianqing Fan,et al.  Data‐Driven Bandwidth Selection in Local Polynomial Fitting: Variable Bandwidth and Spatial Adaptation , 1995 .

[15]  Roy van der Weide,et al.  GO-GARCH: a multivariate generalized orthogonal GARCH model , 2002 .

[16]  M. West,et al.  Dynamic Factor Volatility Modeling: A Bayesian Latent Threshold Approach , 2013 .

[17]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[18]  Bin Zhu,et al.  Locally Adaptive Bayes Nonparametric Regression via Nested Gaussian Processes , 2012, Journal of the American Statistical Association.

[19]  R. Kohn,et al.  Nonparametric regression using Bayesian variable selection , 1996 .

[20]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[21]  R. Engle Dynamic Conditional Correlation , 2002 .

[22]  M. Clyde,et al.  Stochastic expansions using continuous dictionaries: Lévy adaptive regression kernels , 2011, 1112.3149.

[23]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[24]  David B. Dunson,et al.  Bayesian nonparametric covariance regression , 2011, J. Mach. Learn. Res..

[25]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[26]  Jianhua Z. Huang,et al.  Varying‐coefficient models and basis function approximations for the analysis of repeated measurements , 2002 .