Model Selection and Adaptive Markov Chain Monte Carlo for Bayesian Cointegrated VAR Model

This paper develops a matrix-variate adaptive Markov chain Monte Carlo (MCMC) methodology for Bayesian Cointegrated Vector Auto Regressions (CVAR). We replace the popular approach to sampling Bayesian CVAR models, involving griddy Gibbs, with an automated efficient alternative, based on the Adaptive Metropolis algorithm of Roberts and Rosenthal, (2009). Developing the adaptive MCMC framework for Bayesian CVAR models allows for efficient estimation of posterior parameters in significantly higher dimensional CVAR series than previously possible with existing griddy Gibbs samplers. For a n-dimensional CVAR series, the matrix-variate posterior is in dimension $3n^2 + n$, with significant correlation present between the blocks of matrix random variables. We also treat the rank of the CVAR model as a random variable and perform joint inference on the rank and model parameters. This is achieved with a Bayesian posterior distribution defined over both the rank and the CVAR model parameters, and inference is made via Bayes Factor analysis of rank. Practically the adaptive sampler also aids in the development of automated Bayesian cointegration models for algorithmic trading systems considering instruments made up of several assets, such as currency baskets. Previously the literature on financial applications of CVAR trading models typically only considers pairs trading (n=2) due to the computational cost of the griddy Gibbs. We are able to extend under our adaptive framework to $n >> 2$ and demonstrate an example with n = 10, resulting in a posterior distribution with parameters up to dimension 310. By also considering the rank as a random quantity we can ensure our resulting trading models are able to adjust to potentially time varying market conditions in a coherent statistical framework.

[1]  Mattias Villani,et al.  BAYESIAN REFERENCE ANALYSIS OF COINTEGRATION , 2005, Econometric Theory.

[2]  A. Gelman,et al.  Weak convergence and optimal scaling of random walk Metropolis algorithms , 1997 .

[3]  Pierre Giot,et al.  A Gibbs sampling approach to cointegration , 1998 .

[4]  Gareth O. Roberts,et al.  Examples of Adaptive MCMC , 2009 .

[5]  Herman K. van Dijk,et al.  Bayesian Approaches to Cointegration , 2006 .

[6]  J. Rosenthal,et al.  Optimal scaling for various Metropolis-Hastings algorithms , 2001 .

[7]  C. Granger.  Some properties of time series data and their use in econometric model specification , 1981 .

[8]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[9]  Brett Inder,et al.  Bayesian analysis of the error correction model , 2004 .

[10]  Katsuhiro Sugita,et al.  TESTING FOR COINTEGRATION RANK USING BAYES FACTORS , 2002 .

[11]  J. Geweke,et al.  Bayesian reduced rank regression in econometrics , 1996 .

[12]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[13]  Christophe Andrieu,et al.  On the efficiency of adaptive MCMC algorithms , 2006, valuetools '06.

[14]  Heikki Haario,et al.  Componentwise adaptation for high dimensional MCMC , 2005, Comput. Stat..

[15]  L. Wasserman,et al.  Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio , 1995 .

[16]  Gareth W. Peters,et al.  Model Selection and Adaptive Markov Chain Monte Carlo for Bayesian Cointegrated VAR Model , 2009 .

[17]  C. Granger,et al.  Co-integration and error correction: representation, estimation and testing , 1987 .

[18]  Luc Bauwens,et al.  Identification restrictions and posterior densities in cointegrated Gaussian VAR system , 1996 .

[19]  P. Giordani,et al.  Adaptive Independent Metropolis–Hastings by Fast Estimation of Mixtures of Normals , 2008, 0801.1864.

[20]  Hans-Martin Krolzig,et al.  Statistical Analysis of Cointegrated VAR Processes with Markovian Regime Shifts , 1999 .

[21]  Richard Paap,et al.  Priors, posteriors and Bayes factors for a Bayesian analysis of cointegration , 1998 .

[22]  Katsuhiro Sugita.  A Monte Carlo comparison of Bayesian testing for cointegration rank , 2009 .

[23]  J. Rosenthal,et al.  On adaptive Markov chain Monte Carlo algorithms , 2005 .

[24]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[25]  Jeffrey S. Rosenthal,et al.  Optimal Proposal Distributions and Adaptive MCMC , 2011 .

[26]  Herman K. van Dijk,et al.  Bayesian model averaging in vector autoregressive processes with an investigation of stability of the US great ratios and risk of a liquidity trap in the USA, UK and Japan , 2007 .

[27]  Herman K. van Dijk,et al.  Bayesian Model Selection with an Uninformative Prior , 2003 .

[28]  G. Reinsel,et al.  Multivariate Reduced-Rank Regression: Theory and Applications , 1998 .

[29]  C. Andrieu,et al.  On the ergodicity properties of some adaptive MCMC algorithms , 2006, math/0610317.

[30]  Ralph S. Silva,et al.  Particle filtering within adaptive Metropolis-Hastings sampling , 2009, 0911.0230.

[31]  Herman K. van Dijk,et al.  On the Shape of the Likelihood/Posterior in Cointegration Models , 1994, Econometric Theory.

[32]  Gareth W. Peters,et al.  Automating and evaluating reversible jump MCMC proposal distributions , 2009, Stat. Comput..

[33]  Lucy F. Ackert,et al.  Stochastic trends and cointegration in the market for equities , 1999 .

[34]  A. Doucet,et al.  Reversible Jump Markov Chain Monte Carlo Strategies for Bayesian Model Selection in Autoregressive Processes , 2004, Journal of Time Series Analysis.

[35]  Alan J. Izenman,et al.  Multivariate Reduced-Rank Regression , 2011, International Encyclopedia of Statistical Science.

[36]  Luc Bauwens,et al.  Bayesian Inference in Dynamic Econometric Models , 2000 .