Achieving Parsimony in Bayesian VARs with the Horseshoe Prior

In the context of a vector autoregression (VAR) model, or any multivariate regression model, the number of relevant predictors may be small relative to the information set available from which to build a prediction equation. It is well known that forecasts based off of (un-penalized) least squares estimates can overfit the data and lead to poor predictions. Since the Minnesota prior was proposed (Doan et al. (1984)), there have been many methods developed aiming at improving prediction performance. In this paper we propose the horseshoe prior (Carvalho et al. (2010), Carvalho et al. (2009)) in the context of a Bayesian VAR. The horseshoe prior is a unique shrinkage prior scheme in that it shrinks irrelevant signals rigorously to 0 while allowing large signals to remain large and practically unshrunk. In an empirical study, we show that the horseshoe prior competes favorably with shrinkage schemes commonly used in Bayesian VAR models as well as with a prior that imposes true sparsity in the coefficient vector. Additionally, we propose the use of particle Gibbs with backwards simulation (Lindsten et al. (2012), Andrieu et al. (2010)) for the estimation of the time-varying volatility parameters. We provide a detailed description of all MCMC methods used in the supplementary material that is available online.

[1]  Dimitris Korobilis,et al.  VAR Forecasting Using Bayesian Variable Selection , 2009 .

[2]  Todd E. Clark,et al.  Macroeconomic Forecasting Performance under Alternative Specifications of Time-Varying Volatility , 2015 .

[3]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[4]  Robert B. Litterman,et al.  Forecasting and Conditional Projection Using Realistic Prior Distributions , 1983 .

[5]  James G. Scott,et al.  The horseshoe estimator for sparse signals , 2010 .

[6]  Fredrik Lindsten,et al.  On the use of backward simulation in the particle Gibbs sampler , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  D. Giannone,et al.  Large Bayesian vector auto regressions , 2010 .

[8]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[9]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[10]  C. De Mol,et al.  Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components? , 2006, SSRN Electronic Journal.

[11]  Todd E. Clark,et al.  Common Drifting Volatility in Large Bayesian VARs , 2012 .

[12]  Dimitrios Korompilis Magkas Hierarchical shrinkage priors for dynamic regressions with many predictors , 2011 .

[13]  F. Dias,et al.  Determining the number of factors in approximate factor models with global and group-specific factors , 2008 .

[14]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[15]  Sune Karlsson Forecasting with Bayesian Vector Autoregression , 2013 .

[16]  Dorota Kurowicka,et al.  Generating random correlation matrices based on vines and extended onion method , 2009, J. Multivar. Anal..

[17]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[18]  David H. Small,et al.  Nowcasting: the real time informational content of macroeconomic data releases , 2008 .

[19]  Michele Lenza,et al.  Prior Selection for Vector Autoregressions , 2012, Review of Economics and Statistics.

[20]  Fabio Canova,et al.  Forecasting and Turning Point Predictions in a Bayesian Panel VAR Model , 2001 .

[21]  Michael I. Jordan,et al.  Dimensionality Reduction for Supervised Learning with Reproducing Kernel Hilbert Spaces , 2004, J. Mach. Learn. Res..

[22]  R. Snee,et al.  Ridge Regression in Practice , 1975 .

[23]  Catherine Doz,et al.  A Two-Step Estimator for Large Approximate Dynamic Factor Models Based on Kalman Filtering , 2007 .

[24]  James G. Scott,et al.  Handling Sparsity via the Horseshoe , 2009, AISTATS.

[25]  G. Koop,et al.  Bayesian Multivariate Time Series Methods for Empirical Macroeconomics , 2009 .

[26]  J. Stock,et al.  Diffusion Indexes , 1998 .