Time-Varying Combinations of Predictive Densities Using Nonlinear Filtering

We propose a Bayesian combination approach for multivariate predictive densities which relies upon a distributional state space representation of the combination weights. Several specifications of multivariate time-varying weights are introduced with a particular focus on weight dynamics driven by the past performance of the predictive densities and the use of learning mechanisms. In the proposed approach the model set can be incomplete, meaning that all models can be individually misspecified. A Sequential Monte Carlo method is proposed to approximate the filtering and predictive densities. The combination approach is assessed using statistical and utility-based performance measures for evaluating density forecasts of simulated data, US macroeconomic time series and surveys of stock market prices. Simulation results indicate that, for a set of linear autoregressive models, the combination strategy is successful in selecting, with probability close to one, the true model when the model set is complete and it is able to detect parameter instability when the model set includes the true model that has generated subsamples of data. Also, substantial uncertainty appears in the weights when predictors are similar; residual uncertainty reduces when the model set is complete; and learning reduces this uncertainty. For the macro series we find that incompleteness of the models is relatively large in the 1970’s, the beginning of the 1980’s and during the recent financial crisis, and lower during the Great Moderation; the predicted probabilities of recession accurately compare with the NBER business cycle dating; model weights have substantial uncertainty attached. With respect to returns of the S&P 500 series, we find that an investment strategy using a combination of predictions from professional forecasters and from a white noise model puts more weight on the white noise model in the beginning of the 1990’s and switches to giving more weight to the professional forecasts over time. Information on the complete predictive distribution and not just on some moments turns out to be very important, above all during turbulent times such as the recent financial crisis. More generally, the proposed distributional state space representation offers great flexibility in combining densities.

[1]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[2]  T. Sargent,et al.  Drifts and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S. , 2003 .

[3]  Min Wei,et al.  Do macro variables, asset markets, or surveys forecast inflation better? , 2006 .

[4]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[5]  Antonello D’Agostino,et al.  Macroeconomic Forecasting and Structural Change , 2009, SSRN Electronic Journal.

[6]  T. Sargent,et al.  Drifts and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S. , 2005 .

[7]  GuptaSunil,et al.  Combination of Forecasts , 1987 .

[8]  Marno Verbeek,et al.  Forecast Accuracy and Economic Gains from Bayesian Model Averaging Using Time Varying Weights , 2009 .

[9]  K. West,et al.  A Utility Based Comparison of Some Models of Exchange Rate Volatility , 1992 .

[10]  Dimitris Korobilis,et al.  Large Time-Varying Parameter VARs , 2012 .

[11]  Eduardo Ley,et al.  On the Effect of Prior Assumptions in Bayesian Model Averaging With Applications to Growth Regression , 2007 .

[12]  K. Lahiri,et al.  Measuring Forecast Uncertainty by Disagreement: The Missing Link , 2008 .

[13]  Bruce E. Hansen,et al.  Least-squares forecast averaging , 2008 .

[14]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[15]  G. Koop,et al.  Forecasting In ation Using Dynamic Model Averaging , 2009 .

[16]  K. Wallis,et al.  Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters , 2008 .

[17]  S. Hall,et al.  Combining density forecasts , 2007 .

[18]  Robert Kohn,et al.  Flexible Modeling of Conditional Distributions Using Smooth Mixtures of Asymmetric Student T Densities , 2009 .

[19]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[20]  F. Gland,et al.  STABILITY AND UNIFORM APPROXIMATION OF NONLINEAR FILTERS USING THE HILBERT METRIC AND APPLICATION TO PARTICLE FILTERS1 , 2004 .

[21]  Shaun P. Vahey,et al.  Combining forecast densities from VARs with uncertain instabilities , 2010 .

[22]  C. Granger Invited review combining forecasts—twenty years later , 1989 .

[23]  M. Halling,et al.  Predictive Regressions with Time-Varying Coefficients , 2008 .

[24]  F. Diebold,et al.  Structural change and the combination of forecasts , 1986 .

[25]  Pierre Del Moral,et al.  Feynman-Kac formulae , 2004 .

[26]  Properties of Market-Based and Survey Macroeconomic Forecasts for Different Data Releases , 2009 .

[27]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[28]  H. V. Dijk,et al.  Combined forecasts from linear and nonlinear time series models , 1999 .

[29]  J. Geweke,et al.  Comparing and Evaluating Bayesian Predictive Distributions of Asset Returns , 2008 .

[30]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[31]  Edward I. George,et al.  Dilution priors: Compensating for model space redundancy , 2010 .

[32]  Francesco Ravazzolo,et al.  Backtesting Value-at-Risk Using Forecasts for Multiple Horizons, a Comment on the Forecast Rationality Tests of A.J. Patton and A. Timmermann , 2011 .

[33]  Francesco Ravazzolo,et al.  The Macroeconomic Forecasting Performance of Autoregressive Models with Alternative Specifications of Time-Varying Volatility , 2012 .

[34]  John Geweke,et al.  Chapter 1 Bayesian Forecasting , 2006 .

[35]  N. Barberis Investing for the Long Run When Returns are Predictable , 2000 .

[36]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[37]  Francesco Ravazzolo,et al.  Combining inflation density forecasts , 2010 .

[38]  Y. P. Mehra Survey Measures of Expected Inflation: Revisiting the Issues of Predictive Content and Rationality , 2002 .

[39]  Roberto Casarin,et al.  Identifying Business Cycle Turning Points with Sequential Monte Carlo Methods , 2008 .

[40]  L. B. Thomas Survey Measures of Expected U.S. Inflation , 1999 .

[41]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[42]  Francis X. Diebold A Note on Bayesian Forecast Combination Procedures , 1991 .

[43]  Alan T. K. Wan,et al.  Optimal Weight Choice for Frequentist Model Average Estimators , 2011 .

[44]  Michael A. West,et al.  Bayesian forecasting and dynamic models (2nd ed.) , 1997 .

[45]  A. Raftery,et al.  Time Series of Continuous Proportions , 1993 .

[46]  Todd E. Clark,et al.  Advances in Forecast Evaluation , 2011 .

[47]  J. Geweke,et al.  Bayesian Forecasting , 2004 .

[48]  Dimitris Korobilis,et al.  VAR Forecasting Using Bayesian Variable Selection , 2009 .

[49]  R. L. Winkler Combining Probability Distributions from Dependent Information Sources , 1981 .

[50]  T. Gneiting,et al.  Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules , 2011 .

[51]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[52]  Michael P. Clements,et al.  FORECASTING ECONOMIC TIME SERIES , 2000, Econometric Theory.

[53]  Jean-Michel Marin,et al.  DATA PROCESSING : COMPARISON OF BAYESIAN REGULARIZED PARTICLE FILTERS by Roberto Casarin , 2007 .

[54]  Chris Kirby,et al.  The Economic Value of Volatility Timing , 2000 .

[55]  John Geweke,et al.  Complete and Incomplete Econometric Models , 2010 .

[56]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[57]  Lennart F. Hoogerheide,et al.  Comment on Forecast Rationality Tests Based on Multi-Horizon Bounds , 2012 .

[58]  Michael R. Gibbons,et al.  A comparison of inflation forecasts , 1984 .

[59]  Todd E. Clark,et al.  Approximately Normal Tests for Equal Predictive Accuracy in Nested Models , 2005 .

[60]  Christian Musso,et al.  Improving Regularised Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[61]  Gianni Amisano,et al.  Comparing Density Forecasts via Weighted Likelihood Ratio Tests , 2007 .

[62]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[63]  V. Chernozhukov,et al.  Bayesian Econometrics , 2007 .

[64]  James Mitchell,et al.  Evaluating, Comparing and Combining Density Forecasts Using the Klic with an Application to the Bank of England and Niesr 'Fan' Charts of Inflation , 2005 .

[65]  Francis X. Diebold,et al.  The use of prior information in forecast combination , 1990 .

[66]  Adrian E. Raftery,et al.  Prediction under Model Uncertainty Via Dynamic Model Averaging : Application to a Cold Rolling Mill 1 , 2008 .

[67]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[68]  G. A. Barnard,et al.  New Methods of Quality Control , 1963 .

[69]  A. Timmermann,et al.  Forecasts of Us Short-Term Interest Rates: A Flexible Forecast Combination Approach , 2006 .

[70]  Gabriel Huerta,et al.  Time series modeling via hierarchical mixtures , 2003 .

[71]  J. Geweke,et al.  Optimal Prediction Pools , 2008 .

[72]  Francesco Ravazzolo,et al.  Real-Time Inflation Forecasting in a Changing World , 2013 .

[73]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[74]  J. M. Sloughter,et al.  Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging , 2010 .

[75]  Jeremy Berkowitz Testing Density Forecasts, With Applications to Risk Management , 2001 .

[76]  W. Branch The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations , 2004 .

[77]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[78]  Monica Billio,et al.  Combining forecasts: some results on exchange and interest rates , 2000 .

[79]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[80]  I. Welch,et al.  A Comprehensive Look at the Empirical Performance of Equity Premium Prediction II , 2004, SSRN Electronic Journal.

[81]  Shaun P. Vahey,et al.  Forecast densities for economic aggregates from disaggregate ensembles , 2010 .

[82]  B. Hansen Least Squares Model Averaging , 2007 .

[83]  Drew D. Creal A Survey of Sequential Monte Carlo Methods for Economics and Finance , 2012 .

[84]  Monica Billio,et al.  Beta Autoregressive Transition Markov-Switching Models for Business Cycle Analysis , 2011 .