Forecast Combination and the Bank of England's Suite of Statistical Forecasting Models

The Bank of England has constructed a 'suite of statistical forecasting models' (the 'Suite') providing judgement-free statistical forecasts of inflation and output growth as inputs into the forecasting process, and to offer measures of relevant news in the data. The Suite focuses on combining in an optimal way a small number of forecasts generated using different sources of information and methodologies. The main combination methods employ weights that are equal or based on the Akaike information criterion (using likelihoods built from estimation errors). This paper sets a general context for this exercise, and describes some features of the Suite as it stood in May 2005. The forecasts are evaluated over the period of Bank independence (from 1997 Q2) by a mean square error criterion. The forecast combinations generally lead to a reduction in forecast error, although over this period some of the benchmark models are hard to beat.

[1]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[2]  F. Diebold,et al.  Structural change and the combination of forecasts , 1986 .

[3]  Todd E. Clark,et al.  The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence , 2003 .

[4]  Kalin Nikolov,et al.  The Bank of England Quarterly Model , 2005 .

[5]  Frédérick Demers,et al.  Econometric Forecasts Package : Short-Run Forecasting Models for the Current Analysis of the Canadian Economy ¤ , 2005 .

[6]  Kenneth F. Wallis,et al.  Sources of error in forecasts and expectations: U.K. economic models, 1984–8 , 1991 .

[7]  Michael P. Clements,et al.  Pooling of Forecasts , 2004 .

[8]  George Kapetanios,et al.  Variable selection in regression models using nonstandard optimisation of information criteria , 2007, Comput. Stat. Data Anal..

[9]  J. Stock,et al.  Why Has U.S. Inflation Become Harder to Forecast , 2007 .

[10]  P. Perron,et al.  Estimating and testing linear models with multiple structural changes , 1995 .

[11]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[12]  Pieter Eykhoff,et al.  Trends and progress in system identification , 1981 .

[13]  V. Vieland,et al.  Statistical Evidence: A Likelihood Paradigm , 1998 .

[14]  Hirotugu Akaike,et al.  MODERN DEVELOPMENT OF STATISTICAL METHODS , 1981 .

[15]  Jonathan H. Wright,et al.  Forecasting U.S. Inflation by Bayesian Model Averaging , 2003 .

[16]  Serena Ng,et al.  Understanding and Comparing Factor-Based Forecasts , 2005 .

[17]  George Kapetanios,et al.  Forecasting Using Bayesian and Information Theoretic Model Averaging: An Application to UK Inflation , 2005 .

[18]  M. Hallin,et al.  The Generalized Dynamic-Factor Model: Identification and Estimation , 2000, Review of Economics and Statistics.

[19]  H. Akaike.  A Bayesian analysis of the minimum AIC procedure , 1978 .

[20]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[21]  Michael P. Clements,et al.  A companion to economic forecasting , 2004 .

[22]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[23]  A. Pagan.  Report and Modelling and Forecasting at the Bank of England , 2005 .

[24]  Stephen Taylor,et al.  Forecasting Economic Time Series , 1979 .

[25]  Robert B. Litterman.  Forecasting with Bayesian Vector Autoregressions-Five Years of Experience , 1984 .

[26]  George Kapetanios.  Variable Selection using Non-Standard Optimisation of Information Criteria , 2005 .

[27]  Rafael Repullo,et al.  Liquidity, Risk-Taking and the Lender of Last Resort , 2005 .

[28]  The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence , 2006 .

[29]  Robert B. Litterman,et al.  Forecasting and Conditional Projection Using Realistic Prior Distributions , 1983 .

[30]  George Kapetanios,et al.  Forecasting using predictive likelihood model averaging , 2006 .

[31]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[32]  C. Granger,et al.  Experience with Forecasting Univariate Time Series and the Combination of Forecasts , 1974 .

[33]  T. Sargent,et al.  Drifts and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S. , 2003 .

[34]  Robert Elder,et al.  Assessing the Mpc's Fan Charts , 2005 .

[35]  J. Stock,et al.  Macroeconomic Forecasting Using Diffusion Indexes , 2002 .

[36]  Mark W. Watson,et al.  Has inflation become harder to forecast , 2005 .

[37]  Sune Karlsson,et al.  Finding Good Predictors for Inflation: A Bayesian Model Averaging Approach , 2004 .

[38]  H. Akaike.  A Bayesian extension of the minimum AIC procedure of autoregressive model fitting , 1979 .

[39]  David F. Hendry,et al.  Robustifying Forecasts from Equilibrium-Correction Models , 2004 .

[40]  David F. Hendry,et al.  Robustifying forecasts from equilibrium-correction systems , 2006 .

[41]  Michael P. Clements,et al.  Forecast Combination and Encompassing , 2009 .

[42]  P. Westaway.  Economic Models at the Bank of England , 2000 .

[43]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[44]  A. Pagan.  Addendum to Report on Modelling and Forecasting at the Bank of England , 2005 .

[45]  T. Sargent,et al.  Drifts and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S. , 2005 .

[46]  M. Hashem Pesaran,et al.  A Recursive Modelling Approach to Predicting UK Stock Returns , 2000 .

[47]  Michael P. Clements,et al.  Forecasting with Breaks , 2006 .

[48]  Arnold Zellner,et al.  Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates , 1993 .

[49]  M. Bhaskara Rao,et al.  Model Selection and Inference , 2000, Technometrics.

[50]  Todd E. Clark,et al.  Improving Forecast Accuracy by Combining Recursive and Rolling Forecasts , 2008 .

[51]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[52]  Jonathan H. Wright,et al.  Bayesian Model Averaging and Exchange Rate Forecasts , 2003 .

[53]  Jean Boivin,et al.  Monetary Policy in a Data-Rich Environment , 2001 .

[54]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[55]  Francis X. Diebold,et al.  The use of prior information in forecast combination , 1990 .

[56]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[57]  Gary Koop,et al.  Forecasting in Large Macroeconomic Panels Using Bayesian Model Averaging , 2003 .

[58]  Jonathan H. Wright.  Bayesian Model Averaging and Exchange Rate Forecasts , 2003 .

[59]  Arnold Zellner,et al.  "Bayesian and Non-Bayesian Methods for Combining Models and Forecasts with Applications to Forecasting International Growth Rates" , 2004 .