Combining probability forecasts

We consider different methods for combining probability forecasts. In empirical exercises, the data generating process of the forecasts and the event being forecast is not known, and therefore the optimal form of combination will also be unknown. We consider the properties of various combination schemes for a number of plausible data generating processes, and indicate which types of combinations are likely to be useful. We also show that whether forecast encompassing is found to hold between two rival sets of forecasts or not may depend on the type of combination adopted. The relative performances of the different combination methods are illustrated, with an application to predicting recession probabilities using leading indicators.

[1]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[2]  Michael P. Clements,et al.  A companion to economic forecasting , 2004 .

[3]  Peter E. Kennedy,et al.  Combining Qualitative Forecasts Using Logit , 1998 .

[4]  A. H. Murphy,et al.  Scoring rules and the evaluation of probabilities , 1996 .

[5]  D. Hendry,et al.  Econometric Evaluation of Linear Macro-Economic Models , 1986 .

[6]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[7]  M. E. Johnson,et al.  A Family of Distributions for Modelling Non‐Elliptically Symmetric Multivariate Data , 1981 .

[8]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[9]  Paul Newbold,et al.  Tests for multiple forecast encompassing , 2000 .

[10]  Kerry Patterson,et al.  Palgrave handbook of econometrics: volume 2 applied econometrics , 2009 .

[11]  Francis X. Diebold,et al.  Scoring the Leading Indicators , 2020, Business Cycles.

[12]  Christian Genest,et al.  Combining Probability Distributions: A Critique and an Annotated Bibliography , 1986 .

[13]  Allan Timmermann,et al.  Optimal Forecast Combinations Under General Loss Functions and Forecast Error Distributions , 2002 .

[14]  A. Timmermann.  Chapter 4 Forecast Combinations , 2006 .

[15]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[16]  H. White,et al.  Cointegration, causality, and forecasting : a festschrift in honour of Clive W.J. Granger , 1999 .

[17]  Kenneth D West,et al.  Tests for Forecasts Encompassing When Forecasts Depend on Estimated Regression Parameters , 2001 .

[18]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[19]  Kaplan,et al.  ‘Combining Probability Distributions from Experts in Risk Analysis’ , 2000, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[21]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[22]  Michael P. Clements,et al.  Forecast Encompassing Tests and Probability Forecasts , 2010 .

[23]  Mark Blaug,et al.  The international library of critical writings in economics , 1990 .

[24]  Michael P. Clements,et al.  Pooling of Forecasts , 2004 .

[25]  P. Newbold,et al.  Tests for Forecast Encompassing , 1998 .

[26]  C. Granger,et al.  Experience with Forecasting Univariate Time Series and the Combination of Forecasts , 1974 .

[27]  J. Stock,et al.  A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series , 1998 .

[28]  Farshid Vahid,et al.  PREDICTING THE PROBABILITY OF A RECESSION WITH NONLINEAR AUTOREGRESSIVE LEADING-INDICATOR MODELS , 2001, Macroeconomic Dynamics.

[29]  Ray C. Fair,et al.  Comparing Information in Forecasts from Econometric Models , 1990 .

[30]  G. Brier.  VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[31]  Frederic S. Mishkin,et al.  Predicting U.S. Recessions: Financial Variables as Leading Indicators , 1995, Review of Economics and Statistics.

[32]  Michael P. Clements,et al.  Forecast Combination and Encompassing , 2009 .

[33]  F. Diebold,et al.  Forecast Evaluation and Combination , 1996 .

[34]  J. Stock,et al.  How Did Leading Indicator Forecasts Perform during the 2001 Recession? , 2003 .

[35]  A. Timmermann.  Forecast Combinations , 2005 .

[36]  Timo Teräsvirta,et al.  The combination of forecasts using changing weights , 1994 .

[37]  James D. Hamilton,et al.  A Reexamination of the Predictability of Economic Activity Using the Yield Spread , 2000 .