Evidence for the selection of forecasting methods

Reid (1972) was among the first to argue that the relative accuracy of forecasting methods changes according to the properties of the time series. Comparative analyses of forecasting performance such as the M-Competition tend to support this argument. The issue addressed here is the usefulness of statistics summarizing the data available in a time series in predicting the relative accuracy of different forecasting methods. Nine forecasting methods are described and the literature suggesting summary statistics for choice of forecasting method is summarized. Based on this literature and further argument a set of these statistics is proposed for the analysis. These statistics are used as explanatory variables in predicting the relative performance of the nine methods using a set of simulated time series with known properties. These results are evaluated on observed data sets, the M-Competition data and Fildes Telecommunications data. The general conclusion is that the summary statistics can be used to select a good forecasting method (or set of methods) but not necessarily the best. Copyright © 2000 John Wiley & Sons, Ltd.

[1]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[2]  Nigel Meade,et al.  ARARMA vs ARIMA—A study of the benefits of a new approach to forecasting , 1985 .

[3]  Robert Fildes,et al.  The accuracy of extrapolation methods; an automatic box–jenkins package sift , 1984 .

[4]  Emanuel Parzen,et al.  ARARMA models for time series analysis and forecasting , 1982 .

[5]  Chris Chatfield,et al.  “Rule-based forecasting: Development and validation of an expert systems approach to combining time series extrapolations”: Fred Collopy and J. Scott Armstrong, Management science, 38 (1992) 1394–1414 , 1993 .

[6]  Chandra Shah,et al.  Model selection in univariate time series forecasting using discriminant analysis , 1997 .

[7]  Robert Fildes,et al.  Generalising about univariate forecasting methods: Further empirical evidence , 1998 .

[8]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[9]  Robert C. Spicer,et al.  Author's biography , 1993 .

[10]  J. Geweke,et al.  THE ESTIMATION AND APPLICATION OF LONG MEMORY TIME SERIES MODELS , 1983 .

[11]  Werner A. Stahel,et al.  Forecasting demand for special telephone services: A case study , 1990 .

[12]  E. S. Gardner,et al.  Forecasting Trends in Time Series , 1985 .

[13]  C. Granger,et al.  Experience with Forecasting Univariate Time Series and the Combination of Forecasts , 1974 .

[14]  Leonard J. Tashman,et al.  The use of protocols to select exponential smoothing procedures: A reconsideration of forecasting competitions , 1996 .

[15]  Everette S. Gardner,et al.  Model Identification in Exponential Smoothing , 1988 .

[16]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[17]  Robert Fildes,et al.  The evaluation of extrapolative forecasting methods , 1992 .

[18]  Fred Collopy,et al.  Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations , 1992 .