Rule-Based Forecasting: Using Judgment in Time-Series Extrapolation

Rule-Based Forecasting (RBF) is an expert system that uses judgment to develop and apply rules for combining extrapolations. The judgment comes from two sources, forecasting expertise and domain knowledge. Forecasting expertise is based on more than a half century of research. Domain knowledge is obtained in a structured way; one example of domain knowledge is managers’ expectations about trends, which we call “causal forces.” Time series are described in terms of up to 28 conditions, which are used to assign weights to extrapolations. Empirical results on multiple sets of time series show that RBF produces more accurate forecasts than those from traditional extrapolation methods or equal-weights combined extrapolations. RBF is most useful when it is based on good domain knowledge, the domain knowledge is important, the series is well-behaved (such that patterns can be identified), there is a strong trend in the data, and the forecast horizon is long. Under ideal conditions, the error for RBF’s forecasts were one-third less than those for equal-weights combining. When these conditions are absent, RBF will neither improve nor harm forecast accuracy. Some of RBF’s rules can be used with traditional extrapolation procedures. In a series of studies, rules based on causal forces improved the selection of forecasting methods, the structuring of time series, and the assessment of prediction intervals.

[1]  Robert Fildes,et al.  Generalising about univariate forecasting methods: Further empirical evidence , 1998 .

[2]  C. Chatfield,et al.  Apples, oranges and mean square error , 1988 .

[3]  Robert J. Vokurka,et al.  Automatic feature identification and graphical support in rule-based forecasting: a comparison , 1996 .

[4]  Monica Adya,et al.  Corrections to rule-based forecasting: findings from a replication , 2000 .

[5]  Fred Collopy,et al.  Integration of Statistical Methods and Judgment for Time Series Forecasting: Principles from Empirical Research , 2004 .

[6]  Thomas R. Stewart,et al.  Improving Reliability of Judgmental Forecasts , 2001 .

[7]  Leonard J. Tashman,et al.  The use of protocols to select exponential smoothing procedures: A reconsideration of forecasting competitions , 1996 .

[8]  Roy Batchelor,et al.  Forecaster diversity and the benefits of combining forecasts , 1995 .

[9]  J. Scott Armstrong,et al.  Long-Range Forecasting: From Crystal Ball to Computer , 1981 .

[10]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[11]  Everette S. Gardner,et al.  Exponential smoothing: The state of the art , 1985 .

[12]  Fred Collopy,et al.  Management science: D. Bunn and G. Wright, “Interaction of Judgmental and Statistical Forecasting Methods: Issues and Analysis”, 37 (1991) 501–518 , 1992 .

[13]  Steven P. Schnaars,et al.  Situational Factors Affecting Forecast Accuracy , 1984 .

[14]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[15]  Michael Lawrence,et al.  Judgmental Time-Series Forecasting Using Domain Knowledge , 2001 .

[16]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[17]  Jr. Everette S. Gardner,et al.  Rule-Based Forecasting Vs. Damped-Trend Exponential Smoothing , 1999 .

[18]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[19]  Fred Collopy,et al.  Identification of Asymmetric Prediction Intervals Through Causal Forces , 2001 .

[20]  George T. Duncan,et al.  Forecasting Analogous Time Series , 2001 .

[21]  J. Armstrong,et al.  Evaluating Forecasting Methods , 2001 .

[22]  Fred Collopy,et al.  An Application of Rule-Based Forecasting to a Situation Lacking Domain Knowledge , 2000 .

[23]  Fred Collopy,et al.  Causal Forces: Structuring Knowledge for Time-Series Extrapolation , 1993 .

[24]  Fred Collopy,et al.  Expert Opinions About Extrapolation and the Mystery of the Overlooked Discontinuities , 1992 .

[25]  Edward J. Lusk,et al.  The Accuracy of Alternative Extrapolation Models: Analysis of a Forecasting Competition Through Open Peer Review , 1983 .

[26]  S. French,et al.  Forecasting with judgment , 1998 .

[27]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[28]  Fred Collopy,et al.  Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations , 1992 .

[29]  Fred Collopy,et al.  Automatic Identification of Time Series Features for Rule-Based Forecasting , 2001 .

[30]  D. Bunn,et al.  Interaction of judgemental and statistical forecasting methods: issues & , 1991 .

[31]  J. Armstrong,et al.  PRINCIPLES OF FORECASTING 1 Principles of Forecasting : A Handbook for Researchers and Practitioners , 2006 .

[32]  Vassilis Assimakopoulos,et al.  An object oriented approach to forecasting , 1992 .

[33]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[34]  Spyros Makridakis,et al.  Forecasting when pattern changes occur beyond the historical data , 1986 .

[35]  D. MacGregor Decomposition for Judgmental Forecasting and Estimation , 1999 .

[36]  R. L. Henshel,et al.  Forecasting: An Appraisal for Policy-Makers and Planners. , 1978 .

[37]  J. Scott Armstrong,et al.  Principles of forecasting , 2001 .

[38]  Robert J. Genetski,et al.  Long-Range Forecasting: From Crystal Ball to Computer , 1981 .