Automatic feature identification and graphical support in rule-based forecasting: a comparison

Abstract We examined automatic feature identification and graphical support in rule-based expert systems for forecasting. The rule-based expert forecasting system (RBEFS) includes predefined rules to automatically identify features of a time series and selects the extrapolation method to be used. The system can also integrate managerial judgment using a graphical interface that allows a user to view alternate extrapolation methods two at a time. The use of the RBEFS led to a significant improvement in accuracy compared to equal-weight combinations of forecasts. Further improvement were achieved with the user interface. For 6-year ahead ex ante forecasts, the rule-based expert forecasting system has a median absolute percentage error (MdAPE) 15% less than that of equally weighted combined forecasts and a 33% improvement over the random walk. The user adjusted forecasts had a MdAPE 20% less than that of the expert system. The results of the system are also compared to those of an earlier rule-based expert system which required human judgments about some features of the time series data. The results of the comparison of the two rule-based expert systems showed no significant differences between them.

[1]  Adamantios Diamantopoulos,et al.  Towards a taxonomy of forecast error measures a factor‐comparative investigation of forecast error dimensions , 1994 .

[2]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[3]  J. Scott Armstrong,et al.  Forecasting by Extrapolation: Conclusions from 25 Years of Research , 2001 .

[4]  Derek W. Bunn.  The Synthesis of Predictive Models in Marketing Research , 1979 .

[5]  N. Sanders,et al.  On Knowing When to Switch from Quantitative to Judgemental Forecasts , 1991 .

[6]  Robert Carbone,et al.  Comparing for Different Time Series Methods the Value of Technical Expertise Individualized Analysis, and Judgmental Adjustment , 1983 .

[7]  Andrew Zardecki,et al.  Rule-Based Forecasting , 1996 .

[8]  Steven P. Schnaars.  A comparison of extrapolation models on yearly sales forecasts , 1986 .

[9]  R. H. Edmundson.  Decomposition; a strategy for judgemental forecasting , 1990 .

[10]  Nada R. Sanders,et al.  Improving short-term forecasts , 1990 .

[11]  Robert Fildes,et al.  Evaluation of Aggregate and Individual Forecast Method Selection Rules , 1989 .

[12]  A. Diamantopoulos,et al.  Judgemental revision of sales forecasts: A longitudinal eetension , 1989 .

[13]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[14]  R. L. Winkler,et al.  Averages of Forecasts: Some Empirical Results , 1983 .

[15]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[16]  Stephen L. Pearce,et al.  Comparing an expert system vs traditional approach to forecasting item demand in a distribution inventory environment , 1996 .

[17]  E. S. Gardner,et al.  Forecasting Trends in Time Series , 1985 .

[18]  R. Tsay.  Time Series Model Specification in the Presence of Outliers , 1986 .

[19]  Fred Collopy,et al.  Causal Forces: Structuring Knowledge for Time-Series Extrapolation , 1993 .

[20]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[21]  J. Ledolter,et al.  Parsimony and Its Importance in Time Series Forecasting , 1981 .

[22]  C. J. Wolfe,et al.  Judgmental adjustment of earnings forecasts , 1990 .

[23]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[24]  J. Scott Armstrong,et al.  Long-Range Forecasting. , 1979 .

[25]  T.S.L. Lo.  An expert system for choosing demand forecasting techniques , 1994 .

[26]  Brian P. Mathews,et al.  Judgemental revision of sales forecasts: Effectiveness of forecast selection , 1990 .

[27]  D. Bunn,et al.  Interaction of judgemental and statistical forecasting methods: issues & , 1991 .

[28]  Rob R. Weitz,et al.  Nostradamus A knowledge-based forecasting advisor , 1986 .

[29]  J. Armstrong.  Research Needs in Forecasting , 1988 .