The impact of task properties feedback on time series judgmental forecasting tasks

This study evaluates the impact of task properties feedback on the time series forecast accuracy of four different judgmental forecasting processes. Specifically, we test the impact of providing information on time series data patterns amd degree of noise level to knowledgeable subjects to interpret this information. Ninety eight subjects were used as the source of the individual and three-person group forecasts for eight artificial time series with varying patterns and noise levels. Our findings show that such task properties feedback leads to improvements in forecast accuracy for all forecasting processes tested, particularly for high noise series. This is true for both individual and group judgmental forecasting processes, as well as combination forecasts. These findings have important implications for business practitioners who continue to rely on judgmental forecasting processes. The information provided to subjects in our study is such that it could readily be obtained as output from most statistical software packages. Our findings imply that all judgmental forecasting processes could benefit by relying on this type of cognitive aid as an input to their judgments.

[1]  K. R. Hammond.  A Theoretically Based Review of Theory and Research in Judgment and Decision Making , 1986 .

[2]  Larry P. Ritzman,et al.  The need for contextual and technical knowledge in judgmental forecasting , 1992 .

[3]  Philip Bromiley,et al.  Do Forecasts Produced by Organizations Reflect Anchoring and Adjustment? - eScholarship , 1987 .

[4]  P. Goodwin,et al.  Improving judgmental time series forecasting: A review of the guidance provided by research , 1993 .

[5]  Arthur J. Adams,et al.  Management Judgment Forecasts, Composite Forecasting Models, and Conditional Efficiency , 1984 .

[6]  Robert H. Ashton,et al.  Aggregating Subjective Forecasts: Some Empirical Results , 1985 .

[7]  Wilpen L. Gorr,et al.  ACCURACY OF JUDGMENTAL FORECASTING OF TIME SERIES , 1985 .

[8]  William Remus,et al.  Does Feedback Improve the Accuracy of Recurrent Judgmental Forecasts , 1996 .

[9]  Marcus O'Connor,et al.  An examination of the accuracy of judgmental extrapolation of time series , 1985 .

[10]  N. Sanders,et al.  Forecasting Practices in US Corporations: Survey Results , 1994 .

[11]  Robin M. Hogarth,et al.  Quality of Group Judgment , 1977 .

[12]  William R. Ferrell,et al.  Combining Individual Judgments , 1985 .

[13]  Marcus O'Connor,et al.  The use of non‐time series information in sales forecasting: A case study , 1988 .

[14]  Marcus O'Connor,et al.  The effect of group interaction processes on performance in time series extrapolation , 1991 .

[15]  R. Ashton,et al.  Feedback And Prediction Achievement In Financial Analysis , 1981 .

[16]  Robert C. Blattberg,et al.  Database Models And Managerial Intuition: 50% Model + 50% Manager , 1990 .

[17]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[18]  D. Bunn,et al.  Interaction of judgemental and statistical forecasting methods: issues & , 1991 .

[19]  B. Brehmer,et al.  Human judgment : the SJT view , 1988 .

[20]  M. O'Connor,et al.  Judgemental and statistical time series forecasting: a review of the literature , 1996 .

[21]  P. George Benson,et al.  The effects of feedback and training on the performance of probability forecasters , 1992 .

[22]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[23]  R. H. Edmundson,et al.  The accuracy of combining judgemental and statistical forecasts , 1986 .

[24]  Fred Collopy,et al.  Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations , 1992 .

[25]  Spyros Makridakis,et al.  Metaforecasting. Ways of improving forecasting accuracy and usefulness , 1988 .