On the accuracy of judgmental interventions on forecasting support systems

Forecasting at the Stock Keeping Unit (SKU) disaggregate level in order to support operations management has proved a very difficult task. The levels of accuracy achieved have major consequences for companies at all levels in the supply chain; errors at each stage are amplified resulting in poor service and overly high inventory levels. In most companies, the size and complexity of the forecasting task necessitates the use of Forecasting Support Systems (FSS). The present study examines monthly demand data and forecasts for 44 fast moving, A-class, durable SKUs, collected from a major U.K. supplier. The company relies upon a FSS to produce baseline forecasts per SKU for each period. Final forecasts are produced at a later stage through the superimposition of judgments based on marketing intelligence gathered by the company forecasters. The benefits of the intervention are evaluated by comparing the actual sales both to system and final forecasts. The findings support the case that adjustments do improve accuracy, particularly under the condition that the adjustment is conservative, in the right direction, but does not overshoot. The question is how best to meet these conditions.

[1]  Adamantios Diamantopoulos,et al.  Managerial intervention in forecasting. An empirical investigation of forecast manipulation , 1986 .

[2]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[3]  Konstantinos Nikolopoulos,et al.  Theta intelligent forecasting information system , 2003, Ind. Manag. Data Syst..

[4]  Larry P. Ritzman,et al.  Judgmental Adjustment of Statistical Forecasts , 2001 .

[5]  Michael Lawrence,et al.  A field study of sales forecasting accuracy and processes , 2000, Eur. J. Oper. Res..

[6]  Fred Collopy,et al.  Integration of Statistical Methods and Judgment for Time Series Forecasting: Principles from Empirical Research , 2004 .

[7]  Steven C. Wheelwright,et al.  Forecasting: Methods and Applications, 3rd Edition , 1998 .

[8]  Brian P. Mathews,et al.  Judgemental revision of sales forecasts: Effectiveness of forecast selection , 1990 .

[9]  Robert Fildes,et al.  Judgmental forecasts of time series affected by special events: does providing a statistical forecast improve accuracy? , 1999 .

[10]  Moira Watson,et al.  Forecasting in the Scottish electronics industry , 1996 .

[11]  Everette S. Gardner,et al.  Focus forecasting reconsidered , 1997 .

[12]  J. Keith Ord,et al.  Automatic neural network modeling for univariate time series , 2000 .

[13]  Marcus O'Connor,et al.  Sales forecasting updates: how good are they in practice? , 2000 .

[14]  Robert Fildes,et al.  The design features of forecasting support systems and their effectiveness , 2006, Decis. Support Syst..

[15]  Robert Fildes,et al.  Forecasting Systems for Production and Inventory Control , 1992 .

[16]  P. Goodwin Improving the voluntary integration of statistical forecasts and judgment , 2000 .

[17]  Robert D. Klassen,et al.  Forecasting practices of Canadian firms: Survey results and comparisons , 2001 .

[18]  A. Diamantopoulos,et al.  Judgemental revision of sales forecasts: A longitudinal eetension , 1989 .

[19]  Michael Lawrence The M2-competition: Some personal views , 1993 .

[20]  David Reilly,et al.  Personal views of the M2-competition , 1993 .

[21]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[22]  Fred Collopy,et al.  Automatic Identification of Time Series Features for Rule-Based Forecasting , 2001 .

[23]  Vineet Padmanabhan,et al.  Comments on "Information Distortion in a Supply Chain: The Bullwhip Effect" , 1997, Manag. Sci..

[24]  S. French,et al.  Forecasting with judgment , 1998 .

[25]  P. Goodwin,et al.  On the asymmetry of the symmetric MAPE , 1999 .

[26]  Paul Goodwin,et al.  Integrating management judgment and statistical methods to improve short-term forecasts , 2002 .

[27]  L. LeeHau,et al.  Information Distortion in a Supply Chain , 1997 .

[28]  Chris Chatfield A personal view of the M2-competition , 1993 .

[29]  Paul Goodwin,et al.  Heuristics, biases and improvement strategies in judgmental time series forecasting , 1994 .

[30]  Terence C. Mills The M2-competition: Some personal reflections , 1993 .

[31]  E. S. Gardner,et al.  Forecasting Trends in Time Series , 1985 .

[32]  John T. Mentzer,et al.  Conducting a sales forecasting audit , 2003 .

[33]  Robert Fildes,et al.  Generalising about univariate forecasting methods: Further empirical evidence , 1998 .

[34]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[35]  C. Chatfield,et al.  The M2-competition: A real-time judgmentally based forecasting study , 1993 .