Judging the judges through accuracy-implication metrics: The case of inventory forecasting

A number of research projects have demonstrated that the efficiency of inventory systems does not relate directly to demand forecasting performance, as measured by standard forecasting accuracy measures. When a forecasting method is used as an input to an inventory system, it should therefore always be evaluated with respect to its consequences for stock control through accuracy implications metrics, in addition to its performance on the standard accuracy measures. In this paper we address the issue of judgementally adjusting statistical forecasts for ‘fast’ demand items, and the implications of such interventions in terms of both forecast accuracy and stock control, with the latter being measured through inventory volumes and service levels achieved. We do so using an empirical dataset from the pharmaceutical industry. Our study allows insights to be gained into the combined forecasting and inventory performance of judgemental estimates. It also aims to advance the practice of forecasting competitions by arguing for the consideration of additional (stock control) metrics when such exercises take place in an inventory context.

[1]  Robert Fildes,et al.  Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting , 2007, Interfaces.

[2]  Jr. Everette S. Gardner,et al.  Evaluating forecast performance in an inventory control system , 1990 .

[3]  C. Carl Pegels,et al.  An Approach for Selecting Times Series Forecasting Models , 1990 .

[4]  Adamantios Diamantopoulos,et al.  Judgemental revision of sales forecasts: The relative performance of judgementally revised versus non‐revised forecasts , 1992 .

[5]  L. Strijbosch,et al.  Modified Normal Demand Distributions in (R,S) - Inventory Models , 2006 .

[6]  David F. Pyke,et al.  Inventory management and production planning and scheduling , 1998 .

[7]  R. Fildes,et al.  The effects of integrating management judgement into intermittent demand forecasts , 2009 .

[8]  John E. Boylan,et al.  Demand forecasting adjustments for service-level achievement , 2008 .

[9]  E. S. Gardner,et al.  Using Optimal Policy Surfaces to Analyze Aggregate Inventory Tradeoffs , 1979 .

[10]  J. Boylan,et al.  On the stock control performance of intermittent demand estimators , 2006 .

[11]  C. Granger,et al.  Efficient Market Hypothesis and Forecasting , 2002 .

[12]  Brian G. Kingsman,et al.  Forecasting for the ordering and stock-holding of spare parts , 2004, J. Oper. Res. Soc..

[13]  R. Fildes,et al.  Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning , 2009 .

[14]  Aris A. Syntetos,et al.  Accuracy and Accuracy Implication Metrics for Intermittent Demand , 2006 .

[15]  P. Goodwin,et al.  On the asymmetry of the symmetric MAPE , 1999 .

[16]  John E. Boylan.  Key assumptions in calculating the Cost of Forecast Error. A commentary on Peter Catt’s article, assessing the Cost of Forecast Error, in Issue 7 of Foresight , 2007 .

[17]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[18]  N. Sanders,et al.  Forecasting Practices in US Corporations: Survey Results , 1994 .

[19]  Leo W. G. Strijbosch,et al.  The impact of unknown demand parameters on (R , 2005, Eur. J. Oper. Res..

[20]  Brian G. Kingsman,et al.  Selecting the best periodic inventory control and demand forecasting methods for low demand items , 1997 .