Forecasting Software in Practice: Use, Satisfaction, and Performance

Using survey data from 240 US corporations, we evaluated practitioners' use and satisfaction with forecasting software and its performance. Despite the many commercial forecasting software packages, only 10.8 percent of the respondents reported using them. Forty-eight percent reported using spreadsheets to make forecasts. Sixty percent reported being dissatisfied with forecasting software. However, we found that those who used commercial forecasting software packages had the best forecast performance, as measured by mean absolute percentage error (MAPE). Those using commercially available packages had errors 6.7 percent lower than those using spreadsheets and 17.2 percent lower than those who used no program. Also, they were more satisfied with their software than those using spreadsheets. In fact, users of forecasting software programs reported a 12.2 percent reduction in forecast error. We found that 61 percent of respondents routinely adjusted forecasts produced by software based on their judgment. Roughly 85 percent of respondents considered ease of use and easily understandable results the most important software features.

[1]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .

[2]  J. Scott Armstrong,et al.  Long-Range Forecasting: From Crystal Ball to Computer , 1981 .

[3]  J. Scott Armstrong,et al.  Estimating nonresponse bias in mail surveys. , 1977 .

[4]  N. Sanders,et al.  Forecasting Practices in US Corporations: Survey Results , 1994 .

[5]  Michael Lawrence,et al.  Judgmental Time-Series Forecasting Using Domain Knowledge , 2001 .

[6]  Douglas J. Dalrymple.  Sales forecasting practices: Results from a United States survey , 1987 .

[7]  Larry P. Ritzman,et al.  Judgmental Adjustment of Statistical Forecasts , 2001 .

[8]  Jim Hoover,et al.  Diffusion of Forecasting Principles through Software , 2001 .

[9]  Robert J. Genetski,et al.  Long-Range Forecasting: From Crystal Ball to Computer , 1981 .

[10]  Keith Ord.  Commercially available software and the M3-Competition , 2000 .

[11]  J. Scott Armstrong,et al.  Beyond Accuracy: Comparison of Criteria Used to Select Forecasting Methods , 1995 .

[12]  F. Adams,et al.  The Business Forecasting Revolution , 1986 .

[13]  John T. Mentzer,et al.  Familiarity, application, and performance of sales forecasting techniques , 1984 .

[14]  Robert S. Rycroft.  Microcomputer software of interest to forecasters in comparative review: An update , 1993 .

[15]  John T. Mentzer,et al.  Forecasting Technique Familiarity, Satisfaction, Usage, and Application , 1995 .

[16]  Everette S. Gardner,et al.  The Strange Case of the Lagging Forecasts , 1984 .

[17]  Michael Lawrence,et al.  What does it take to achieve adoption in sales forecasting , 2000 .

[18]  Robert S. Rycroft,et al.  Microcomputer software of interest to forecasters in comparative review , 1989 .

[19]  Leonard J. Tashman,et al.  Automatic forecasting software: A survey and evaluation☆ , 1991 .