The design features of forecasting support systems and their effectiveness

Forecasts play a key role in the management of the supply chain. In most organisations such forecasts form part of an information system on which other functions, such as scheduling, resource planning and marketing depend. Forecast accuracy is, therefore, an important component in the delivery of an effective supply chain. Typically, the forecasts are produced by integrating managerial judgment with quantitative forecasts within a forecasting support system (FSS). However, there is much evidence that this integration is often carried out poorly with deleterious effects on accuracy. This study integrates the literatures on forecasting and decision support to explain the causes of the problem and to identify design features of FSSs that might help to ameliorate it. It is also argued that, by studying the supply chain forecasting task, DSS researchers could learn much about decision support in general and also make a significant contribution to the improvement of forecasting practice.

[1]  William Remus,et al.  Does Feedback Improve the Accuracy of Recurrent Judgmental Forecasts , 1996 .

[2]  Mark S. Silver,et al.  Decisional Guidance for Computer-Based Decision Support , 1991, MIS Q..

[3]  Charles R. Crowell,et al.  Human-computer interaction: A preliminary social psychological analysis , 1982 .

[4]  Nigel Harvey,et al.  Why Are Judgments Less Consistent in Less Predictable Task Situations , 1995 .

[5]  Marcus O'Connor,et al.  Scale, Variability, and the Calibration of Judgmental Prediction Intervals , 1993 .

[6]  Derek W. Bunn,et al.  Setting accuracy targets for short-term judgemental sales forecasting , 2001 .

[7]  John T. Mentzer,et al.  Conducting a sales forecasting audit , 2003 .

[8]  Maryam Alavi,et al.  Revisiting DSS Implementation Research: A Meta-Analysis of the Literature and Suggestions for Researchers , 1992, MIS Q..

[9]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[10]  Robert C. Blattberg,et al.  Database Models And Managerial Intuition: 50% Model + 50% Manager , 1990 .

[11]  Peter G. W. Keen,et al.  Decision support systems : an organizational perspective , 1978 .

[12]  S. French,et al.  Forecasting with judgment , 1998 .

[13]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[14]  William Remus,et al.  Judgemental forecasting in times of change , 1993 .

[15]  Ed O'Donnell,et al.  How information systems influence user decisions: a research framework and literature review , 2000, Int. J. Account. Inf. Syst..

[16]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[17]  Gideon Keren,et al.  Facing uncertainty in the game of bridge: A calibration study , 1987 .

[18]  Spyros Makridakis,et al.  The M3-Competition1 , 2000 .

[19]  Izak Benbasat,et al.  Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice , 1999, MIS Q..

[20]  Michael Lawrence,et al.  The effects of structural characteristics of explanations on use of a DSS , 2006, Decis. Support Syst..

[21]  Jim Hoover,et al.  Diffusion of Forecasting Principles through Software , 2001 .

[22]  Brian P. Mathews,et al.  Judgemental revision of sales forecasts: Effectiveness of forecast selection , 1990 .

[23]  M. O'Connor,et al.  Judgemental adjustment of initial forecasts: Its effectiveness and biases , 1995 .

[24]  James J. Jiang,et al.  The Impact of Model Performance History Information on Users' Confidence in Decision Models: An Experimental Examination , 1996 .

[25]  Paul N. Finlay,et al.  A classification of management support systems , 1997 .

[26]  Gary Klein,et al.  Side effects of decision guidance in decision support systems , 2000, Interact. Comput..

[27]  Michael Lawrence,et al.  Prototyping a financial DSS , 1999 .

[28]  George M. Kasper,et al.  A Theory of Decision Support System Design for User Calibration , 1996, Inf. Syst. Res..

[29]  Joyce J. Elam,et al.  A Comparative Study of How Experts and Novices Use a Decision Aid to Solve Problems in Complex Knowledge Domains , 1992, Inf. Syst. Res..

[30]  R. Fildes,et al.  The State of Macroeconomic Forecasting , 2002 .

[31]  F. Bolger,et al.  Graphs versus tables: Effects of data presentation format on judgemental forecasting , 1996 .

[32]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[33]  Liam J. Bannon,et al.  Implementing systems for supporting management decisions: concepts, methods and experiences , 1996 .

[34]  Paul Goodwin,et al.  Correct or combine? Mechanically integrating judgmental forecasts with statistical methods , 2000 .

[35]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[36]  Konstantinos Nikolopoulos,et al.  The process of using a forecasting support system , 2007 .

[37]  Danièle Thomassin Singh,et al.  Incorporating cognitive aids into decision support systems: the case of the strategy execution process , 1998, Decision Support Systems.

[38]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[39]  P. George Benson,et al.  The effects of feedback and training on the performance of probability forecasters , 1992 .

[40]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[41]  Robert Fildes,et al.  Influence of user participation on DSS use and decision accuracy , 2002 .

[42]  Robert Fildes,et al.  Forecasting competitions - their role in improving forecasting practice and research , 2007 .

[43]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[44]  P. Goodwin Improving the voluntary integration of statistical forecasts and judgment , 2000 .

[45]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[46]  Fred D. Davis,et al.  User Perceptions of Decision Support Effectiveness: Two Production Planning Experiments * , 1994 .

[47]  Randall L. Schultz The implementation of forecasting models , 1984 .

[48]  Peter Stecher,et al.  Incorporating cognitive aids into decision support systems: the case of the strategy execution process , 1986 .

[49]  Robert E. Hastings,et al.  The Organization and Improvement of Market Forecasting , 1994 .

[50]  Joa Sang Lim,et al.  Judgmental forecasting with interactive forecasting support systems , 1996, Decis. Support Syst..

[51]  Izak Benbasat,et al.  Evaluating the Impact of DSS, Cognitive Effort, and Incentives on Strategy Selection , 1999, Inf. Syst. Res..

[52]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[53]  Robert Fildes,et al.  Forecasting Systems for Production and Inventory Control , 1992 .

[54]  M. Doherty,et al.  Effects of cognitive feedback on performance. , 1989 .

[55]  Feng Wang,et al.  On the effectiveness of decisional guidance , 1996, Decis. Support Syst..

[56]  R. H. Edmundson,et al.  The accuracy of combining judgemental and statistical forecasts , 1986 .

[57]  Bijan Fazlollahi,et al.  The Effectiveness of Decisional Guidance: An Empirical Evaluation , 2001, Decis. Sci..

[58]  H. Arkes,et al.  Two methods of reducing overconfidence , 1987 .

[59]  P. Goodwin,et al.  Improving judgmental time series forecasting: A review of the guidance provided by research , 1993 .

[60]  B Kleinmuntz,et al.  Why we still use our heads instead of formulas: toward an integrative approach. , 1990, Psychological bulletin.

[61]  Robert Fildes,et al.  Judgmental forecasts of time series affected by special events: does providing a statistical forecast improve accuracy? , 1999 .

[62]  Peter J. Danaher,et al.  Principles of forecasting , 2001 .

[63]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[64]  Paul Goodwin,et al.  Integrating management judgment and statistical methods to improve short-term forecasts , 2002 .

[65]  Michael R. Donihue Evaluating the role judgment plays in forecast accuracy , 1993 .

[66]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[67]  R. H. Edmundson Decomposition; a strategy for judgemental forecasting , 1990 .

[68]  Kenneth R. Hammond,et al.  Negative effects of outcome-feedback in multiple-cue probability learning. , 1973 .

[69]  Michael Lawrence,et al.  Judgmental Time-Series Forecasting Using Domain Knowledge , 2001 .

[70]  S. Oskamp OVERCONFIDENCE IN CASE-STUDY JUDGMENTS. , 1965, Journal of consulting psychology.

[71]  Donald R. Jones,et al.  The division of labor between human and computer in the presence of decision support system advice , 2002, Decis. Support Syst..

[72]  Michael P. Clements,et al.  A companion to economic forecasting , 2004 .

[73]  P. F. Taylor,et al.  Short Term Forecasting: Horses for Courses , 1982 .

[74]  Efraim Turban,et al.  Decision Support and Expert Systems: Management Support Systems , 1990 .