Wisdom of group forecasts: Does role-playing play a role?

Forecasting plays a special role in supply chain management with sales forecasts representing one of the key drivers for collaborative planning and decision making in the organisations involved. We review the important role played by judgemental forecasts in this area, focusing on group predictions. Noting the scarcity of research using group forecasts, we present the results of an experiment where consensus forecasts are elicited from structured groups with and without role-playing. Comparisons with groups without any assigned roles show that getting into tailored organisational roles does have a significant effect in the resultant forecasts. In particular, members of the role-playing groups show less agreement with consensus forecasts and display a strong commitment to their assumed roles and scripts. Furthermore, role-playing groups leave a higher percentage of model-based forecasts unadjusted and when they do make an adjustment, it is significantly less than the groups, whose members are not assigned roles. Differences between the role-playing conditions are interpreted as highlighting the importance of role framing on forecast adjustment and group forecasting behaviour. Future research directions are proposed to improve the accuracy and acceptance of group forecasts.

[1]  Robert Fildes,et al.  Restrictiveness and guidance in support systems , 2011 .

[2]  Jinxing Xie,et al.  Production, Manufacturing and Logistics The impact of forecasting model selection on the value of information sharing in a supply chain , 2002 .

[3]  Srinivasan Raghunathan.  Interorganizational Collaborative Forecasting and Replenishment Systems and Supply Chain Implications , 1999 .

[4]  Marshall L. Fisher,et al.  Estimating Demand Uncertainty Using Judgmental Forecasts , 2007, Manuf. Serv. Oper. Manag..

[5]  Erika D Peterson,et al.  Collective Efficacy and Aspects of Shared Mental Models as Predictors of Performance Over Time in Work Groups , 2000 .

[6]  Charles E. Miller,et al.  Some social psychological effects of group decision rules. , 1987 .

[7]  William H. Starbuck,et al.  Two Experiments on Bias and Conflict in Organizational Estimation , 1961 .

[8]  Reeshad S. Dalal,et al.  The effects of member expertise on group decision-making and performance , 2002 .

[9]  Janet A. Sniezek,et al.  Revision, Weighting, and commitment in consensus group judgment , 1990 .

[10]  David L. Ronis,et al.  Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. , 1987 .

[11]  J. Scott Armstrong.  The Forecasting Dictionary Updated : October 23 , 2000 , .

[12]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[13]  J. Mathieu,et al.  Scaling the quality of teammates' mental models: equifinality and normative comparisons , 2005 .

[14]  Fei Song,et al.  Trust and reciprocity behavior and behavioral forecasts: Individuals versus group-representatives , 2008, Games Econ. Behav..

[15]  Robert Fildes,et al.  Influence of user participation on DSS use and decision accuracy , 2002 .

[16]  Jacinto González-Pachón,et al.  The design of socially optimal decisions in a consensus scenario , 2011 .

[17]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[18]  Michael Lawrence,et al.  Influence of differentiated roles on group forecasting accuracy , 2011 .

[19]  Bryan L. Bonner,et al.  Collective estimation: Accuracy, expertise, and extroversion as sources of intra-group influence , 2007 .

[20]  Nada R. Sanders,et al.  Accuracy of judgmental forecasts: A comparison , 1992 .

[21]  David H. Krantz,et al.  From Individual Preference Construction to Group Decisions: Framing Effects and Group Processes , 2009 .

[22]  J. Scott Armstrong,et al.  Role thinking: Standing in other people’s shoes to forecast decisions in conflicts , 2009 .

[23]  Marcus O'Connor,et al.  The effect of group interaction processes on performance in time series extrapolation , 1991 .

[24]  Xiaolong Zhang.  The impact of forecasting methods on the bullwhip effect , 2004 .

[25]  Vassilios P. Filios.  Where Should be the Trends in Current Accounting Research , 1992 .

[26]  Nada R. Sanders,et al.  Quantifying costs of forecast errors: A case study of the warehouse environment☆ , 2009 .

[27]  Aris A. Syntetos,et al.  Classification for forecasting and stock control: a case study , 2008, J. Oper. Res. Soc..

[28]  G. Stasser,et al.  Information salience and the discovery of hidden profiles by decision-making groups: A “thought experiment”☆ , 1992 .

[29]  N. John Castellan,et al.  Individual and group decision making : current issues , 2013 .

[30]  Paul B. Paulus,et al.  Psychology of Group Influence , 1981 .

[31]  Michael Lawrence,et al.  A field study of sales forecasting accuracy and processes , 2000, Eur. J. Oper. Res..

[32]  J. Scott Armstrong,et al.  Assessing Game Theory, Role Playing, and Unaided Judgment , 2002 .

[33]  Rick H. Hoyle,et al.  Individual versus group discontinuity: The role of intergroup contact. , 1987 .

[34]  R. Fildes,et al.  Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning , 2009 .

[35]  C. H. Castore,et al.  Determinants of support for group decisions , 1978 .

[36]  Tyzoon T. Tyebjee,et al.  Optimistic Capital Budgeting Forecasts: An Experiment , 1985 .

[37]  Ronald A. Howard,et al.  Decision analysis: practice and promise , 1988 .

[38]  George Loewenstein,et al.  Biased Judgments of Fairness in Bargaining , 1995 .

[39]  R. Fildes,et al.  The effects of integrating management judgement into intermittent demand forecasts , 2009 .

[40]  J. Boylan,et al.  The accuracy of intermittent demand estimates , 2005 .

[41]  Michael Lawrence,et al.  Judgmental Adjustments of Previously Adjusted Forecasts , 2008, Decis. Sci..

[42]  Paul Goodwin,et al.  Expectations, use and judgmental adjustment of external financial and economic forecasts: an empirical investigation , 2009 .

[43]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[44]  Kesten C. Green,et al.  Forecasting Decisions in Conflict Situations: A Comparison of Game Theory, Role-playing, and Unaided Judgement , 2002 .

[45]  Joseph S. Valacich,et al.  Understanding risk-taking behavior of groups: A "decision analysis" perspective , 2009, Decis. Support Syst..

[46]  Rebecca A. Henry,et al.  Accuracy and confidence in group judgment , 1989 .

[47]  Janet A. Sniezek,et al.  An examination of group process in judgmental forecasting , 1989 .

[48]  Alan R. Dennis,et al.  Information Exchange and Use in Group Decision Making: You Can Lead a Group to Information, but You Can't Make It Think , 1996, MIS Q..

[49]  P. Goodwin,et al.  Judgmental forecasting: A review of progress over the last 25 years , 2006 .

[50]  Mary E. Thomson,et al.  The relative influence of advice from human experts and statistical methods on forecast adjustments , 2009 .

[51]  Nada R. Sanders.  Comments on "Effective forecasting and judgmental adjustments: An empirical evaluation and strategies for improvement in supply-chain planning" , 2009 .

[52]  Prem Vrat,et al.  Information distortion in a supply chain and its mitigation using soft computing approach , 2009 .

[53]  Bryan L. Bonner,et al.  The effects of variability and expectations on utilization of member expertise and group performance , 2004 .

[54]  Peter Ayton,et al.  Subjective confidence in forecasts: A response to fischhoff and MacGregor , 1986 .

[55]  Dilek Önkal,et al.  Judgmental Adjustment: A Challenge for Providers and Users of Forecasts , 2005 .

[56]  Robert Fildes,et al.  The design features of forecasting support systems and their effectiveness , 2006, Decis. Support Syst..