Effect of Shared Information on Trust and Reliance in a Demand Forecasting Task

People have difficulty relying on forecasting systems appropriately, which can lead to huge business losses. Sharing information regarding the performance of forecasting systems may lead to more appropriate trust and reliance. This study considered imperfect forecasting systems and investigated how sharing such information influences people's trust and reliance. A simulated demand forecasting task required participants to provide an initial forecast, select and view a model forecast, and then determine their final forecast. Results showed that participants' reliance on a forecasting model strongly depended on their trust in the model, which was often inappropriate. With shared information, participants' reliance was more sensitive to changes of their trust in the model. However, when the shared information exposed instances of poor performance of the model, it diminished compliance with the selected model forecast, which undermined the accuracy of the final forecasts. These results suggest that sharing information may promote more appropriate reliance in situations in which people over trust automation, but not in situations in which people tend to under trust automation.

[1]  Ji Gao,et al.  Extending the decision field theory to model operators' reliance on automation in supervisory control situations , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  John D. Lee,et al.  Trust, Information Technology, and Cooperation in Supply Chains , 2005 .

[3]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[4]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[5]  Robert Fildes,et al.  Influence of user participation on DSS use and decision accuracy , 2002 .

[6]  Michael Lawrence,et al.  A field study of sales forecasting accuracy and processes , 2000, Eur. J. Oper. Res..

[7]  P. Goodwin Improving the voluntary integration of statistical forecasts and judgment , 2000 .

[8]  Michael Lawrence,et al.  Prototyping a financial DSS , 1999 .

[9]  Robert Fildes,et al.  Judgmental forecasts of time series affected by special events: does providing a statistical forecast improve accuracy? , 1999 .

[10]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[11]  L J Skitka,et al.  Automation bias: decision making and performance in high-tech cockpits. , 1997, The International journal of aviation psychology.

[12]  Joa Sang Lim,et al.  Judgmental forecasting with interactive forecasting support systems , 1996, Decis. Support Syst..

[13]  M. O'Connor,et al.  Judgemental adjustment of initial forecasts: Its effectiveness and biases , 1995 .

[14]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[15]  Jeffrey Jarrett Business Forecasting Methods , 1987 .

[16]  J. Rotter A new scale for the measurement of interpersonal trust. , 1967, Journal of personality.