The effects of structural characteristics of explanations on use of a DSS

Research in the field of expert systems has shown that providing supporting explanations may influence effective use of system developed advice. However, despite many studies showing the less than optimal use made of DSS prepared advice, almost no research has been undertaken to study if the provision of explanations enhances the users' ability to wisely accept DSS advice. This study outlines an experiment to examine the effects of structural characteristics of explanations provided within a forecasting DSS context. In particular, the effects of explanation length (short vs. long) and the conveyed confidence level (weak vs. strong confidence) are examined. Strongly confident and long explanations are found to be more effective in participants' acceptance of interval forecasts. In addition, explanations with higher information value are more effective than those with low information value and thus are persuasive tools in the presentation of advice to users.

[1]  N. Harvey,et al.  Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility☆☆☆ , 1997 .

[2]  Robert Fildes,et al.  The design features of forecasting support systems and their effectiveness , 2006, Decis. Support Syst..

[3]  Robert Ramberg,et al.  People's Perception of Human and Computer Advice. , 1996 .

[4]  S. French,et al.  Forecasting with judgment , 1998 .

[5]  William Remus,et al.  Judgemental forecasting in times of change , 1993 .

[6]  Janet A. Sniezek,et al.  Trust, Confidence, and Expertise in a Judge-Advisor System. , 2001, Organizational behavior and human decision processes.

[7]  John Durkin.  Expert Systems: A View of the Field , 1996, IEEE Expert.

[8]  Shirley Gregor,et al.  Explanations from knowledge-based systems and cooperative problem solving: an empirical study , 2001, Int. J. Hum. Comput. Stud..

[9]  Fischer,et al.  Using Advice and Assessing Its Quality. , 2000, Organizational behavior and human decision processes.

[10]  Joa Sang Lim,et al.  Judgmental forecasting with time series and causal information , 1996 .

[11]  R. Ashton,et al.  Students As Surrogates In Behavioral Accounting Research - Some Evidence , 1980 .

[12]  L. Toledo-Pereyra.  Trust , 2006, Mediation Behaviour.

[13]  Izak Benbasat,et al.  Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice , 1999, MIS Q..

[14]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[15]  William Remus,et al.  Does reliable information improve the accuracy of judgmental forecasts , 1995 .

[16]  N Harvey,et al.  Taking advice, using information and knowing what you are doing. , 2000, Acta psychologica.

[17]  Izak Benbasat,et al.  The Use of Explanations in Knowledge-Based Systems: Cognitive Perspective and a Process-Tracing Analysis , 2000, J. Manag. Inf. Syst..

[18]  D Borley.  Taking advice. , 1999, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[19]  Izak Benbasat,et al.  The Use and Effects of Knowledge-Based System Explanations: Theoretical Foundations and a Framework for Empirical Evaluation , 1996, Inf. Syst. Res..

[20]  M. O'Connor,et al.  Judgemental adjustment of initial forecasts: Its effectiveness and biases , 1995 .

[21]  Paul Goodwin,et al.  Feedback-labelling synergies in judgmental stock price forecasting , 2004, Decis. Support Syst..

[22]  Efraim Turban,et al.  Decision support systems and intelligent systems , 1997 .

[23]  Ji-Ye Mao, Izak Benbasat,et al.  The Use of Explanations in Knowledge-Based Systems: Cognitive Perspectives and a Process-Tracing Analysis , 2000 .

[24]  Simon French,et al.  Explaining and justifying the advice of a decision support system: a natural language generation approach , 2003, Expert Syst. Appl..

[25]  Robert Fildes,et al.  Influence of user participation on DSS use and decision accuracy , 2002 .

[26]  Edward H. Shortliffe,et al.  Computer-based medical consultations, MYCIN , 1976 .

[27]  B Kleinmuntz,et al.  Why we still use our heads instead of formulas: toward an integrative approach. , 1990, Psychological bulletin.

[28]  M. O'Connor,et al.  Judgemental and statistical time series forecasting: a review of the literature , 1996 .

[29]  Marcus O'Connor,et al.  Judgmental forecasting in the presence of loss functions , 2005 .

[30]  Prashant Bordia,et al.  Rumor and Prediction: Making Sense (but Losing Dollars) in the Stock Market , 1997 .

[31]  L. Richard Ye,et al.  The Impact of Explanation Facilities in User Acceptance of Expert System Advice , 1995, MIS Q..

[32]  Larry Press,et al.  The global diffusion of the Internet: patterns and problems , 1994, CACM.

[33]  J. Wyatt.  Decision support systems. , 2000, Journal of the Royal Society of Medicine.

[34]  Fred D. Davis,et al.  Determinants of Decision Rule Use in a Production Planning Task , 1995 .

[35]  Frederick Hayes-Roth,et al.  The state of knowledge-based systems , 1994, CACM.

[36]  E. A. Locke,et al.  Generalizing From Laboratory to Field Settings. , 1987 .