Bennefits of Decision Support Tools for Users with Differing Levels of Domain Expertese

When designing decision support systems (DSSs) to support complex cognitive problem solving tasks, it is important to understand what classes of users (domain novices, intermediates or experts) are likely to benefit from it, and conversely, what types of benefits can one expect a given class of users (such as domain novices or experts) will derive. Unfortunately, this is not yet well understood. In this paper we examine a specific class of DSSs which assist users by generating solution options. We compared the results of this class of DSS for four domains and found that they tend to increase novices’ solution quality more than experts’, and that increase may come at the cost of more total time required to produce solutions (although this is not always the case.) Additionally, in an animal nutrition domain, we found that both experts and novices (particularly experts) tended to insist on detrimentally modifying computer generated solutions even when those solutions started out with very high quality. Lastly we discuss possible explanations and implications for DSS design.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  E. William East,et al.  SEDAR: Expert Critiquing System for Flat and Low-Slope Roof Design and Review , 1997 .

[3]  Philip J. Smith,et al.  Brittleness in the design of cooperative problem-solving systems: the effects on user performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Hasler Rudy Hayes,et al.  Three problems in teaching general skills , 1985 .

[5]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[6]  David E. Goldberg,et al.  FOX-GA: A Genetic Algorithm for Generating and Analyzing Battlefield Courses of Action , 1999, Evolutionary Computation.

[7]  H. Simon,et al.  A simulation of memory for chess positions. , 1973 .

[8]  Adam D. Larson,et al.  An Assessment of Weasel: A Decision Support System to Assist in Military Planning , 2005 .

[9]  Caroline C. Hayes,et al.  Weasel: an automated planner that users can guide , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[10]  Jonathan Grudin,et al.  Why CSCW applications fail: problems in the design and evaluationof organizational interfaces , 1988, CSCW '88.

[11]  David C. Wilkins,et al.  Readings in Knowledge Acquisition and Learning: Automating the Construction and Improvement of Expert Systems , 1992 .

[12]  Caroline C. Hayes,et al.  DAISY: a decision support design methodology for complex, experience-centered domains , 2002, IEEE Trans. Syst. Man Cybern. Part A.