PROCESS TRACING METHODS IN THE DECISION SCIENCES: A Com paris ion and Review of Methods

The complex interaction of a decision maker, performing a particular decision task, using a specific decision aid permits to many factors to influence the decision making process and hence the performance of the user. To help better understand the complex interaction of these factors, the use of process tracing methods is suggested. While the application of process tracing methods has increased significantly in the last decade they are still sparingly used and not particularly well understood. This paper provides an overview of several process tracing methods and their application in the decision sciences. The methods are compared and contrasted based on a set of attributes relating to their applicability, informativeness, validity and utility. Some suggestions are also provided for the successful application of process tracing methods.

[1]  Izak Benbasat,et al.  An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies , 1991, Inf. Syst. Res..

[2]  Izak Benbasat,et al.  The Use of Information in Decision Making: An Experimental Investigation of the Impact of Computer-Based Decision Aids , 1992, MIS Q..

[3]  J. Ford,et al.  Process tracing methods: Contributions, problems, and neglected research questions , 1989 .

[4]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[5]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[6]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[7]  Peter A. White,et al.  Limitations on verbal reports of internal events: A refutation of Nisbett and Wilson and of Bem. , 1980 .

[8]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[9]  Andrew J. Rosman,et al.  Methodological issues in judgment and decision-making research: Concurrent verbal protocol validity and simultaneous traces of process. , 1993 .

[10]  Joyce J. Elam,et al.  A Comparative Study of How Experts and Novices Use a Decision Aid to Solve Problems in Complex Knowledge Domains , 1992, Inf. Syst. Res..

[11]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[12]  A. Newell.  ON THE ANALYSIS OF HUMAN PROBLEM SOLVING PROTOCOLS , 1966 .

[13]  Marinus J. Bouwman.  Human Diagnostic Reasoning by Computer: An Illustration from Financial Analysis , 1983 .

[14]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[15]  Gary J. Cook,et al.  A Computerized Approach to Decision Process Tracing for Decision Support System Design , 1993 .

[16]  Imran A. Zualkernan,et al.  Specification for Expertise , 1987, Int. J. Man Mach. Stud..

[17]  Joyce J. Elam,et al.  Can Software Influence Creativity? , 1990, Inf. Syst. Res..

[18]  J. Payne,et al.  Exploring predecisional behavior: An alternative approach to decision research , 1978 .

[19]  David M. Schweiger,et al.  Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making , 1983 .

[20]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[21]  H. Simon,et al.  Information Processing Models of Cognition , 1979 .

[22]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[23]  N. Pennington,et al.  Inside the Jury. , 1985 .

[24]  I. Benbasat,et al.  The Influence of Decision Aids on Choice Strategies: An Experimental Analysis of the Role of Cognitive Effort , 1994 .

[25]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[26]  Larry D. Rosen,et al.  An eye fixation analysis of multialternative choice , 1975, Memory & cognition.

[27]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[28]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[29]  D. Kahneman,et al.  Attention and Effort , 1973 .

[30]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .