Process Tracing Methods in the Decision Sciences

The complex interaction of a decision maker, performing a particular decision task, using a specific decision aid permits to many factors to influence the decision making process and hence the performance of the user. To help better understand the complex interaction of these factors, the use of process tracing methods is suggested. While the application of process tracing methods has increased significantly in the last decade they are still sparingly used and not particularly well understood. This paper provides an overview of several process tracing methods and their application in the decision sciences. The methods are compared and contrasted based on a set of attributes relating to their applicability, informativeness, validity and utility. Some suggestions are also provided for the successful application of process tracing methods.

[1]  I. Benbasat,et al.  The Influence of Decision Aids on Choice Strategies: An Experimental Analysis of the Role of Cognitive Effort , 1994 .

[2]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[3]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[4]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[5]  Izak Benbasat,et al.  An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies , 1991, Inf. Syst. Res..

[6]  J. Ford,et al.  Process tracing methods: Contributions, problems, and neglected research questions , 1989 .

[7]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[8]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[9]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[10]  Joyce J. Elam,et al.  A Comparative Study of How Experts and Novices Use a Decision Aid to Solve Problems in Complex Knowledge Domains , 1992, Inf. Syst. Res..

[11]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[12]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[13]  D. Kahneman,et al.  Attention and Effort , 1973 .

[14]  Joyce J. Elam,et al.  Can Software Influence Creativity? , 1990, Inf. Syst. Res..

[15]  Izak Benbasat,et al.  An evaluation of empirical research in managerial support systems , 1990, Decis. Support Syst..

[16]  B. Dosher,et al.  Strategies for multiattribute binary choice. , 1983, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Peter A. White,et al.  Limitations on verbal reports of internal events: A refutation of Nisbett and Wilson and of Bem. , 1980 .

[18]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[19]  Izak Benbasat,et al.  The Use of Information in Decision Making: An Experimental Investigation of the Impact of Computer-Based Decision Aids , 1992, MIS Q..

[20]  J. Payne,et al.  Exploring predecisional behavior: An alternative approach to decision research , 1978 .

[21]  Larry D. Rosen,et al.  An eye fixation analysis of multialternative choice , 1975, Memory & cognition.

[22]  Roy O. Freedle,et al.  Artificial Intelligence and the Future of Testing , 1990 .

[23]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[24]  Gary J. Cook,et al.  A Computerized Approach to Decision Process Tracing for Decision Support System Design , 1993 .

[25]  David M. Schweiger,et al.  Is the simultaneous verbal protocol a viable method for studying managerial problem solving and decision making , 1983 .

[26]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[27]  H. Simon,et al.  Information Processing Models of Cognition , 1979 .

[28]  N. Pennington,et al.  Inside the Jury. , 1985 .

[29]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[30]  A. Newell.  ON THE ANALYSIS OF HUMAN PROBLEM SOLVING PROTOCOLS , 1966 .

[31]  Marinus J. Bouwman.  Human Diagnostic Reasoning by Computer: An Illustration from Financial Analysis , 1983 .

[32]  Imran A. Zualkernan,et al.  Specification for Expertise , 1987, Int. J. Man Mach. Stud..

[33]  Andrew J. Rosman,et al.  Methodological issues in judgment and decision-making research: Concurrent verbal protocol validity and simultaneous traces of process. , 1993 .