Unveiling the black box of human-computer interaction: The need for replay process tracing in decision aid research

The extant accounting behavioral research related to decision aid impacts on user's decision-making has been limited over time due to the focus on decision outcomes to the neglect of the underlying decision processes and strategies. A primary barrier in moving the decision aid literature forward into the exploration of the black boxof human-computer interaction is the paucity of methods for accurately capturing the interaction process. This paper presents a conceptualization of a technique we refer to as replay process tracing that allows the researcher to recreate the precise session that a user has participated in with a decision aid. We subsequently operationalize this conceptualization through a working prototype model with advanced replay process tracing functionality.

[1]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[2]  Eric J. Johnson,et al.  Information displays and preference reversals , 1988 .

[3]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[4]  Gerald L. Lohse,et al.  A Comparison of Two Process Tracing Methods for Choice Tasks , 1996 .

[5]  Nicole Clark,et al.  A validated expert system for decision making in corporate recovery , 1999, Intell. Syst. Account. Finance Manag..

[6]  George M. Kasper,et al.  A Theory of Decision Support System Design for User Calibration , 1996, Inf. Syst. Res..

[7]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[8]  Gary J. Cook,et al.  A Computerized Approach to Decision Process Tracing for Decision Support System Design , 1993 .

[9]  Steven M. Glover,et al.  The Influence of Decision Aids on User Behavior: Implications for Knowledge Acquisition and Inappropriate Reliance , 1997 .

[10]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[11]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[12]  M. W. Nelson,et al.  Using Decision Aids to Improve Auditors' Conditional Probability Judgments , 1998 .

[13]  Buck K.W. Pei,et al.  The Effects of Decision Consequences on Auditors' Reliance on Decision Aids in Audit Planning☆☆☆ , 1997 .

[14]  Izak Benbasat,et al.  Contextualized access to knowledge: theoretical perspectives and a process‐tracing study , 1998, Inf. Syst. J..

[15]  Matthew J. Anderson,et al.  Some Evidence On The Effect Of Verbalization On Process - A Methodological Note , 1985 .

[16]  Robert Libby,et al.  Accounting and human information processing : theory and applications , 1981 .

[17]  Nicole Clark,et al.  A generalized model of decision‐making processes for companies in financial distress , 1999 .

[18]  Robert H. Ashton,et al.  Effects of justification and a mechanical aid on judgment performance , 1992 .

[19]  Donald R. Jones,et al.  Factors that influence reliance on decision aids: a model and an experiment , 1998 .

[20]  Izak Benbasat,et al.  An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies , 1991, Inf. Syst. Res..

[21]  J. Bettman,et al.  Effects of Information Presentation Format on Consumer Information Acquisition Strategies , 1977 .