A Comparative Evaluation of Belief Revision Models in Auditing

External auditors typically gather audit evidence in a sequential fashion and revise their estimates of likelihood of material misstatements based on the evidence collected. Optimal utilization of audit evidence can help control audit risk and improve audit efficiency and effectiveness. This paper first shows how a typical audit risk assessment and belief revision task can be modeled using four theoretical models of belief revision. Then the descriptive properties of these models are evaluated based on the actual judgments of experienced auditors who assessed the likelihood of error in a task involving inventory valuation. A realistic audit case was administered to 101 experienced auditors. Models based on the following theories were evaluated: a version of Bayesian inference labeled Cascaded Inference Theory (Schum 1987; Schum and DuCharme 1971), two versions of the Belief Adjustment Model (Hogarth and Einhorn 1992), and a version of the Dempster‐Shafer Theory of Belief Functions (Srivastava and Shafer 1...

[1]  John W. Payne,et al.  Effort and Accuracy in Choice , 1985 .

[2]  H. A. Taylor,et al.  The conjunction fallacy? , 1990, Memory & cognition.

[3]  K. Yuen,et al.  The two-sample trimmed t for unequal population variances , 1974 .

[4]  David A. Schum,et al.  Evidence and inference for the intelligence analyst , 1987 .

[5]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[6]  B. Fischhoff,et al.  Hypothesis Evaluation from a Bayesian Perspective. , 1983 .

[7]  J. S. Maritz,et al.  A Note on Estimating the Variance of the Sample Median , 1978 .

[8]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[9]  Cameron R. Peterson,et al.  Intuitive cascaded inferences , 1973 .

[10]  David A. Schum,et al.  Research on human multistage probabilistic inference processes , 1973 .

[11]  M. W. Nelson,et al.  Using Decision Aids to Improve Auditors' Conditional Probability Judgments , 1998 .

[12]  Paula C. Morrow,et al.  RISK ASSESSMENT JUDGMENTS OF AUDITORS AND BANK LENDERS: A COMPARATIVE ANALYSIS OF CONFORMANCE... , 1992 .

[13]  Thomas Kida,et al.  Heuristics and biases: Expertise and task realism in auditing. , 1991 .

[14]  Edward J. Joyce,et al.  Are Auditors' Judgments Sufficiently Regressive? , 1981 .

[15]  Theodore J. Mock,et al.  Auditor's probabilistic reasoning in a multi-stage risk assessment task , 1990 .

[16]  Loren L. Margheim.  Further Evidence On External Auditors Reliance On Internal Auditors , 1986 .

[17]  David A. Schum,et al.  Comments on the relationship between the impact and the reliability of evidence , 1971 .

[18]  Robert H. Ashton,et al.  Evidence-responsiveness in professional judgment: Effects of positive versus negative evidence and presentation mode , 1990 .

[19]  Rand R. Wilcox,et al.  New Statistical Procedures for the Social Sciences. , 1989 .

[20]  Shawn P. Curley,et al.  Using Belief Functions to Represent Degrees of Belief , 1994 .

[21]  Arnold Schneider,et al.  Modeling External Auditors' Evaluations of Internal Auditing , 1984 .

[22]  Thomas Kida,et al.  The Impact of Analytical Review Results, Internal Control Reliability, and Experience on Auditors' Use of Analytical Review , 1989 .

[23]  M. W. Nelson,et al.  Knowledge structure and the estimation of conditional probabilities in audit planning , 1995 .

[24]  Eric J. Johnson,et al.  A componential analysis of cognitive effort in choice , 1990 .

[25]  R. Hogarth,et al.  Order effects in belief updating: The belief-adjustment model , 1992, Cognitive Psychology.

[26]  J. Efrim Boritz,et al.  An experimental study of review of preliminary audit strategy by external auditors , 1987 .

[27]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[28]  Reid Hastie,et al.  Revision of beliefs when a hypothesis is eliminated from consideration. , 1985 .

[29]  R. P. Srivastava,et al.  The belief‐function approach to aggregating audit evidence , 1995, Int. J. Intell. Syst..

[30]  Reid Hastie,et al.  Tracing the footsteps of Sherlock Holmes: Cognitive representations of hypothesis testing , 1990, Memory & cognition.

[31]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[32]  E. Bamber,et al.  Expert Judgment in the Audit Team: A Source Reliability Approach , 1983 .

[33]  Arnold M. Wright,et al.  Evaluation of Competing Hypotheses in Auditing , 1997 .

[34]  D. Johnstone,et al.  Sample Size and the Strength of Evidence: A Bayesian Interpretation of Binomial Tests of the Information Content of Qualified Audit Reports , 1990 .

[35]  Prakash P. Shenoy,et al.  A valuation-based language for expert systems , 1989, Int. J. Approx. Reason..

[36]  D. Hirst,et al.  Auditors Sensitivity To Source Reliability , 1994 .

[37]  R. P. Srivastava,et al.  The Bayesian and belief-function formalisms a general perspective for auditing , 1990 .

[38]  William F. Messier,et al.  A Review of Audit Research Using the Belief-Adjustment Model , 1991 .

[39]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[40]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[41]  Glenn Shafer,et al.  Languages and Designs for Probability Judgment , 1985, Cogn. Sci..

[42]  I. Benbasat,et al.  The Influence of Decision Aids on Choice Strategies: An Experimental Analysis of the Role of Cognitive Effort , 1994 .

[43]  Alvin A. Arens,et al.  Auditing: An Integrated Approach , 1976 .

[44]  Jeffrey E. Kottemann,et al.  Decisional Conflict and User Acceptance of Multicriteria Decision-Making Aids , 1991 .