Three paradigms for viewing decision biases

Decisions can, and do, go wrong: a doctor misdiagnoses a patient's illness; a new product fails in the marketplace; a military commander mistakenly engages a civilian aircraft. Undesirable outcomes, however, do not necessarily imply faulty decision making; consider General Hod's decision to shoot down a Libyan airliner (described at the end of the last chapter). Even though the aircraft turned out not to be on a hostile mission, his conclusion that it was hostile might have been justified by the information he had at the time, by his efforts to gather further relevant data, and by the costs of a terrorist incident. It can also happen, of course, that a bad decision works out well. It is natural, then, for psychologists to look for a way of evaluating the decision itself, or the process that led to the decision, as distinct from its outcomes: to point, for example, at false prior beliefs, inappropriate priorities, shaky inferences from data, or even logical inconsistencies, rather than simply a bad outcome. A widely accepted research paradigm in psychology (e.g., Kahneman, Slovic, and Tversky, 1982) has taken Bayesian decision theory as the standard by which reasoning is to be judged, and has identified pervasive patterns of error, called biases, in laboratory performance. According to these researchers, unaided decision processes employ rules of thumb (or "heuristics") that under many (but not all) conditions lead to "severe and systematic errors" (Tversky and Kahneman, 1974). The bottom line of this research has been a rather pessimistic view of human reasoning. To illustrate, let us extrapolate some of the laboratory results on biases and their interpretation to a hypothetical physician: ! In assessing the probability that she will encounter cases of diseases A, B, and C among her patients, the physician may rely on the ease with which she can recall or imagine instances of each disease. This is the so-called "availability heuristic", postulated by Tversky and Kahneman (1973). Availability may be influenced by factors like the recency or salience of the physician's own experiences, which do not reflect the true relative frequencies of the diseases in the relevant population. ! In estimating a quantity, such as the required length of treatment for disease B, the doctor may first generate her best guess, then adjust it upwards and downwards to allow for uncertainty, e.g., 10 days plus or minus 2. This is the "anchoring and adjustment" heuristic. According …

[1]  Stephen P. Stich,et al.  Justification and the Psychology of Human Reasoning , 1980, Philosophy of Science.

[2]  John D. Bransford,et al.  The abstraction of linguistic ideas , 1971 .

[3]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[4]  H. Jungermann The Two Camps on Rationality , 1983 .

[5]  N. Pennington,et al.  Explanation-based decision making: effects of memory structure on judgment , 1988 .

[6]  G. Shafer Jeffrey's Rule of Conditioning , 1981, Philosophy of Science.

[7]  R. Dawkins Adaptationism was always predictive and needed no defense , 1983, Behavioral and Brain Sciences.

[8]  N. Goodman Fact, Fiction, and Forecast , 1955 .

[9]  Detlof von Winterfeldt,et al.  Flat Maxima in Linear Optimization Models , 1973 .

[10]  W. Thorngate Efficient decision heuristics. , 1980 .

[11]  Ann L. Brown,et al.  Skills, plans, and self-regulation , 1978 .

[12]  Herbert A Simon,et al.  The understanding process: Problem isomorphs , 1976, Cognitive Psychology.

[13]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[14]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[15]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  Marvin S. Cohen An Expert System Framework for Non-monotonic Reasoning About Probabilistic Assumptions , 1985, UAI.

[17]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[18]  B. D. Finetti,et al.  Foresight: Its Logical Laws, Its Subjective Sources , 1992 .

[19]  D. E. Bell,et al.  Decision Making: DESCRIPTIVE, NORMATIVE, AND PRESCRIPTIVE INTERACTIONS IN DECISION MAKING , 1988 .

[20]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[21]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[22]  Berndt Brehmer,et al.  New directions in research on decision making , 1986 .

[23]  Howard Raiffa,et al.  Decision analysis: introductory lectures on choices under uncertainty. 1968. , 1969, M.D.Computing.

[24]  J. Baron,et al.  Heuristics and biases in diagnostic reasoning: II. Congruence, information, and certainty☆ , 1988 .

[25]  Simon French,et al.  Decision Making: Descriptive, Normative, and Prescriptive Interactions , 1990 .

[26]  Richard Scheines,et al.  Discovering Causal Structure: Artificial Intelligence, Philosophy of Science, and Statistical Modeling , 1987 .

[27]  Richard Bellman,et al.  On the Analytic Formalism of the Theory of Fuzzy Sets , 1973, Inf. Sci..

[28]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[29]  Wayne Lee,et al.  Decision theory and human behavior , 1971 .

[30]  Patrick Suppes,et al.  Decision Making: An Experimental Approach , 1959 .

[31]  L. R. Goldberg Simple models or simple processes? Some research on clinical judgments. , 1968, The American psychologist.

[32]  B. Fischhoff,et al.  Hypothesis Evaluation from a Bayesian Perspective. , 1983 .

[33]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[34]  Paul E. Lehner,et al.  Effects of Early Decisions on Later Judgments in an Evolving Situation. , 1995 .

[35]  J. March Bounded rationality, ambiguity, and the engineering of choice , 1978 .

[36]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[37]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[38]  Marvin S. Cohen,et al.  Influence of Uncertainty and Time Stress on Decision Making , 1993 .

[39]  M. Sebrechts Ignorance and Uncertainty: Emerging Paradigms , 1989 .

[40]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[41]  Joseph B. Kadane,et al.  A Subjectivist View of Calibration. , 1982 .

[42]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[43]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[44]  G. Gigerenzer,et al.  Cognition as Intuitive Statistics , 1987 .

[45]  Eugene Borgida,et al.  Judgment under uncertainty: Popular induction: Information is not necessarily informative , 1982 .

[46]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[47]  Christopher Cherniak,et al.  Minimal Rationality , 1986, Computational models of cognition and perception.

[48]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[49]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[50]  D. Kuhn,et al.  The development of scientific thinking skills , 1988 .

[51]  A. D. D. Groot Thought and Choice in Chess , 1978 .

[52]  David E. Bell,et al.  Disappointment in Decision Making Under Uncertainty , 1985, Oper. Res..

[53]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[54]  G. Brier,et al.  External correspondence: Decompositions of the mean probability score , 1982 .

[55]  David Noble,et al.  A Theory of Information Presentation for Distributed Decision Making , 1989 .

[56]  Spyros Makridakis,et al.  Forecasting and Planning: An Evaluation , 1981 .

[57]  Thomas S. Wallsten,et al.  The Theoretical Status of Judgmental Heuristics1) , 1983 .

[58]  J. Shanteau COGNITIVE HEURISTICS AND BIASES IN BEHAVIORAL AUDITING: REVIEW, COMMENTS AND OBSERVATIONS , 1989 .

[59]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[60]  B. Fischhoff,et al.  Subjective sensitivity analysis. , 1979 .

[61]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[62]  Ulvila Jw,et al.  Decision analysis comes of age. , 1982 .

[63]  Glenn Shafer,et al.  Languages and Designs for Probability Judgment , 1985, Cogn. Sci..

[64]  R. Luce,et al.  The Choice Axiom after Twenty Years , 1977 .

[65]  J. Bruner On perceptual readiness. , 1957, Psychological review.

[66]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[67]  Alf Zimmer,et al.  Verbal Vs. Numerical Processing of Subjective Probabilities , 1983 .

[68]  Kenneth R Hammond,et al.  Judgement and Decision Making in Dynamic Tasks , 1988 .

[69]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[70]  A. Tversky Additivity, utility, and subjective probability , 1967 .

[71]  I. Levi Hard Choices: Decision Making under Unresolved Conflict , 1986 .

[72]  Martin A. Tolcott,et al.  Reducing the Confirmation Bias in an Evolving Situation. , 1995 .

[73]  Lee Roy Beach,et al.  Normative models in the study of cognition , 1971 .

[74]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[75]  M. Bar-Hillel The base-rate fallacy in probability judgments. , 1980 .

[76]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[77]  G. Huber Managerial decision making , 1980 .

[78]  A. Tversky,et al.  On the study of statistical intuitions , 1982, Cognition.

[79]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[80]  C. Lindblom THE SCIENCE OF MUDDLING THROUGH , 1959 .

[81]  Stephen J. Hoch,et al.  Cue redundancy and extra logical inferences in a deductive reasoning task , 1983, Memory & cognition.

[82]  Roger W. Berger Implementing Decision Analysis on Digital Computers , 1972 .

[83]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[84]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[85]  The Rationality of Intelligence , 1991, Probability and Rationality.

[86]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[87]  M. Birnbaum Base Rates in Bayesian Inference: Signal Detection Analysis of the Cab Problem , 1983 .

[88]  P. Horwich Probability and Evidence , 1972 .

[89]  Marvin S. Cohen,et al.  A Personalized and Prescriptive Decision Aid. , 1982 .

[90]  R. W. Marks,et al.  The effect of probability, desirability, and "privilege" on the stated expectations of children. , 1951, Journal of personality.

[91]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[92]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[93]  Jon Doyle,et al.  A Truth Maintenance System , 1979, Artif. Intell..

[94]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[95]  H. J. Einhorn,et al.  Cognitive processes in choice and decision behavior , 1979 .

[96]  Lola L. Lopes Doing the impossible: A note on induction and the experience of randomness. , 1982 .

[97]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[98]  Detlof von Winterfeldt,et al.  Error in Decision Analysis: How to Create the Possibility of Large Losses by Using Dominated Strategies , 1975 .

[99]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[100]  Rex V. Brown,et al.  Toward a prescriptive science and technology of decision aiding , 1989 .

[101]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[102]  H. Zur,et al.  The effect of time pressure on risky choice behavior , 1981 .

[103]  Henry Montgomery,et al.  Decision Rules and the Search for a Dominance Structure: Towards a Process Model of Decision Making* , 1983 .

[104]  D. Dennett Intentional systems in cognitive ethology: The “Panglossian paradigm” defended , 1983, Behavioral and Brain Sciences.

[105]  P. N. Johnson Reasoning and a Sense of Reality. , 1972 .

[106]  T. E. Raphael,et al.  Metacognition, Instruction, and the Role of Questioning Activities , 1985 .

[107]  L. Beach,et al.  Man as an Intuitive Statistician , 2022 .

[108]  W. A. Wagenaar Generation of random sequences by human subjects: A critical survey of literature. , 1972 .

[109]  L. Beach,et al.  The citation bias: Fad and fashion in the judgment and decision literature. , 1984 .

[110]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[111]  Martin Edman The Probable and the Provable , 1980 .

[112]  David Lindley Scoring rules and the inevitability of probability , 1982 .

[113]  Baruch Fischhoff,et al.  Direct measures of availability and judgments of category frequency , 1977 .

[114]  A. Greenwald,et al.  Under what conditions does theory obstruct research progress? , 1986, Psychological review.

[115]  Herbert A. Simon,et al.  THE MIND'S EYE IN CHESS , 1988 .

[116]  R R Macdonald,et al.  Credible conceptions and implausible probabilities. , 1986, The British journal of mathematical and statistical psychology.

[117]  Simon French Decision, Probability and Utility: Selected Readings , 1989 .

[118]  Baruch Fischhoff,et al.  Predicting Frames , 1983 .

[119]  Norman H. Anderson,et al.  A ratio rule from integration theory applied to inference judgments , 1974 .

[120]  J A SWETS,et al.  Is there a sensory threshold? , 1961, Science.

[121]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[122]  A. Tversky,et al.  Causal Schemata in Judgments under Uncertainty , 1982 .

[123]  Norman Daniels,et al.  Wide Reflective Equilibrium and Theory Acceptance in Ethics , 1979 .

[124]  L. Cohen Can human irrationality be experimentally demonstrated? , 1981, Behavioral and Brain Sciences.

[125]  G. Murphy,et al.  The utility of theories in intuitive statistics: The robustness of theory-based judgments. , 1984 .

[126]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[127]  A. Tversky,et al.  Evidential impact of base rates , 1981 .

[128]  Robert P. Abelson,et al.  Conjunctive explanations: When two reasons are better than one. , 1984 .

[129]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[130]  Kathryn B. Laskey,et al.  A Personalized and Prescriptive Decision Aid for Choice from a Database of Options. , 1987 .

[131]  O. Svenson Process descriptions of decision making. , 1979 .

[132]  Eric J. Johnson,et al.  The Adaptive Decision-Maker : Effort and Accuracy in Choice , 2022 .

[133]  Stephen J. Hoch,et al.  Counterfactual reasoning and accuracy in predicting personal events. , 1985 .

[134]  A. E. Woodcock,et al.  I&W(Indications and Warning) Applications of Catastrophe Theory , 1988 .

[135]  Simon French,et al.  Updating of Belief in the Light of Someone Else's Opinion , 1980 .

[136]  Lola L. Lopes Some thoughts on the psychological concept of risk. , 1983 .

[137]  Peter Wright The harassed decision maker: Time pressures, distractions, and the use of evidence. , 1974 .

[138]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[139]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[140]  Keith J Holyoak,et al.  Pragmatic reasoning schemas , 1985, Cognitive Psychology.

[141]  Rex V. Brown,et al.  Decision Analysis for the Manager , 1974 .

[142]  L. Beach,et al.  A Contingency Model for the Selection of Decision Strategies , 1978 .

[143]  P. Thagard,et al.  Computational Philosophy of Science , 1988 .

[144]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[145]  A. Tversky,et al.  Who accepts Savage's axiom? , 1974 .

[146]  C. R. Fay The Aim and Structure of Physical Theory , 1958 .

[147]  L. Cohen,et al.  The controversy about irrationality , 1983, Behavioral and Brain Sciences.

[148]  D. Ellsberg Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .