Decision making under risk and uncertainty.

Decision making is studied from a number of different theoretical approaches. Normative theories focus on how to make the best decisions by deriving algebraic representations of preference from idealized behavioral axioms. Descriptive theories adopt this algebraic representation, but incorporate known limitations of human behavior. Computational approaches start from a different set of assumptions altogether, focusing instead on the underlying cognitive and emotional processes that result in the selection of one option over the other. This review comprehensively but concisely describes and contrasts three approaches in terms of their theoretical assumptions and their ability to account for behavioral and neurophysiological evidence from experimental research. Although each approach contributes substantially to our understanding of human decision making, we argue that the computational approach is more fruitful and parsimonious for describing and predicting choices in both laboratory and applied settings and for understanding the neurophysiological substrates of decision making. Copyright © 2010 John Wiley & Sons, Ltd. For further resources related to this article, please visit the WIREs website.

[1]  P. Slovic,et al.  The Construction of Preference: Index , 2006 .

[2]  N. Roese,et al.  The Functional Theory of Counterfactual Thinking , 2008, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[3]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[4]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[5]  Seungho Lee,et al.  An integrated human decision making model for evacuation scenarios under a BDI framework , 2010, TOMC.

[6]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[7]  R. Hastie,et al.  The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line , 1986 .

[8]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[9]  Gerd Gigerenzer,et al.  Risky choice with heuristics: reply to Birnbaum (2008), Johnson, Schulte-Mecklenbeck, and Willemsen (2008), and Rieger and Wang (2008). , 2008, Psychological review.

[10]  James T. Townsend,et al.  Building bridges between neural models and complex decision making behaviour , 2006, Neural Networks.

[11]  M. Yaari The Dual Theory of Choice under Risk , 1987 .

[12]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[13]  G. Grisetti,et al.  Further Reading , 1984, IEEE Spectrum.

[14]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[15]  M. Birnbaum,et al.  Organizational Behavior and Human Decision Processes Tests of Theories of Decision Making: Violations of Branch Independence and Distribution Independence Generic Rank-dependent Utility Generic Analysis of Violations of Branch Independence and Distribution Independence Birnbaum and Mcintosh Model: N , 2022 .

[16]  P. Fishburn,et al.  Utility theory , 1980, Cognitive Choice Modeling.

[17]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[18]  A. Sanfey Neural computations of decision utility , 2004, Trends in Cognitive Sciences.

[19]  J. Schall Neural correlates of decision processes: neural and mental chronometry , 2003, Current Opinion in Neurobiology.

[20]  M. Birnbaum,et al.  Source Credibility in Social Judgment : Bias , Expertise , and the Judge ' s Point of View , 1979 .

[21]  J. Busemeyer,et al.  Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice , 2006 .

[22]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[23]  J. Kadane Structural Analysis of Discrete Data with Econometric Applications , 1984 .

[24]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[25]  Michael H. Birnbaum,et al.  Scale convergence and utility measurement , 1992 .

[26]  Nigel Harvey,et al.  Blackwell Handbook of Judgment and Decision Making , 2004 .

[27]  A. Tversky,et al.  Weighing Risk and Uncertainty , 1995 .

[28]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[29]  H. Montgomery From cognition to action: The search for dominance in decision making. , 1989 .

[30]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[31]  Ji Gao,et al.  Extending the decision field theory to model operators' reliance on automation in supervisory control situations , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[33]  R. Zajonc Feeling and thinking : Preferences need no inferences , 1980 .

[34]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[35]  Joseph G. Johnson,et al.  A dynamic, stochastic, computational model of preference reversal phenomena. , 2005, Psychological review.

[36]  I. J. Myung,et al.  The Importance of Complexity in Model Selection. , 2000, Journal of mathematical psychology.

[37]  M. Allais Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[38]  Richard Gonzalez,et al.  On the Shape of the Probability Weighting Function , 1999, Cognitive Psychology.

[39]  C. Fox Strength of Evidence, Judged Probability, and Choice Under Uncertainty , 1999, Cognitive Psychology.

[40]  C. Starmer Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk , 2000 .

[41]  O. Svenson Decision Making and the Search for Fundamental Psychological Regularities: What Can Be Learned from a Process Perspective? , 1996 .

[42]  Michael H. Birnbaum,et al.  Violations of Branch Independence in Choices between Gambles , 1996 .

[43]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[44]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[45]  M. Birnbaum,et al.  New Paradoxes of Risky Decision Making , 2022 .

[46]  C. Coombs A theory of data. , 1965, Psychology Review.

[47]  David Leake,et al.  Inference to the Best Plan: a Coherence Theory of Decision , 1995 .

[48]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[49]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[50]  D. McFadden Econometric Models of Probabilistic Choice , 1981 .

[51]  S. Sloman Two systems of reasoning. , 2002 .

[52]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[53]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[54]  Keith J. Holyoak,et al.  Understanding Similarity in Choice Behavior: A Connectionist Model , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[55]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[56]  David I. Laibson,et al.  Neuroeconomics : How Neuroscience Can Inform Economics , 2003 .

[57]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[58]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[59]  Gerd Gigerenzer,et al.  Models of ecological rationality: the recognition heuristic. , 2002, Psychological review.

[60]  Jonathan D. Cohen,et al.  Neuroeconomics: cross-currents in research on decision-making , 2006, Trends in Cognitive Sciences.

[61]  F. Ramsey The Foundations of Mathematics and Other Logical Essays , 2001 .

[62]  Adele Diederich,et al.  Contrast effects or loss aversion? Comment on Usher and McClelland (2004). , 2005, Psychological review.

[63]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[64]  A. Diederich MDFT account of decision making under time pressure , 2003, Psychonomic Bulletin & Review.

[65]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[66]  Adele Diederich,et al.  Survey of decision field theory , 2002, Math. Soc. Sci..

[67]  Lola L. Lopes Algebra and Process in the Modeling of Risky Choice , 1995 .

[68]  J. Quiggin A theory of anticipated utility , 1982 .

[69]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[70]  F. B. Vernadat,et al.  Decisions with Multiple Objectives: Preferences and Value Tradeoffs , 1994 .

[71]  Jerome R. Busemeyer,et al.  Computational Models of Decision Making , 2003 .

[72]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[73]  P. Slovic The Construction of Preference , 1995 .

[74]  E. Weber,et al.  Content and Discontent: Indications and Implications of Domain Specificity in Preferential Decision Making , 1995 .

[75]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[76]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[77]  A. Glöckner,et al.  Coherence Shifts in Probabilistic Inference Tasks , 2009 .

[78]  M. Birnbaum,et al.  Contextual effects in information integration. , 1971, Journal of experimental psychology.

[79]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[80]  B. D. Finetti,et al.  Foresight: Its Logical Laws, Its Subjective Sources , 1992 .

[81]  Andreas Glöckner,et al.  Modeling Option and Strategy Choices with Connectionist Networks: Towards an Integrative Model of Automatic and Deliberate Decision Making , 2008, Judgment and Decision Making.

[82]  O. Svenson Differentiation and consolidation theory of human decision making: A frame of reference for the study of pre- and post-decision processes , 1992 .

[83]  R. Hastie Problems for judgment and decision making. , 2001, Annual review of psychology.

[84]  Daniel M. Oppenheimer,et al.  Heuristics made easy: an effort-reduction framework. , 2008, Psychological bulletin.

[85]  K. Holyoak,et al.  Bidirectional reasoning in decision making by constraint satisfaction , 1999 .

[86]  W. Edwards Subjective probabilities inferred from decisions. , 1962, Psychological review.

[87]  A. Tversky,et al.  A Belief-Based Account of Decision Under Uncertainty , 1998 .

[88]  W. Thorngate Efficient decision heuristics. , 1980 .

[89]  M. Birnbaum,et al.  Testing Descriptive Utility Theories: Violations of Stochastic Dominance and Cumulative Independence , 1998 .

[90]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[91]  A. Bechara,et al.  The role of emotion in decision making: A cognitive neuroscience perspective , 2006 .

[92]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[93]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[94]  Lola L. Lopes,et al.  [Advances in Experimental Social Psychology] Advances in Experimental Social Psychology Volume 20 Volume 20 || Between Hope and Fear: The Psychology of Risk , 1987 .

[95]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[96]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[97]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[98]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[99]  Keith J. Holyoak,et al.  PSYCHOLOGICAL SCIENCE Research Article Construction of Preferences by Constraint Satisfaction , 2022 .

[100]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[101]  James T. Townsend,et al.  Mathematical Psychology , 2020, Psychology.

[102]  E. Brandstätter,et al.  A cognitive‐emotional account of the shape of the probability weighting function , 2002 .

[103]  I. Ritov,et al.  Decision Affect Theory: Emotional Reactions to the Outcomes of Risky Options , 1997 .

[104]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[105]  Eric J. Johnson,et al.  Aspects of Endowment: A Query Theory of Value Construction , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[106]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.