The Costs and Benefits of Calculation and Moral Rules

There has been a recent upsurge of research on moral judgment and decision making. One important issue with this body of work concerns the relative advantages of calculating costs and benefits versus adherence to moral rules. The general tenor of recent research suggests that adherence to moral rules is associated with systematic biases and that systematic cost-benefit analysis is a normatively superior decision strategy. This article queries both the merits of cost-benefit analyses and the shortcomings of moral rules. We argue that outside the very narrow domain in which consequences can be unambiguously anticipated, it is not at all clear that calculation processes optimize outcomes. In addition, there are good reasons to believe that following moral rules can lead to superior consequences in certain contexts. More generally, different modes of decision making can be seen as adaptations to particular environments.

[1]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[2]  R. M. Hare,et al.  Moral Thinking: Its Levels, Method, and Point. , 1982 .

[3]  Timothy D. Wilson,et al.  Affective Forecasting , 2005 .

[4]  Melissa L. Finucane,et al.  Risk as Analysis and Risk as Feelings: Some Thoughts about Affect, Reason, Risk, and Rationality , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[5]  Daniel M. Oppenheimer,et al.  Heuristics made easy: an effort-reduction framework. , 2008, Psychological bulletin.

[6]  E. Weber,et al.  Content and Discontent: Indications and Implications of Domain Specificity in Preferential Decision Making , 1995 .

[7]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[8]  D. Medin,et al.  Protected values: No omission bias and no framing effects , 2004, Psychonomic bulletin & review.

[9]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[10]  G. Gigerenzer Moral intuition = fast and frugal heuristics? , 2008 .

[11]  W. Thorngate Efficient decision heuristics. , 1980 .

[12]  W. Sinnott-Armstrong,et al.  The cognitive science of morality : intuition and diversity , 2008 .

[13]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[14]  Timothy D. Wilson,et al.  Prospection: Experiencing the Future , 2007, Science.

[15]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  G. Marwell,et al.  Economists free ride, does anyone else? : Experiments on the provision of public goods, IV , 1981 .

[17]  J. Prinz The Emotional Construction of Morals , 2007 .

[18]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[19]  John M. Frost,et al.  Moral heuristics. Commentaries. Author's reply , 2005 .

[20]  Dan Ariely,et al.  Decisions by Rules: The Case of Unwillingness to Pay for Beneficial Delays , 2006 .

[21]  M. Hauser,et al.  A Dissociation Between Moral Judgments and Justification , 2006 .

[22]  Andrew D. Engell,et al.  The Neural Bases of Cognitive Conflict and Control in Moral Judgment , 2004, Neuron.

[23]  Robin M. Hogarth,et al.  Judgment and decision research: Some historical context. , 1997 .

[24]  Timothy D. Wilson,et al.  Immune neglect: a source of durability bias in affective forecasting. , 1998, Journal of personality and social psychology.

[25]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[26]  P. Tetlock,et al.  The psychology of the unthinkable: taboo trade-offs, forbidden base rates, and heretical counterfactuals. , 2000, Journal of personality and social psychology.

[27]  J. Baron,et al.  ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES www.elsevier.com/locate/obhdp Omission bias, individual differences, and normality , 2003 .

[28]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[29]  Richard P. Larrick,et al.  Who uses the cost-benefit rules of choice? implications for the normative status of microeconomic theory , 1993 .

[30]  John Mikhail,et al.  Universal moral grammar: theory, evidence and the future , 2007, Trends in Cognitive Sciences.

[31]  H. Reis Naturalistic approaches to studying social interaction , 1983 .

[32]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[33]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[34]  Philip T. Dunwoody Introduction to the special issue: Coherence and correspondence in judgment and decision making , 2009, Judgment and Decision Making.

[35]  Herbert Gintis,et al.  Game Theory Evolving: A Problem-Centered Introduction to Modeling Strategic Interaction - Second Edition , 2009 .

[36]  Scott E. Page,et al.  THE EMERGENCE OF CULTURAL BEHAVIOR WITHIN MULTIPLE GAMES , 2005 .

[37]  A. Damasio,et al.  Deciding Advantageously Before Knowing the Advantageous Strategy , 1997, Science.

[38]  Mike Mesterton-Gibbons,et al.  Genetic and cultural evolution of cooperation , 2004 .

[39]  Steven J. Sherman,et al.  The Role of Counterfactual Thinking in Judgments of Affect , 1990 .

[40]  Thomas Gilovich,et al.  Varieties of regret: A debate and partial resolution. , 1998 .

[41]  Jonathan Baron,et al.  Regular ArticleProtected Values , 1997 .

[42]  Peter Singer,et al.  A companion to ethics , 1993 .

[43]  Anthony Appiah Experiments in ethics , 2009 .

[44]  Geoffrey E. Hinton,et al.  Why the Islands Move , 1984, Perception.

[45]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[46]  E. Eisner Learning and teaching the ways of knowing , 1985 .

[47]  G. Williams Adaptation and Natural Selection. (Book Reviews: Adaptation and Natural Selection: A Critique of Some Current Evolutionary Thought) , 2018 .

[48]  G. Loewenstein,et al.  Mixing virtue and vice: combining the immediacy effect and the diversification heuristic , 1999 .

[49]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[50]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[51]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[52]  P. Foot The Problem of Abortion and the Doctrine of the Double Effect , 2020, The Doctrine of Double Effect.

[53]  Daniel M. Bartels,et al.  Principled moral sentiment and the flexibility of moral judgment and decision making , 2008, Cognition.

[54]  M. Milinski,et al.  Reputation helps solve the ‘tragedy of the commons’ , 2002, Nature.

[55]  M. Dummett Language and Truth , 1996 .

[56]  Christopher K. Hsee,et al.  Decision and experience: why don't we choose what makes us happy? , 2006, Trends in Cognitive Sciences.

[57]  E. Uhlmann,et al.  do normative standards advance our understanding of moral judgment? , 2005, Behavioral and Brain Sciences.

[58]  Thomas Gilovich,et al.  Does Studying Economics Inhibit Cooperation , 1993 .

[59]  D. Medin,et al.  Broadening behavioral decision research: Multiple levels of cognitive processing , 1999, Psychonomic bulletin & review.

[60]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[61]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[62]  Walter Sinnott-Armstrong,et al.  Framing moral intuitions. , 2008 .

[63]  J. Henrich,et al.  The evolution of prestige: freely conferred deference as a mechanism for enhancing the benefits of cultural transmission. , 2001, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[64]  P. Richerson,et al.  Not by genes alone: How culture transformed human evolution. , 2004 .

[65]  Yaacov Trope,et al.  Temporal construal. , 2003, Psychological review.

[66]  Jonathan D. Cohen,et al.  Cognitive load selectively interferes with utilitarian moral judgment , 2008, Cognition.

[67]  R. Hastie Problems for judgment and decision making. , 2001, Annual review of psychology.

[68]  K. Lewin,et al.  Field Theory in Social Science: Selected Theoretical Papers , 1951 .

[69]  R. Parmentier Wisdom Sits in Places: Landscape and Language among the Western Apache. , 1997 .

[70]  N. Roese,et al.  What We Regret Most... and Why , 2005, Personality & social psychology bulletin.

[71]  Richard A. Shweder,et al.  The semiotic subject of cultural psychology. , 1990 .

[72]  Jutta Haider,et al.  Understanding Knowledge as a Commons: From Theory to Practice , 2008, J. Documentation.

[73]  P. Richerson,et al.  Norms and Bounded Rationality , 2022 .

[74]  Robert J. Waller,et al.  Social Traps , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[75]  E. Ostrom A Behavioral Approach to the Rational Choice Theory of Collective Action: Presidential Address, American Political Science Association, 1997 , 1998, American Political Science Review.

[76]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .

[77]  J. Baron,et al.  Omission and commission in judgment and choice , 1991 .

[78]  M. Waldmann,et al.  Throwing a Bomb on a Person Versus Throwing a Person on a Bomb , 2007, Psychological science.

[79]  L. Petrinovich,et al.  A preliminary cross-cultural study of moral intuitions. , 1998 .

[80]  Jonathan D. Cohen,et al.  An fMRI Investigation of Emotional Engagement in Moral Judgment , 2001, Science.

[81]  Baron,et al.  Protected Values , 1997, Virology.

[82]  Richard A. Shweder,et al.  The "big three" of morality (autonomy, community, divinity) and the "big three" explanations of suffering. , 1997 .

[83]  M. Smith Field Theory in Social Science: Selected Theoretical Papers. , 1951 .

[84]  Timothy D. Wilson,et al.  Thinking too much: introspection can reduce the quality of preferences and decisions. , 1991, Journal of personality and social psychology.

[85]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[86]  Baron,et al.  Protected Values and Omission Bias. , 1999, Organizational behavior and human decision processes.

[87]  E. Aronson The Return of the Repressed: Dissonance Theory Makes a Comeback , 1992 .

[88]  Richard J. Zeckhauser,et al.  Action Bias and Environmental Decisions , 2000 .

[89]  Lee Roy Beach,et al.  Image theory: Principles, goals, and plans in decision making , 1987 .

[90]  R. Clemen,et al.  Beyond expected utility: rethinking behavioral decision research. , 1994, Psychological bulletin.

[91]  Gordon Miller,et al.  Decision Making: Descriptive, Normative, and Prescriptive Interactions , 1990 .

[92]  T. Gilovich,et al.  The experience of regret: what, when, and why. , 1995, Psychological review.

[93]  D. Gilbert,et al.  Decisions and revisions: the affective forecasting of changeable outcomes. , 2002, Journal of personality and social psychology.

[94]  P. Tetlock,et al.  Social functionalist frameworks for judgment and choice: intuitive politicians, theologians, and prosecutors. , 2002, Psychological review.

[95]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[96]  G. Gigerenzer Striking a Blow for Sanity in Theories of Rationality , 2004 .

[97]  E. Ostrom Collective action and the evolution of social norms , 2000, Journal of Economic Perspectives.

[98]  J. Haidt,et al.  Affect, culture, and morality, or is it wrong to eat your dog? , 1993, Journal of personality and social psychology.

[99]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[100]  D. Fessler,et al.  The Effect of Age on Death Disgust: Challenges to Terror Management Perspectives , 2005 .

[101]  J. Lansing Perfect Order: Recognizing Complexity in Bali , 2006 .

[102]  Daniel M. Bartels,et al.  Are Morally Motivated Decision Makers Insensitive to the Consequences of Their Choices? , 2007, Psychological science.

[103]  W. Hamilton The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[104]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[105]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[106]  A. Fiske Complementarity Theory: Why Human Social Capacities Evolved to Require Cultural Complements , 2000, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[107]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[108]  D. Kahneman,et al.  Does Living in California Make People Happy? A Focusing Illusion in Judgments of Life Satisfaction , 1998 .

[109]  Shaun Nichols,et al.  Moral dilemmas and moral rules , 2006, Cognition.

[110]  R F Atkinson,et al.  Moral Thinking: Its Levels, Method and Point , 1982 .

[111]  J. Baron,et al.  Status-quo and omission biases , 1992 .

[112]  Dale T. Miller,et al.  Norm theory: Comparing reality to its alternatives , 1986 .

[113]  Lu Hong,et al.  Groups of diverse problem solvers can outperform groups of high-ability problem solvers. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[114]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[115]  P. Unger,et al.  Sacrificing for the Good of Strangers-Repeatedly@@@Living High and Letting Die , 1999 .

[116]  Peter Sedlmeier BasicBayes: A tutor system for simple Bayesian inference , 1997 .

[117]  M. Hauser,et al.  The Role of Conscious Reasoning and Intuition in Moral Judgment , 2006, Psychological science.

[118]  Daniel Kahneman,et al.  Fairness and the Assumptions of Economics , 1986 .

[119]  A R Jonsen,et al.  Do no harm. , 1978, Annals of internal medicine.

[120]  E. Weber,et al.  ‘How Do I Choose Thee? Let me Count the Ways’: A Textual Analysis of Similarities and Differences in Modes of Decision-making in China and the United States , 2005, Management and Organization Review.

[121]  P. Gollwitzer,et al.  The Willful Pursuit of Identity , 1998 .

[122]  L. Skitka Of Different Minds: An Accessible Identity Model of Justice Reasoning , 2003, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[123]  Y. Trope,et al.  Temporal construal and time-dependent changes in preference , 2000 .

[124]  J. Haidt,et al.  Intuitive ethics: how innately prepared intuitions generate culturally variable virtues , 2004, Daedalus.

[125]  Harold Houba Game Theory Evolving: a Problem-centered Introduction to Modeling Stratgeic Behavior [Review of: H. Gintis (2000) Game Theory Evolving: a Problem-centered Introduction to Modeling Strategic Behavior] , 2001 .

[126]  J. Baron Thinking and Deciding , 2023 .

[127]  K. Aquino,et al.  The self-importance of moral identity. , 2002, Journal of personality and social psychology.

[128]  Herbert A. Simon,et al.  Alternative visions of rationality. , 1990 .

[129]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[130]  J. Haidt The emotional dog and its rational tail: a social intuitionist approach to moral judgment. , 2001, Psychological review.

[131]  David M. Messick,et al.  Codes of Conduct: Behavioral Research into Business Ethics. , 1998 .

[132]  P. Todd,et al.  Bounding rationality to the world , 2003 .

[133]  E. Ostrom,et al.  Rules, Games, and Common-Pool Resources , 1994 .

[134]  D. Medin,et al.  The semantic side of decision making , 1999, Psychonomic bulletin & review.

[135]  P. Baran The Theory of the Leisure Class , 1957 .

[136]  Adam B. Moore,et al.  Who Shalt Not Kill? Individual Differences in Working Memory Capacity, Executive Control, and Moral Judgment , 2008, Psychological science.

[137]  Nassim Nicholas Taleb,et al.  The Black Swan: The Impact of the Highly Improbable , 2007 .

[138]  Jordan Henry Grafman,et al.  Social contracts and precautions activate different neurological systems: An fMRI investigation of deontic reasoning , 2005, NeuroImage.

[139]  R. Lazarus Emotion and Adaptation , 1991 .

[140]  Matthew J. Jorgensen,et al.  An empirical study of moral intuitions: Toward an evolutionary ethics. , 1993 .

[141]  J. Bargh,et al.  The psychology of action : linking cognition and motivation to behavior , 1999 .

[142]  Adam Kowol The theory of cognitive dissonance By , 2008 .

[143]  F. Waal,et al.  Good Natured: The Origins of Right and Wrong in Humans and Other Animals , 1996 .

[144]  B. Hooker Ideal Code, Real World , 2000 .

[145]  J. March Bounded rationality, ambiguity, and the engineering of choice , 1978 .

[146]  D. Messick,et al.  Sanctioning Systems, Decision Frames, and Cooperation , 1999 .

[147]  Reid Hastie,et al.  Content Effects on Decision Making. , 2001, Organizational behavior and human decision processes.

[148]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[149]  G. Loewenstein Out of control: Visceral influences on behavior , 1996 .

[150]  N. Pennington,et al.  Explanation-based decision making: effects of memory structure on judgment , 1988 .

[151]  S. Bonaccio,et al.  Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences , 2006 .

[152]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[153]  Daniel M. Bartels,et al.  Representation over time: The effects of temporal distance on similarity , 2008, Cognition.

[154]  A. Lanteri The dismal science: how thinking like an economist undermines community , 2010 .

[155]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[156]  M. M. Flood Some Experimental Games , 1958 .

[157]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[158]  P. Tetlock,et al.  Taboo Trade‐offs: Reactions to Transactions That Transgress the Spheres of Justice , 1997 .

[159]  Gerd Gigerenzer,et al.  Why Heuristics Work , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[160]  C. Sunstein,et al.  moral heuristics , 2003, Behavioral and Brain Sciences.

[161]  M. Nowak,et al.  Evolution of indirect reciprocity by image scoring , 1998, Nature.

[162]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[163]  Richard McElreath,et al.  Dual-inheritance theory: The evolution of human cultural capacities and cultural evolution , 2007 .

[164]  Christopher K. Hsee,et al.  Money, Kisses, and Electric Shocks: On the Affective Psychology of Risk , 2001, Psychological science.

[165]  E. Ostrom,et al.  A Framework for Analyzing the Knowledge Commons : a chapter from Understanding Knowledge as a Commons: from Theory to Practice. , 2005 .

[166]  Jonathan Baron,et al.  Social roles and the moral judgement of acts and omissions , 1996 .

[167]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[168]  Paul Slovic,et al.  The affect heuristic , 2007, Eur. J. Oper. Res..

[169]  Edward B. Royzman,et al.  The Preference for Indirect Harm , 2002 .

[170]  Peter Unger,et al.  Living high and letting die: Our illusion of innocence , 1998 .

[171]  T. Connolly,et al.  Omission bias in vaccination decisions: Where’s the “omission”? Where’s the “bias”? , 2003 .

[172]  H. Jungermann The Two Camps on Rationality , 1983 .

[173]  Timothy D. Wilson,et al.  Knowing what you'll do: effects of analyzing reasons on self-prediction. , 1995, Journal of personality and social psychology.

[174]  Joshua D. Greene,et al.  A Dissociation Between Moral Judgments and Justifications , 2007 .

[175]  P. Tetlock Thinking the unthinkable: sacred values and taboo cognitions , 2003, Trends in Cognitive Sciences.

[176]  D. Medin,et al.  The cultural mind: environmental decision making and cultural modeling within and across populations. , 2005, Psychological review.

[177]  M. Bazerman Judgment in Managerial Decision Making , 1990 .

[178]  C. Alessi The God delusion. , 2012, The Health service journal.

[179]  Anna Cuxart,et al.  What Risks Do People Perceive in Everyday Life? A Perspective Gained from the Experience Sampling Method (ESM) , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[180]  R. D'Andrade The Development of Cognitive Anthropology , 1995 .

[181]  G. Loewenstein,et al.  Projection Bias in Predicting Future Utility , 2000 .

[182]  D. Messick Alternative logics for decision making in social settings , 1999 .