Neural Signatures of Intransitive Preferences

It is often assumed that decisions are made by rank-ordering and thus comparing the available choice options based on their subjective values. Rank-ordering requires that the alternatives’ subjective values are mentally represented at least on an ordinal scale. Because one alternative cannot be at the same time better and worse than another alternative, choices should satisfy transitivity (if alternative A is preferred over B, and B is preferred over C, A should be preferred over C). Yet, individuals often demonstrate striking violations of transitivity (preferring C over A). We used functional magnetic resonance imaging to study the neural correlates of intransitive choices between gambles varying in magnitude and probability of financial gains. Behavioral intransitivities were common. They occurred because participants did not evaluate the gambles independently, but in comparison with the alternative gamble presented. Neural value signals in prefrontal and parietal cortex were not ordinal-scaled and transitive, but reflected fluctuations in the gambles’ local, pairing-dependent preference-ranks. Detailed behavioral analysis of gamble preferences showed that, depending on the difference in the offered gambles’ attributes, participants gave variable priority to magnitude or probability and thus shifted between preferring richer or safer gambles. The variable, context-dependent priority given to magnitude and probability was tracked by insula (magnitude) and posterior cingulate (probability). Their activation-balance may reflect the individual decision rules leading to intransitivities. Thus, the phenomenon of intransitivity is reflected in the organization of the neural systems involved in risky decision-making.

[1]  P. Samuelson A Note on the Pure Theory of Consumer's Behaviour , 1938 .

[2]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[3]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[4]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[5]  S. Afriat THE CONSTRUCTION OF UTILITY FUNCTIONS FROM EXPENDITURE DATA , 1967 .

[6]  A. Tversky Intransitivity of preferences. , 1969 .

[7]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[8]  David Hume A Treatise of Human Nature: Being an Attempt to introduce the experimental Method of Reasoning into Moral Subjects , 1972 .

[9]  E Fantino,et al.  Transitivity as a property of choice. , 1972, Journal of the experimental analysis of behavior.

[10]  S. Afriat Efficiency Estimation of Production Function , 1972 .

[11]  Edmund Fantino,et al.  Stochastic transitivity and the unidimensional control of choice , 1975 .

[12]  P. Fishburn Nontransitive measurable utility , 1982 .

[13]  H. Varian The Nonparametric Approach to Demand Analysis , 1982 .

[14]  B. Dosher,et al.  Strategies for multiattribute binary choice. , 1983, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Robert Sugden,et al.  OBSERVING VIOLATIONS OF TRANSITIVITY BY EXPERIMENTAL METHODS , 1991 .

[16]  J. Ebeling,et al.  Monitoring and control , 1994 .

[17]  S. Shafir Intransitivity of preferences in honey bees: support for 'comparative' evaluation of foraging options , 1994, Animal Behaviour.

[18]  John D. Hey,et al.  Experimental Investigations of Errors in Decision Making under Risk Experimental investigations of errors in decision making under risk , 1995 .

[19]  P. Shizgal Neural basis of utility estimation , 1997, Current Opinion in Neurobiology.

[20]  Alasdair I. Houston,et al.  Natural selection and context-dependent values , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[22]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[23]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[24]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[25]  Ravi S. Menon,et al.  Dissociating pain from its anticipation in the human brain. , 1999, Science.

[26]  Peter H. M. P. Roelofsma,et al.  Intransitive intertemporal choice , 2000 .

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  Gregory G. Brown,et al.  Prefrontal, Parietal, and Temporal Cortex Networks Underlie Decision-Making in the Presence of Uncertainty , 2001, NeuroImage.

[29]  Donald Davidson,et al.  How Is Weakness of the Will Possible , 2001 .

[30]  T. Waite Intransitive preferences in hoarding gray jays (Perisoreus canadensis) , 2001, Behavioral Ecology and Sociobiology.

[31]  A. Craig How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[32]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[33]  T. Kalenscher,et al.  Neural architecture of choice behaviour in a concurrent interval schedule , 2003, The European journal of neuroscience.

[34]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[35]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[36]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[37]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[38]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[39]  M. Platt,et al.  Risk-sensitive neurons in macaque posterior cingulate cortex , 2005, Nature Neuroscience.

[40]  Giorgio Coricelli,et al.  Response to Comment on "The Involvement of the Orbitofrontal Cortex in the Experience of Regret" , 2005, Science.

[41]  J. O'Doherty,et al.  Regret and its avoidance: a neuroimaging study of choice behavior , 2005, Nature Neuroscience.

[42]  Paul J Laurienti,et al.  The subjective experience of pain: where expectations become reality. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[43]  T. Kalenscher,et al.  Single Units in the Pigeon Brain Integrate Reward Amount and Time-to-Reward in an Impulsive Choice Task , 2005, Current Biology.

[44]  M. Paulus,et al.  Neurobiology of Decision Making: A Selective Review from a Neurocognitive and Clinical Perspective , 2005, Biological Psychiatry.

[45]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[46]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[47]  Lorena R. R. Gianotti,et al.  Disruption of Right Prefrontal Cortex by Low-Frequency Repetitive Transcranial Magnetic Stimulation Induces Risk-Taking Behavior , 2006, The Journal of Neuroscience.

[48]  Lael J. Schooler,et al.  Why You Think Milan is Larger than Modena: Neural Correlates of the Recognition Heuristic , 2006, Journal of Cognitive Neuroscience.

[49]  D. Ariely,et al.  In Search of Homo Economicus: Preference Consistency, Emotions, and Cognition , 2006 .

[50]  Evan M. Gordon,et al.  Neural Signatures of Economic Preferences for Risk and Ambiguity , 2006, Neuron.

[51]  Martin P. Paulus,et al.  Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task , 2007, Experimental Brain Research.

[52]  J. O'Doherty,et al.  Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems , 2006, Journal of neurophysiology.

[53]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[54]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[55]  Syngjoo Choi,et al.  Consistency and heterogeneity of individual behavior under uncertainty , 2007 .

[56]  Á. Pascual-Leone,et al.  Diminishing Risk-Taking Behavior by Modulating Activity in the Prefrontal Cortex: A Direct Current Stimulation Study , 2007, The Journal of Neuroscience.

[57]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[58]  Douglas Gale,et al.  Revealing Preferences Graphically: An Old Method Gets a New Tool Kit , 2007 .

[59]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[60]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[61]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[62]  Daeyeol Lee,et al.  Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice , 2008, Neuron.

[63]  Annemarie Kalis,et al.  Weakness of will, akrasia, and the neuropsychiatry of decision making: An interdisciplinary perspective , 2008, Cognitive, affective & behavioral neuroscience.

[64]  R. Elliott,et al.  Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans , 2008, The European journal of neuroscience.

[65]  Gregory S. Berns,et al.  Neurobiological regret and rejoice functions for aversive outcomes , 2008, NeuroImage.

[66]  Bijan Pesaran,et al.  Free choice activates a decision circuit between frontal and parietal cortex , 2008, Nature.

[67]  L. Pessoa On the relationship between emotion and cognition , 2008, Nature Reviews Neuroscience.

[68]  C. Pennartz,et al.  Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making , 2008, Progress in Neurobiology.

[69]  Michael G. Hardin,et al.  The influence of context valence in the neural coding of monetary outcomes , 2009, NeuroImage.

[70]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[71]  D. Kumaran,et al.  The Neurobiology of Reference-Dependent Value Computation , 2009, NeuroImage.

[72]  Irwin P. Levin,et al.  The effects of insula damage on decision-making for risky gains and losses , 2009, Social neuroscience.

[73]  M. F. Luce,et al.  Separate Neural Mechanisms Underlie Choices and Strategic Preferences in Risky Decision Making , 2009, Neuron.

[74]  Bruce W. Smith,et al.  Neural Substrates of Reward Magnitude, Probability, and Risk during a Wheel of Fortune Decision-making Task Nih Public Access Cingulate Cortex in Decision-making , 2022 .

[75]  Masato Taira,et al.  A parametric relief signal in human ventrolateral prefrontal cortex , 2009, NeuroImage.

[76]  Hans-Jochen Heinze,et al.  Behavioral Neuroscience , 2022 .

[77]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[78]  D. Ariely,et al.  In Search of Homo Economicus: Cognitive Noise and the Role of Emotion in Preference Consistency , 2009 .

[79]  George I. Christopoulos,et al.  Risk-dependent reward value signal in human prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[80]  Arnaud D'Argembeau,et al.  The Iowa Gambling Task in fMRI images , 2009, Human brain mapping.

[81]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.