Title: the Neural Representation of Subjective Value under Risk and Ambiguity 1 2

Risk and ambiguity are two conditions in which the consequences of possible outcomes are not certain. Under risk, the probabilities of different outcomes can be estimated, whereas under ambiguity, even these probabilities are not known. Although most people exhibit at least some aversion to both risk and ambiguity, the degree of these aversions is largely uncorrelated across subjects, suggesting that risk aversion and ambiguity aversion are distinct phenomena. Previous studies have shown differences in brain activations for risky and ambiguous choices and have identified neural mechanisms that may mediate transitions from conditions of ambiguity to conditions of risk. Unknown, however, is whether the value of risky and ambiguous options is necessarily represented by two distinct systems or whether a common mechanism can be identified. To answer this question, we compared the neural representation of subjective value under risk and ambiguity. fMRI was used to track brain activation while subjects made choices regarding options that varied systematically in the amount of money offered and in either the probability of obtaining that amount or the level of ambiguity around that probability. A common system, consisting of at least the striatum and the medial prefrontal cortex, was found to represent subjective value under both conditions.

[1]  J. O'Doherty,et al.  Marketing actions can modulate neural representations of experienced pleasantness , 2008, Proceedings of the National Academy of Sciences.

[2]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[3]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[4]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[5]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[6]  P. Glimcher Understanding risk: A guide for the perplexed , 2008, Cognitive, affective & behavioral neuroscience.

[7]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[8]  J. O'Doherty,et al.  Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems , 2006, Journal of neurophysiology.

[9]  J. Power,et al.  The amygdaloid complex: anatomy and physiology. , 2003, Physiological reviews.

[10]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[11]  S. Becker,et al.  What Price Ambiguity? or the Role of Ambiguity in Decision-Making , 1964, Journal of Political Economy.

[12]  Karl J. Friston,et al.  Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution , 2003, NeuroImage.

[13]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[14]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[15]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[16]  R. Abrams,et al.  Psychological sources of ambiguity avoidance , 1986 .

[17]  Colin Camerer,et al.  Recent developments in modelling preferences under risk , 1987 .

[18]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[19]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[20]  J. O'Doherty,et al.  Evidence for a Common Representation of Decision Values for Dissimilar Goods in Human Ventromedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[21]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[22]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[23]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[24]  Camelia M. Kuhnen,et al.  The Neural Basis of Financial Risk Taking , 2005, Neuron.

[25]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[26]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[27]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[28]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[29]  D. Ellsberg Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .

[30]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[31]  Samuel M. McClure,et al.  Neural Correlates of Behavioral Preference for Culturally Familiar Drinks , 2004, Neuron.

[32]  J. O'Doherty,et al.  Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum , 2006, Neuron.

[33]  D. Kumaran,et al.  The Neurobiology of Reference-Dependent Value Computation , 2009, NeuroImage.

[34]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[35]  R. Malach,et al.  When the Brain Loses Its Self: Prefrontal Inactivation during Sensorimotor Processing , 2006, Neuron.

[36]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[37]  Shawn P. Curley,et al.  The center and range of the probability interval as factors affecting ambiguity preferences , 1985 .

[38]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[39]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[40]  Daeyeol Lee,et al.  Neural Dissociation of Delay and Uncertainty in Intertemporal Choice , 2008, The Journal of Neuroscience.

[41]  Vernon L. Smith,et al.  Papers in experimental economics , 1991 .

[42]  R. Elliott,et al.  Differential Response Patterns in the Striatum and Orbitofrontal Cortex to Financial Reward in Humans: A Parametric Functional Magnetic Resonance Imaging Study , 2003, The Journal of Neuroscience.

[43]  Kip Smith,et al.  A brain imaging study of the choice procedure , 2005, Games Econ. Behav..

[44]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[45]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[46]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[47]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[48]  J. Wallis,et al.  Dynamic Encoding of Responses and Outcomes by Neurons in Medial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[49]  A. Rustichini,et al.  Ambiguity Aversion, Robustness, and the Variational Representation of Preferences , 2006 .

[50]  Colin Camerer,et al.  Recent developments in modeling preferences: Uncertainty and ambiguity , 1992 .

[51]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[52]  D. Prelec The Probability Weighting Function , 1998 .

[53]  Evan M. Gordon,et al.  Neural Signatures of Economic Preferences for Risk and Ambiguity , 2006, Neuron.

[54]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[55]  Mohammed Abdellaoui,et al.  Loss Aversion Under Prospect Theory: A Parameter-Free Measurement , 2007, Manag. Sci..

[56]  Jason P. Mitchell,et al.  A neural mechanism of first impressions , 2009, Nature Neuroscience.

[57]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[58]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[59]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[60]  P. Glimcher,et al.  Value Representations in the Primate Striatum during Matching Behavior , 2008, Neuron.

[61]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[62]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[63]  J. O'Doherty,et al.  Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices , 2003, The Journal of Neuroscience.

[64]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[65]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[66]  Alain Dagher,et al.  Feeding-induced dopamine release in dorsal striatum correlates with meal pleasantness ratings in healthy human volunteers , 2003, NeuroImage.

[67]  Colin Camerer,et al.  Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities , 2009, The Journal of Neuroscience.

[68]  A. Tversky,et al.  Preference and belief: Ambiguity and competence in choice under uncertainty , 1991 .

[69]  Paolo Ghirardato,et al.  Ambiguity in Asset Markets: Theory and Experiment , 2010 .

[70]  Benedetto De Martino,et al.  How Choice Reveals and Shapes Expected Hedonic Outcome , 2009, The Journal of Neuroscience.

[71]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[72]  F. McGlone,et al.  Separable Substrates for Anticipatory and Consummatory Food Chemosensation , 2008, Neuron.

[73]  Craig R. Fox,et al.  Ambiguity Aversion and Comparative Ignorance , 1995 .

[74]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[75]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[76]  Josef Perner,et al.  The role of competition and knowledge in the Ellsberg task , 2003 .

[77]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[78]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[79]  R. Hogarth,et al.  Venture Theory: A Model of Decision Weights , 1990 .

[80]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[81]  I. Gilboa,et al.  Maxmin Expected Utility with Non-Unique Prior , 1989 .

[82]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[83]  Ben Seymour,et al.  Neural Activity Associated with the Passive Prediction of Ambiguity and Risk for Aversive Events , 2009, The Journal of Neuroscience.