Disentangling neural representations of value and salience in the human brain

Significance The value and salience of predictive cues are important signals for regulating approach–avoidance behavior and attentional processing, respectively. However, the two signals often are confounded in studies of decision-making. Indeed, recent results suggest that neural signals in the primate posterior parietal cortex (PPC) which previously were thought to encode value actually reflect salience. This finding has created considerable uncertainty about previously identified value signals. Here we experimentally dissociate value and salience and use pattern-based functional MRI to demonstrate distinct encoding of both signals in the PPC, thereby reinforcing the earlier reports of value in the PPC. Moreover, we show that the orbitofrontal cortex encodes the predicted value of appetitive and aversive outcomes on a common neural scale. A large body of evidence has implicated the posterior parietal and orbitofrontal cortex in the processing of value. However, value correlates perfectly with salience when appetitive stimuli are investigated in isolation. Accordingly, considerable uncertainty has remained about the precise nature of the previously identified signals. In particular, recent evidence suggests that neurons in the primate parietal cortex signal salience instead of value. To investigate neural signatures of value and salience, here we apply multivariate (pattern-based) analyses to human functional MRI data acquired during a noninstrumental outcome-prediction task involving appetitive and aversive outcomes. Reaction time data indicated additive and independent effects of value and salience. Critically, we show that multivoxel ensemble activity in the posterior parietal cortex encodes predicted value and salience in superior and inferior compartments, respectively. These findings reinforce the earlier reports of parietal value signals and reconcile them with the recent salience report. Moreover, we find that multivoxel patterns in the orbitofrontal cortex correlate with value. Importantly, the patterns coding for the predicted value of appetitive and aversive outcomes are similar, indicating a common neural scale for appetite and aversive values in the orbitofrontal cortex. Thus orbitofrontal activity patterns satisfy a basic requirement for a neural value signal.

[1]  R. Juliano Strategy behind science policy decisions. , 2013, Science.

[2]  Jacqueline Gottlieb,et al.  Comment on “In Monkeys Making Value-Based Decisions, LIP Neurons Encode Cue Salience and Not Action Value” , 2013, Science.

[3]  Daniel C. McNamee,et al.  Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex , 2013, Nature Neuroscience.

[4]  Timothy Edward John Behrens,et al.  Segregated Encoding of Reward–Identity and Stimulus–Reward Associations in Human Orbitofrontal Cortex , 2013, The Journal of Neuroscience.

[5]  Chung-Hay Luk,et al.  Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making , 2013, The Journal of Neuroscience.

[6]  Geoffrey Schoenbaum,et al.  Risk-Responsive Orbitofrontal Neurons Track Acquired Salience , 2013, Neuron.

[7]  P. Tobler,et al.  Salience Signals in the Right Temporoparietal Junction Facilitate Value-Based Decisions , 2013, The Journal of Neuroscience.

[8]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[9]  Karl J. Friston,et al.  Action-Specific Value Signals in Reward-Related Regions of the Human Brain , 2012, The Journal of Neuroscience.

[10]  J. Gottlieb Attention, Learning, and the Value of Information , 2012, Neuron.

[11]  C. Olson,et al.  In Monkeys Making Value-Based Decisions, LIP Neurons Encode Cue Salience and Not Action Value , 2012, Science.

[12]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[13]  J. Wallis Cross-species studies of orbitofrontal cortex and value-based decision-making , 2011, Nature Neuroscience.

[14]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[15]  Soyoung Q. Park,et al.  Decoding the Formation of Reward Predictions across Learning , 2011, The Journal of Neuroscience.

[16]  Timothy E. J. Behrens,et al.  Double dissociation of value computations in orbitofrontal and anterior cingulate neurons , 2011, Nature Neuroscience.

[17]  Guillem R. Esber,et al.  Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning , 2011, Proceedings of the Royal Society B: Biological Sciences.

[18]  Soyoung Q. Park,et al.  Neurobiology of Value Integration: When Value Impacts Valuation , 2011, The Journal of Neuroscience.

[19]  Jakob Heinzle,et al.  Decoding different roles for vmPFC and dlPFC in multi-attribute decision making , 2011, NeuroImage.

[20]  J. Haynes,et al.  Perceptual Learning and Decision-Making in Human Medial Frontal Cortex , 2011, Neuron.

[21]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[22]  W. Schultz,et al.  Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value , 2010, Neuron.

[23]  Christopher J. Mitchell,et al.  Attention and Associative Learning: From Brain to Behaviour , 2010 .

[24]  J. O'Doherty,et al.  Appetitive and Aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision-making , 2009, NeuroImage.

[25]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[26]  Soyoung Q. Park,et al.  The neural code of reward anticipation in human orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[27]  Yq Liu,et al.  Intention and Attention: Different functional roles for LIPd and LIPv , 2010, Nature Neuroscience.

[28]  W. Schultz,et al.  Adaptation of Reward Sensitivity in Orbitofrontal Neurons , 2010, The Journal of Neuroscience.

[29]  V. Michel,et al.  An Automatic Valuation System in the Human Brain: Evidence from Functional Neuroimaging , 2009, Neuron.

[30]  C. Daniel Salzman,et al.  The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons , 2009, The Journal of Neuroscience.

[31]  Christopher J. Peck,et al.  Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex , 2009, The Journal of Neuroscience.

[32]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[33]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[34]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[35]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[36]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[37]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[38]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[39]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[40]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[41]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[42]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[43]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[44]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[45]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[46]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[47]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[48]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[49]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[50]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[51]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[52]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[53]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[54]  P. Wakker,et al.  Eliciting von Neumann-Morgenstern Utilities When Probabilities Are Distorted or Unknown , 1996 .

[55]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[56]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .