Representations of appetitive and aversive information in the primate orbitofrontal cortex

Individuals weigh information about both rewarding and aversive stimuli to make adaptive decisions. Most studies of the orbitofrontal cortex (OFC), an area where appetitive and aversive neural subsystems might interact, have focused only on reward. Using a classical conditioning task where novel stimuli are paired with a reward or an aversive air puff, we discovered that two groups of orbitofrontal neurons respond preferentially to conditioned stimuli associated with rewarding and aversive outcomes; however, information about appetitive and aversive stimuli converges on individual neurons from both populations. Therefore, neurons in the OFC might participate in appetitive and aversive networks that track the motivational significance of stimuli even when they vary in valence and sensory modality. Further, we show that these networks, which also extend to the amygdala, exhibit different rates of change during reversal learning. Thus, although both networks represent appetitive and aversive associations, their distinct temporal dynamics might indicate different roles in learning processes.

[1]  Sara E. Morrison,et al.  Different Time Courses for Learning-Related Changes in Amygdala and Orbitofrontal Cortex , 2011, Neuron.

[2]  Stefano Fusi,et al.  Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. , 2010, Annual review of neuroscience.

[3]  S. Wise,et al.  Interactions between orbital prefrontal cortex and amygdala: advanced cognition, learned responses and instinctive behaviors , 2010, Current Opinion in Neurobiology.

[4]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.

[5]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[6]  S. Kennerley,et al.  Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. , 2009, Journal of neurophysiology.

[7]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[8]  C. Daniel Salzman,et al.  The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons , 2009, The Journal of Neuroscience.

[9]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[10]  Adam Kepecs,et al.  Neural representation of behavioral outcomes in the orbitofrontal cortex , 2009, Current Opinion in Neurobiology.

[11]  Steven P. Wise,et al.  Forward frontal fields: phylogeny and fundamental function , 2008, Trends in Neurosciences.

[12]  Joseph J. Paton,et al.  Moment-to-Moment Tracking of State Value in the Amygdala , 2008, The Journal of Neuroscience.

[13]  Geoffrey Schoenbaum,et al.  The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards , 2008, Nature.

[14]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[15]  P. Dayan,et al.  Reinforcement learning: The Good, The Bad and The Ugly , 2008, Current Opinion in Neurobiology.

[16]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[17]  J. O'Doherty,et al.  Lights, Camembert, Action! The Role of Human Orbitofrontal Cortex in Encoding Stimuli, Rewards, and Choices , 2007, Annals of the New York Academy of Sciences.

[18]  Joseph J. Paton,et al.  Expectation Modulates Neural Responses to Pleasant and Aversive Stimuli in Primate Amygdala , 2007, Neuron.

[19]  G. Schoenbaum,et al.  Conditioned Reinforcement can be Mediated by Either Outcome-Specific or General Affective Representations , 2007, Frontiers in integrative neuroscience.

[20]  Masato Inoue,et al.  Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes , 2007, Neuroscience Research.

[21]  Claus C. Hilgetag,et al.  Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala , 2007, NeuroImage.

[22]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[23]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[24]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[25]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[26]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[27]  K. Saleem,et al.  Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys , 2005, The Journal of comparative neurology.

[28]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[29]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[30]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[31]  Karl J. Friston,et al.  Opponent appetitive-aversive neural processes underlie predictive learning of pain relief , 2005, Nature Neuroscience.

[32]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[33]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[34]  J. Salamone,et al.  Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirements , 2004, Behavioural Brain Research.

[35]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[36]  M. Mishkin,et al.  Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity , 1970, Experimental Brain Research.

[37]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.

[38]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[39]  T. Robbins,et al.  Dissociable Contributions of the Orbitofrontal and Infralimbic Cortex to Pavlovian Autoshaping and Discrimination Reversal Learning: Further Evidence for the Functional Heterogeneity of the Rodent Frontal Cortex , 2003, The Journal of Neuroscience.

[40]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[41]  Geoffrey Schoenbaum,et al.  Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. , 2003, Learning & memory.

[42]  H. Barbas,et al.  Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey , 2002, Neuroscience.

[43]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[44]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[45]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[46]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[47]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[48]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[49]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[50]  P. Goldman-Rakic,et al.  Auditory belt and parabelt projections to the prefrontal cortex in the Rhesus monkey , 1999, The Journal of comparative neurology.

[51]  J. Price,et al.  Prefrontal cortical projections to the hypothalamus in Macaque monkeys , 1998, The Journal of comparative neurology.

[52]  H. Barbas,et al.  Topographic Organization of Connections between the Hypothalamus and Prefrontal Cortex in the Rhesus Monkey , 2022 .

[53]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[54]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[55]  J. Price,et al.  Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys , 1995, The Journal of comparative neurology.

[56]  E. Lynd-Balta,et al.  The orbital and medial prefrontal circuit through the primate basal ganglia , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  H. Barbas,et al.  Topographically specific hippocampal projections target functionally distinct prefrontal areas in the rhesus monkey , 1995, Hippocampus.

[58]  T. Preuss Do Rats Have Prefrontal Cortex? The Rose-Woolsey-Akert Program Reconsidered , 1995, Journal of Cognitive Neuroscience.

[59]  S. Grossberg Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. , 1984, Biological psychiatry.

[60]  R. Solomon,et al.  An Opponent-Process Theory of Motivation , 1978 .

[61]  R. Solomon,et al.  An opponent-process theory of motivation. I. Temporal dynamics of affect. , 1974, Psychological review.