Effects of Amygdala Lesions on Object-Based Versus Action-Based Learning in Macaques.

The neural systems that underlie reinforcement learning (RL) allow animals to adapt to changes in their environment. In the present study, we examined the hypothesis that the amygdala would have a preferential role in learning the values of visual objects. We compared a group of monkeys (Macaca mulatta) with amygdala lesions to a group of unoperated controls on a two-armed bandit reversal learning task. The task had two conditions. In the What condition, the animals had to learn to select a visual object, independent of its location. And in the Where condition, the animals had to learn to saccade to a location, independent of the object at the location. In both conditions choice-outcome mappings reversed in the middle of the block. We found that monkeys with amygdala lesions had learning deficits in both conditions. Monkeys with amygdala lesions did not have deficits in learning to reverse choice-outcome mappings. Rather, amygdala lesions caused the monkeys to become overly sensitive to negative feedback which impaired their ability to consistently select the more highly valued action or object. These results imply that the amygdala is generally necessary for RL.

[1]  B. Averbeck,et al.  Hypothalamic Interactions with Large-Scale Neural Circuits Underlying Reinforcement Learning and Motivated Behavior , 2020, Trends in Neurosciences.

[2]  Ramon Bartolo,et al.  Prefrontal Cortex Predicts State Switches during Reversal Learning , 2020, Neuron.

[3]  Ramon Bartolo,et al.  Information-Limiting Correlations in Large Neural Populations , 2020, The Journal of Neuroscience.

[4]  Andrew R. Mitz,et al.  Subcortical Substrates of Explore-Exploit Decisions in Primates , 2019, Neuron.

[5]  Stephanie M. Groman,et al.  Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes , 2019, Neuron.

[6]  Mehrdad Jazayeri,et al.  Hierarchical reasoning by neural circuits in the frontal cortex , 2019, Science.

[7]  B. Averbeck,et al.  Reinforcement learning in artificial and biological systems , 2019, Nature Machine Intelligence.

[8]  Vincent D Costa,et al.  Ventral striatum’s role in learning from gains and losses , 2018, Proceedings of the National Academy of Sciences.

[9]  E. Murray,et al.  Specializations for reward-guided decision-making in the primate ventral prefrontal cortex , 2018, Nature Reviews Neuroscience.

[10]  S. Gershman,et al.  The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty , 2018, Neuron.

[11]  T. Moore,et al.  Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex , 2017, Neuron.

[12]  Elisabeth A. Murray,et al.  Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes , 2017, Neuron.

[13]  Kathryn M. Rothenhoefer,et al.  Effects of Ventral Striatum Lesions on Stimulus-Based versus Action-Based Reinforcement Learning , 2017, The Journal of Neuroscience.

[14]  E. Murray,et al.  MRI Overestimates Excitotoxic Amygdala Lesion Damage in Rhesus Monkeys , 2017, Front. Integr. Neurosci..

[15]  Vincent D Costa,et al.  Motivational neural circuits underlying reinforcement learning , 2017, Nature Neuroscience.

[16]  B. Averbeck,et al.  Amygdala Contributions to Stimulus–Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning , 2017, The Journal of Neuroscience.

[17]  Elena Borra,et al.  Computational Architecture of the Parieto-Frontal Network Underlying Cognitive-Motor Control in Monkeys , 2017, eNeuro.

[18]  David A. Leopold,et al.  A population MRI brain template and analysis tools for the macaque , 2017, NeuroImage.

[19]  Vincent D Costa,et al.  Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning , 2016, Neuron.

[20]  Nicolas W. Schuck,et al.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space , 2016, Neuron.

[21]  Ilana B. Witten,et al.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target , 2016, Nature Neuroscience.

[22]  Matthew F.S. Rushworth,et al.  Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques , 2015, Neuron.

[23]  Vincent D Costa,et al.  The Role of Frontal Cortical and Medial-Temporal Lobe Brain Areas in Learning a Bayesian Prior Belief on Reversals , 2015, The Journal of Neuroscience.

[24]  B. Averbeck,et al.  Injection of a Dopamine Type 2 Receptor Antagonist into the Dorsal Striatum Disrupts Choices Driven by Previous Outcomes, But Not Perceptual Inference , 2015, The Journal of Neuroscience.

[25]  Vincent D Costa,et al.  Reversal Learning and Dopamine: A Bayesian Perspective , 2015, The Journal of Neuroscience.

[26]  Christopher J. Peck,et al.  Task-Dependent Spatial Selectivity in the Primate Amygdala , 2014, The Journal of Neuroscience.

[27]  Christopher J. Peck,et al.  Amygdala neural activity reflects spatial attention towards stimuli promising reward or threatening punishment , 2014, eLife.

[28]  Christopher J. Peck,et al.  The Amygdala and Basal Forebrain as a Pathway for Motivationally Guided Attention , 2014, The Journal of Neuroscience.

[29]  S. Haber,et al.  Estimates of Projection Overlap and Zones of Convergence within Frontal-Striatal Circuits , 2014, The Journal of Neuroscience.

[30]  Ha Hong,et al.  Performance-optimized hierarchical models predict neural responses in higher visual cortex , 2014, Proceedings of the National Academy of Sciences.

[31]  Robert C. Wilson,et al.  Orbitofrontal Cortex as a Cognitive Map of Task Space , 2014, Neuron.

[32]  Ravi V. Chacko,et al.  Effects of Amygdala Lesions on Reward-Value Coding in Orbital and Medial Prefrontal Cortex , 2013, Neuron.

[33]  E. Murray,et al.  Differential Effects of Amygdala, Orbital Prefrontal Cortex, and Prelimbic Cortex Lesions on Goal-Directed Behavior in Rhesus Macaques , 2013, The Journal of Neuroscience.

[34]  Christopher J. Peck,et al.  The primate amygdala combines information about space and value , 2013, Nature Neuroscience.

[35]  Mattias P. Karlsson,et al.  Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty , 2012, Science.

[36]  B. Averbeck,et al.  Action Selection and Action Value in Frontal-Striatal Circuits , 2012, Neuron.

[37]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[38]  Stefano Fusi,et al.  Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. , 2010, Annual review of neuroscience.

[39]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[40]  N. Daw,et al.  Human Reinforcement Learning Subdivides Structured Action Spaces by Learning Effector-Specific Values , 2009, The Journal of Neuroscience.

[41]  B. Balleine,et al.  The integrative function of the basal ganglia in instrumental conditioning , 2009, Behavioural Brain Research.

[42]  Joseph J. Paton,et al.  Moment-to-Moment Tracking of State Value in the Amygdala , 2008, The Journal of Neuroscience.

[43]  Emad N. Eskandar,et al.  A flexible software tool for temporally-precise behavioral control in Matlab , 2008, Journal of Neuroscience Methods.

[44]  E. Murray,et al.  Amygdala and Orbitofrontal Cortex Lesions Differentially Influence Choices during Object Reversal Learning , 2008, The Journal of Neuroscience.

[45]  P. Glimcher,et al.  Value Representations in the Primate Striatum during Matching Behavior , 2008, Neuron.

[46]  Bruno B. Averbeck,et al.  The Statistical Neuroanatomy of Frontal Networks in the Macaque , 2008, PLoS Comput. Biol..

[47]  J. O'Doherty,et al.  Contributions of the Amygdala to Reward Expectancy and Choice Signals in Human Prefrontal Cortex , 2007, Neuron.

[48]  G. Schoenbaum,et al.  Basolateral Amygdala Lesions Abolish Orbitofrontal-Dependent Reversal Impairments , 2007, Neuron.

[49]  Claus C. Hilgetag,et al.  Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala , 2007, NeuroImage.

[50]  Elisabeth A. Murray,et al.  Behavioral/systems/cognitive Selective Bilateral Amygdala Lesions in Rhesus Monkeys Fail to Disrupt Object Reversal Learning , 2022 .

[51]  S. Haber,et al.  Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning , 2006, The Journal of Neuroscience.

[52]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[53]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[54]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[55]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[56]  J. Parkinson,et al.  Autonomic arousal in an appetitive context in primates: a behavioural and neural analysis , 2005, The European journal of neuroscience.

[57]  B. Balleine,et al.  Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer , 2005, The Journal of Neuroscience.

[58]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[59]  D. Amit,et al.  The eye and the hand: neural mechanisms and network models for oculomanual coordination in parietal cortex. , 2003, Cerebral cortex.

[60]  H. Barbas,et al.  Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey , 2002, Neuroscience.

[61]  Richard C Saunders,et al.  Comparison of hippocampal, amygdala, and perirhinal projections to the nucleus accumbens: Combined anterograde and retrograde tracing study in the Macaque brain , 2002, The Journal of comparative neurology.

[62]  T. Bussey,et al.  Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning. , 2002, Behavioral neuroscience.

[63]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[64]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[65]  Olejnik,et al.  Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations. , 2000, Contemporary educational psychology.

[66]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[67]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[68]  E. Murray,et al.  Excitotoxic Lesions of the Amygdala Fail to Produce Impairment in Visual Learning for Auditory Secondary Reinforcement But Interfere with Reinforcer Devaluation Effects in Rhesus Monkeys , 1997, The Journal of Neuroscience.

[69]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[70]  Elisabeth A. Murray,et al.  Role of the hippocampus plus subjacent cortex but not amygdala in visuomotor conditional learning in rhesus monkeys. , 1996, Behavioral neuroscience.

[71]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[72]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. , 1994, Cerebral cortex.

[73]  Trevor W. Robbins,et al.  Differential effects of excitotoxic lesions of the basolateral amygdala, ventral subiculum and medial prefrontal cortex on responding with conditioned reinforcement and locomotor activity potentiated by intra-accumbens infusions ofd-amphetamine , 1993, Behavioural Brain Research.

[74]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[75]  H. Barbas Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey , 1988, The Journal of comparative neurology.

[76]  D. Amaral,et al.  The afferent input to the magnocellular division of the mediodorsal thalamic nucleus in the monkey, Macaca fascicularis , 1987, The Journal of comparative neurology.

[77]  B. C. Motter,et al.  Functional properties of parietal visual neurons: radial organization of directionalities within the visual field , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[78]  P. Goldman-Rakic,et al.  The primate mediodorsal (MD) nucleus and its projection to the frontal lobe , 1985, The Journal of comparative neurology.

[79]  D. Amaral,et al.  Amygdalo‐cortical projections in the monkey (Macaca fascicularis) , 1984, The Journal of comparative neurology.

[80]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  M Mishkin,et al.  Organization of the amygdalopetal projections from modality‐specific cortical association areas in the monkey , 1980, The Journal of comparative neurology.

[82]  Tirin Moore,et al.  Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex , 2018, Neuron.

[83]  David W. McNeal,et al.  Amygdala interconnections with the cingulate motor cortex in the rhesus monkey , 2007, The Journal of comparative neurology.

[84]  N. Schmajuk Animal learning and cognition , 1997 .

[85]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[86]  Leslie G. Ungerleider Two cortical visual systems , 1982 .