Evaluation of ambiguous associations in the amygdala by learning the structure of the environment

Recognizing predictive relationships is critical for survival, but an understanding of the underlying neural mechanisms remains elusive. In particular, it is unclear how the brain distinguishes predictive relationships from spurious ones when evidence about a relationship is ambiguous, or how it computes predictions given such uncertainty. To better understand this process, we introduced ambiguity into an associative learning task by presenting aversive outcomes both in the presence and in the absence of a predictive cue. Electrophysiological and optogenetic approaches revealed that amygdala neurons directly regulated and tracked the effects of ambiguity on learning. Contrary to established accounts of associative learning, however, interference from competing associations was not required to assess an ambiguous cue–outcome contingency. Instead, animals' behavior was explained by a normative account that evaluates different models of the environment's statistical structure. These findings suggest an alternative view of amygdala circuits in resolving ambiguity during aversive learning.

[1]  H. T. Blair,et al.  Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray , 2010, Nature Neuroscience.

[2]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[3]  C. Salzman,et al.  Abstract Context Representations in Primate Amygdala and Prefrontal Cortex , 2015, Neuron.

[4]  Jennifer A. Hobin,et al.  Auditory-Evoked Spike Firing in the Lateral Amygdala and Pavlovian Fear Conditioning Mnemonic Code or Fear Bias? , 2003, Neuron.

[5]  Overshadowing and latent inhibition of context aversion conditioning in the rat , 2006, Autonomic Neuroscience.

[6]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[7]  S. Kakade,et al.  Learning and selective attention , 2000, Nature Neuroscience.

[8]  L. Kamin Attention-like processes in classical conditioning , 1967 .

[9]  C. Gallistel,et al.  Pavlovian contingencies and temporal information. , 2006, Journal of experimental psychology. Animal behavior processes.

[10]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[11]  Mattias P. Karlsson,et al.  Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty , 2012, Science.

[12]  Joseph E LeDoux,et al.  Fear conditioning induces associative long-term potentiation in the amygdala , 1997, Nature.

[13]  W. Schultz,et al.  Responses of Amygdala Neurons to Positive Reward-Predicting Stimuli Depend on Background Reward (Contingency) Rather Than Stimulus-Reward Pairing (Contiguity) , 2009, Journal of neurophysiology.

[14]  Ralph R. Miller,et al.  Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus. , 1985 .

[15]  N. Weinberger Auditory associative memory and representational plasticity in the primary auditory cortex , 2007, Hearing Research.

[16]  J. Tenenbaum,et al.  Structure and strength in causal induction , 2005, Cognitive Psychology.

[17]  M. Volgushev,et al.  Heterosynaptic Plasticity , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[18]  Travis P Todd,et al.  Context change and associative learning. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[19]  T. Ono,et al.  Neuronal responsiveness to various sensory stimuli, and associative learning in the rat amygdala , 1995, Neuroscience.

[20]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[21]  W. Abraham How long will long-term potentiation last? , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  R. Paz,et al.  Amygdala–prefrontal interactions in (mal)adaptive learning , 2015, Trends in Neurosciences.

[23]  Degraded contingency revisited: posttraining extinction of a cover stimulus attenuates a target cue's behavioral control. , 2007, Journal of experimental psychology. Animal behavior processes.

[24]  R. Rescorla Probability of shock in the presence and absence of CS in fear conditioning. , 1968, Journal of comparative and physiological psychology.

[25]  M. Fanselow,et al.  N-methyl-D-aspartate receptor antagonist APV blocks acquisition but not expression of fear conditioning. , 1991, Behavioral neuroscience.

[26]  Nir Friedman,et al.  Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks , 2004, Machine Learning.

[27]  Peter Bossaerts,et al.  Evidence for Model-based Computations in the Human Amygdala during Pavlovian Conditioning , 2013, PLoS Comput. Biol..

[28]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[29]  J. Pearce,et al.  Theories of associative learning in animals. , 2001, Annual review of psychology.

[30]  A. Lüthi,et al.  Ensemble coding in amygdala circuits for associative learning , 2015, Current Opinion in Neurobiology.

[31]  Fabian A. Soto,et al.  Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization. , 2014, Psychological review.

[32]  Cyril Herry,et al.  Encoding of fear learning and memory in distributed neuronal circuits , 2014, Nature Neuroscience.

[33]  David Kappel,et al.  Network Plasticity as Bayesian Inference , 2015, PLoS Comput. Biol..

[34]  D. Blei,et al.  Context, learning, and extinction. , 2010, Psychological review.

[35]  P. Durlach Effect of signaling intertrial unconditioned stimuli in autoshaping. , 1983, Journal of experimental psychology. Animal behavior processes.

[36]  Michael A. Henninger,et al.  High-Performance Genetically Targetable Optical Neural Silencing via Light-Driven Proton Pumps , 2010 .

[37]  Steven C Stout,et al.  Sometimes-competing retrieval (SOCR): a formalization of the comparator hypothesis. , 2007, Psychological review.

[38]  Joseph E. LeDoux,et al.  Somatosensory and auditory convergence in the lateral nucleus of the amygdala. , 1993, Behavioral neuroscience.

[39]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[40]  K. Holyoak,et al.  Causal learning and inference as a rational process: the new synthesis. , 2011, Annual review of psychology.

[41]  G. Quirk,et al.  Neuronal signalling of fear memory , 2004, Nature Reviews Neuroscience.

[42]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[43]  E. Wasserman,et al.  Cue Competition in Causality Judgments: The Role of Nonpresentation of Compound Stimulus Elements , 1994 .

[44]  M. Davis,et al.  Disruption of contextual freezing, but not contextual blocking of fear-potentiated startle, after lesions of the dorsal hippocampus. , 2000, Behavioral neuroscience.

[45]  B. Balleine,et al.  The Effect of Lesions of the Basolateral Amygdala on Instrumental Conditioning , 2003, The Journal of Neuroscience.

[46]  R. K. Simpson Nature Neuroscience , 2022 .

[47]  Edward S Boyden,et al.  Hebbian and neuromodulatory mechanisms interact to trigger associative memory formation , 2014, Proceedings of the National Academy of Sciences.

[48]  David S. Touretzky,et al.  Model Uncertainty in Classical Conditioning , 2003, NIPS.

[49]  D. Paré,et al.  Erasing Fear Memories with Extinction Training , 2010, The Journal of Neuroscience.

[50]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[51]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[52]  Ralph R. Miller,et al.  Prevention of the degraded-contingency effect by signalling training trials , 2000, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[53]  Joseph E LeDoux,et al.  Fear conditioning and LTP in the lateral amygdala are sensitive to the same stimulus contingencies , 2001, Nature Neuroscience.