Hippocampal activation during extinction learning predicts occurrence of the renewal effect in extinction recall

The renewal effect describes the reoccurrence of a previously extinguished response in situations where the context of extinction differs from that of acquisition, thus illustrating the context-dependency of extinction learning. A number of studies on contextual fear extinction have implicated hippocampus and vmPFC in processing and retrieval of context both during extinction learning and recall of extinction. In this functional magnetic resonance imaging (fMRI) study we explored the neural correlates of the renewal effect in associative learning, using a predictive learning task that required participants to learn relations between cues and outcomes presented in particular contexts. During extinction in a novel context, compared to extinction in a context identical to the acquisition context, participants who exhibited the renewal effect (REN) showed increased activation in brain regions including bilateral posterior hippocampus and left parahippocampal gyrus. This activation pattern was absent in participants that did not show the renewal effect (NOREN). In direct comparisons between the groups, the REN group exhibited higher activation in bilateral hippocampus, while the NOREN group showed higher activation in left dlPFC (BA 46) and right anterior cingulate (BA 32). During extinction recall, stimuli that had been extinguished in a different context were again presented in the context of acquisition. Here both groups exhibited predominantly prefrontal activation, with the REN group's focus upon bilateral OFC (BA 47) and bilateral vmPFC (BA 10), while the NOREN group showed generally more widespread activation, predominantly in large clusters of dlPFC (BA 8,9,45). In a direct comparison, the REN group showed higher activation than the NOREN group in left vmPFC (BA 10), while NOREN participants exhibited more activation in dlPFC (BA 9, 46). Activation in left vmPFC during extinction recall correlated with the number of renewal effect responses, while the dlPFC activation showed a negative correlation with renewal effect responses. These results highlight the differential activation patterns of processes that will eventually produce or not produce a renewal effect, indicating that during extinction learning hippocampus encodes the relation between context and cue-outcome, while in extinction recall vmPFC is active to retrieve this association.

[1]  James Danckert,et al.  Attention for action? Examining the link between attention and visuomotor control deficits in a patient with optic ataxia , 2009, Neuropsychologia.

[2]  Christian Grillon,et al.  Contextual-specificity of short-delay extinction in humans: renewal of fear-potentiated startle in a virtual environment. , 2007, Learning & memory.

[3]  H. Lachnit,et al.  Dissociations among ABA, ABC, and AAB recovery effects. , 2008 .

[4]  R. J. Darby,et al.  Effects of context on responding during a compound stimulus. , 1995, Journal of experimental psychology. Animal behavior processes.

[5]  Jakob Heinzle,et al.  Decoding different roles for vmPFC and dlPFC in multi-attribute decision making , 2011, NeuroImage.

[6]  J. M. Rosas,et al.  Context switch effects on acquisition and extinction in human predictive learning. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Ali Ghazizadeh,et al.  Prefrontal Cortex Mediates Extinction of Responding by Two Distinct Neural Mechanisms in Accumbens Shell , 2012, The Journal of Neuroscience.

[8]  T. Robbins,et al.  Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making , 2008, Brain : a journal of neurology.

[9]  M. Bouton,et al.  Immediate extinction causes a less durable loss of performance than delayed extinction following either fear or appetitive conditioning. , 2008, Learning & memory.

[10]  Michael Davis,et al.  Behavioral and Neural Analysis of Extinction , 2002, Neuron.

[11]  Joseph E LeDoux,et al.  Evidence for recovery of fear following immediate extinction in rats and humans. , 2008, Learning & memory.

[12]  R. Bolles,et al.  Role of conditioned contextual stimuli in reinstatement of extinguished fear. , 1979, Journal of experimental psychology. Animal behavior processes.

[13]  A. Dale,et al.  Dorsal anterior cingulate cortex: A role in reward-based decision making , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Stephen Maren,et al.  Hippocampal involvement in contextual modulation of fear extinction , 2007, Hippocampus.

[15]  Harald Lachnit,et al.  The informational value of contexts affects context-dependent learning , 2013, Learning & behavior.

[16]  V. Menon,et al.  Saliency, switching, attention and control: a network model of insula function , 2010, Brain Structure and Function.

[17]  Tali Bitan,et al.  Putting Humpty together and pulling him apart: Accessing and unbinding the hippocampal item-context engram , 2012, NeuroImage.

[18]  Jennifer A. Hobin,et al.  Ventral hippocampal muscimol disrupts context‐specific fear memory retrieval after extinction in rats , 2006, Hippocampus.

[19]  Gang Chen,et al.  Contextual Fear Conditioning in Humans: Cortical-Hippocampal and Amygdala Contributions , 2008, The Journal of Neuroscience.

[20]  T. Robbins,et al.  Dissociable Contributions of the Orbitofrontal and Infralimbic Cortex to Pavlovian Autoshaping and Discrimination Reversal Learning: Further Evidence for the Functional Heterogeneity of the Rodent Frontal Cortex , 2003, The Journal of Neuroscience.

[21]  Timothy J Desmond,et al.  Behavioral / Systems / Cognitive Hippocampal Inactivation Disrupts the Acquisition and Contextual Encoding of Fear Extinction , 2005 .

[22]  J. Kim,et al.  Expression of renewal is dependent on the extinction-test interval rather than the acquisition-extinction interval. , 2009, Behavioral neuroscience.

[23]  J. Rawlins,et al.  The effects of intrahippocampal ibotenate on resistance to extinction after continuous or partial reinforcement , 2004, Experimental Brain Research.

[24]  R. C. Honey,et al.  Conditioning and contextual retrieval in hippocampal rats. , 1991, Behavioral neuroscience.

[25]  Cristina Ramponi,et al.  The amygdala response to images with impact. , 2009, Social cognitive and affective neuroscience.

[26]  Michael E. Ragozzino,et al.  Human reversal learning under conditions of certain versus uncertain outcomes , 2011, NeuroImage.

[27]  E. Wasserman Comparative Cognition : Beginning the Second Century of the Study of Animal Intelligence , 2004 .

[28]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[29]  P. Holland,et al.  Lesions of basolateral amygdala impair extinction of CS motivational value, but not of explicit conditioned responses, in Pavlovian appetitive second‐order conditioning , 2003, The European journal of neuroscience.

[30]  R. Elliott,et al.  Activation of Different Anterior Cingulate Foci in Association with Hypothesis Testing and Response Selection , 1998, NeuroImage.

[31]  T. Robbins,et al.  Dissociable roles of the central and basolateral amygdala in appetitive emotional learning , 2000, The European journal of neuroscience.

[32]  Additivity of the effects of retention interval and context change on latent inhibition: toward resolution of the context forgetting paradox. , 1997, Journal of experimental psychology. Animal behavior processes.

[33]  Mark E. Bouton,et al.  Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation , 1989 .

[34]  Christian Büchel,et al.  Dissociable Roles for the Hippocampus and the Amygdala in Human Cued versus Context Fear Conditioning , 2008, The Journal of Neuroscience.

[35]  Bradford C. Dickerson,et al.  Novelty as a dimension in the affective brain , 2010, NeuroImage.

[36]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[37]  M. Bouton,et al.  Renewal of extinguished responding in a second context , 1994 .

[38]  Stephen Maren,et al.  Electrolytic lesions of the dorsal hippocampus disrupt renewal of conditional fear after extinction. , 2005, Learning & memory.

[39]  Christopher I. Wright,et al.  Novelty responses and differential effects of order in the amygdala, substantia innominata, and inferior temporal cortex , 2003, NeuroImage.

[40]  M. Martí-Nicolovius,et al.  d-cycloserine in the basolateral amygdala prevents extinction and enhances reconsolidation of odor-reward associative learning in rats , 2013, Neurobiology of Learning and Memory.

[41]  D. Kumaran,et al.  Match–Mismatch Processes Underlie Human Hippocampal Responses to Associative Novelty , 2007, The Journal of Neuroscience.

[42]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[43]  Joseph E LeDoux,et al.  Dissociable roles for the ventromedial prefrontal cortex and amygdala in fear extinction: NR2B contribution. , 2008, Cerebral cortex.

[44]  E. Rolls,et al.  The effects of stimulus novelty and familiarity on neuronal activity in the amygdala of monkeys performing recognition memory tasks , 2004, Experimental Brain Research.

[45]  Sara E. Morrison,et al.  Re-valuing the amygdala , 2010, Current Opinion in Neurobiology.

[46]  J. Peters,et al.  d-Cycloserine administered directly to infralimbic medial prefrontal cortex enhances extinction memory in sucrose-seeking animals , 2013, Neuroscience.

[47]  T. F. Tavares,et al.  Involvement of the basolateral complex and central nucleus of amygdala in the omission effects of different magnitudes of reinforcement , 2012, Behavioural Brain Research.

[48]  D. Kumaran,et al.  Novelty signals: a window into hippocampal information processing , 2009, Trends in Cognitive Sciences.

[49]  P. Rodríguez Stimulus-outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing. , 2009, Learning & memory.

[50]  R. Dolan,et al.  Classical fear conditioning in functional neuroimaging , 2000, Current Opinion in Neurobiology.

[51]  Raffael Kalisch,et al.  Clarifying the Role of the Rostral dmPFC/dACC in Fear/Anxiety: Learning, Appraisal or Expression? , 2012, PloS one.

[52]  Derek G. V. Mitchell,et al.  Dissociable roles of medial orbitofrontal cortex in human operant extinction learning , 2008, NeuroImage.

[53]  Hilke Plassmann,et al.  Nonlinear Responses Within the Medial Prefrontal Cortex Reveal When Specific Implicit Information Influences Economic Decision Making , 2005, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[54]  Michael Davis,et al.  Different mechanisms of fear extinction dependent on length of time since fear acquisition. , 2006, Learning & memory.

[55]  D. Tranel,et al.  Irrational Economic Decision-Making after Ventromedial Prefrontal Damage: Evidence from the Ultimatum Game , 2007, The Journal of Neuroscience.

[56]  Elizabeth A. Phelps,et al.  Insula and Orbital Frontal Cortex Activity Underlying Emotion Interference Resolution in Working Memory , 2010, Journal of Cognitive Neuroscience.

[57]  P. Matthews,et al.  Learning about pain: the neural substrate of the prediction error for aversive events. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[58]  Ewelina Knapska,et al.  Differential involvement of the central amygdala in appetitive versus aversive learning. , 2006, Learning & memory.

[59]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[60]  Peter Boesiger,et al.  Affective judgment and beneficial decision making: Ventromedial prefrontal activity correlates with performance in the Iowa Gambling Task , 2006, Human brain mapping.

[61]  P. Cheng,et al.  Causal Learning , 2012 .

[62]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[63]  S. Rauch,et al.  Recall of Fear Extinction in Humans Activates the Ventromedial Prefrontal Cortex and Hippocampus in Concert , 2007, Biological Psychiatry.

[64]  R. Adolphs,et al.  Damage to the prefrontal cortex increases utilitarian moral judgements , 2007, Nature.

[65]  Trevor W Robbins,et al.  Appetitive Behavior , 2003, Annals of the New York Academy of Sciences.

[66]  Alicia Izquierdo,et al.  Opposing effects of amygdala and orbital prefrontal cortex lesions on the extinction of instrumental responding in macaque monkeys , 2005, The European journal of neuroscience.

[67]  Yoshikazu Isomura,et al.  Neural Coding of “Attention for Action” and “Response Selection” in Primate Anterior Cingulate Cortex , 2003, The Journal of Neuroscience.

[68]  V. Arolt,et al.  Human Fear Conditioning and Extinction in Neuroimaging: A Systematic Review , 2009, PloS one.

[69]  G. Quirk,et al.  The Role of Ventromedial Prefrontal Cortex in the Recovery of Extinguished Fear , 2000, The Journal of Neuroscience.

[70]  S. Mingote,et al.  Noradrenaline and Dopamine Efflux in the Prefrontal Cortex in Relation to Appetitive Classical Conditioning , 2004, The Journal of Neuroscience.

[71]  S. Nakajima,et al.  Renewal of Formerly Conditioned Fear in Rats after Extensive Extinction Training , 2000, International Journal of Comparative Psychology.

[72]  Nicholas L. Balderston,et al.  The human amygdala plays a stimulus specific role in the detection of novelty , 2011, NeuroImage.

[73]  Emery Brown,et al.  Trial Outcome and Associative Learning Signals in the Monkey Hippocampus , 2009, Neuron.

[74]  P. Gean,et al.  The Role of the Amygdala in the Extinction of Conditioned Fear , 2006, Biological Psychiatry.

[75]  J. B. Nelson,et al.  The role of interference produced by conflicting associations in contextual control. , 2007, Journal of experimental psychology. Animal behavior processes.

[76]  Carl Senior,et al.  The Lateral and Ventromedial Prefrontal Cortex Work as a Dynamic Integrated System: Evidence from fMRI Connectivity Analysis , 2009, Journal of Cognitive Neuroscience.

[77]  G. Quirk,et al.  Consolidation of Fear Extinction Requires NMDA Receptor-Dependent Bursting in the Ventromedial Prefrontal Cortex , 2007, Neuron.

[78]  Klaus G. Melchers,et al.  Stimulus coding in human associative learning: Flexible representations of parts and wholes , 2008, Behavioural Processes.

[79]  D Yves von Cramon,et al.  How the orbitofrontal cortex contributes to decision making - a view from neuroscience. , 2009, Progress in brain research.

[80]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[81]  J. Gore,et al.  Activation of the left amygdala to a cognitive representation of fear , 2001, Nature Neuroscience.

[82]  H. Lachnit,et al.  Contextual control in discrimination reversal learning. , 2006, Journal of experimental psychology. Animal behavior processes.

[83]  I. Daum,et al.  The neural coding of expected and unexpected monetary performance outcomes: Dissociations between active and observational learning , 2012, Behavioural Brain Research.

[84]  G. Quirk,et al.  Recalling Safety: Cooperative Functions of the Ventromedial Prefrontal Cortex and the Hippocampus in Extinction , 2007, CNS Spectrums.

[85]  Stephen Maren,et al.  Hippocampal Inactivation Disrupts Contextual Retrieval of Fear Memory after Extinction , 2001, The Journal of Neuroscience.

[86]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[87]  Edward Awh,et al.  The anterior cingulate cortex lends a hand in response selection , 1999, Nature Neuroscience.

[88]  L. Jarrard,et al.  The effects of selective ibotenate lesions of the hippocampus on conditioned inhibition and extinction , 2003, Cognitive, affective & behavioral neuroscience.

[89]  J F Disterhoft,et al.  Hippocampal Unit Activity during Classical Aversive and Appetitive Conditioning , 1972, Science.

[90]  D. A. King,et al.  Contextual control of the extinction of conditioned fear: tests for the associative value of the context. , 1983, Journal of experimental psychology. Animal behavior processes.

[91]  Jennifer Urbano Blackford,et al.  A unique role for the human amygdala in novelty detection , 2010, NeuroImage.

[92]  M. Bouton,et al.  Spontaneous recovery in cross-motivational transfer (counterconditioning) , 1992 .

[93]  Donald M. Wilson,et al.  Behavioral Neuroscience , 2019 .

[94]  Edward Awh,et al.  The anterior cingulate cortex lends a hand in response , 1999 .

[95]  T. Beckers,et al.  Return of fear in a human differential conditioning paradigm caused by a return to the original acquistion context. , 2005, Behaviour research and therapy.

[96]  L. Alloy,et al.  Assessment of covariation by humans and animals: The joint influence of prior expectations and current situational information. , 1984 .

[97]  Peter A Bandettini,et al.  Impact of continuous versus intermittent CS-UCS pairing on human brain activation during Pavlovian fear conditioning. , 2007, Behavioral neuroscience.

[98]  Shauna L. Parkes,et al.  Role of the basolateral amygdala and NMDA receptors in higher-order conditioned fear , 2011, Reviews in the neurosciences.

[99]  L. Allan Human contingency judgments: rule based or associative? , 1993, Psychological bulletin.

[100]  Klaus G. Melchers,et al.  Comparing elemental and configural associative theories in human causal learning: a case for attention. , 2008, Journal of experimental psychology. Animal behavior processes.

[101]  A. Dickinson Contemporary Animal Learning Theory , 1981 .

[102]  R. R. Miller,et al.  Biological significance in forward and backward blocking: resolution of a discrepancy between animal conditioning and human causal judgment. , 1996, Journal of experimental psychology. General.

[103]  Justin A. Harris,et al.  Contextual control over conditioned responding in an extinction paradigm. , 2000, Journal of experimental psychology. Animal behavior processes.

[104]  S. Kennerley,et al.  Contrasting reward signals in the orbitofrontal cortex and anterior cingulate cortex , 2011, Annals of the New York Academy of Sciences.

[105]  Peter Kirsch,et al.  On Framing Effects in Decision Making: Linking Lateral versus Medial Orbitofrontal Cortex Activation to Choice Outcome Processing , 2006, Journal of Cognitive Neuroscience.

[106]  Richard B. Ivry,et al.  The influence of feedback valence in associative learning , 2009, NeuroImage.

[107]  M. Bouton Context and behavioral processes in extinction. , 2004, Learning & memory.

[108]  Stephen Maren,et al.  Muscimol Inactivation of the Dorsal Hippocampus Impairs Contextual Retrieval of Fear Memory , 1999, The Journal of Neuroscience.

[109]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[110]  Nikolaus Weiskopf,et al.  Context-Dependent Human Extinction Memory Is Mediated by a Ventromedial Prefrontal and Hippocampal Network , 2006, The Journal of Neuroscience.

[111]  T. Beckers,et al.  Stronger renewal in human fear conditioning when tested with an acquisition retrieval cue than with an extinction retrieval cue. , 2006, Behaviour research and therapy.