Bridging the interval: Theory and neurobiology of trace conditioning

An early finding in the behavioral analysis of learning was that conditioned responding weakens as the conditioned stimulus (CS) and unconditioned stimulus (US) are separated in time. This "trace" conditioning effect has been the focus of years of research in associative learning. Theoretical accounts of trace conditioning have focused on mechanisms that allow associative learning to occur across long intervals between the CS and US. These accounts have emphasized degraded contingency effects, timing mechanisms, and inhibitory learning. More recently, study of the neurobiology of trace conditioning has shown that even a short interval between the CS and US alters the circuitry recruited for learning. Here, we review some of the theoretical and neurobiological mechanisms underlying trace conditioning with an emphasis on recent studies of trace fear conditioning. Findings across many studies have implications not just for how we think about time and conditioning, but also for how we conceptualize fear conditioning in general, suggesting that circuitry beyond the usual suspects needs to be incorporated into current thinking about fear, learning, and anxiety.

[1]  J. Disterhoft,et al.  Mechanisms underlying basal and learning-related intrinsic excitability in a mouse model of Alzheimer's disease , 2011, Neurobiology of Aging.

[2]  R. Bolles,et al.  Some tricks for ameliorating the trace-conditioning deficit , 1978 .

[3]  M. Zhuo,et al.  Genetic enhancement of trace fear memory and cingulate potentiation in mice overexpressing Ca2+/calmodulin‐dependent protein kinase IV , 2008, The European journal of neuroscience.

[4]  Greg D. Gale,et al.  The Amygdala, Fear, and Memory , 2003, Annals of the New York Academy of Sciences.

[5]  P. Balsam,et al.  Timing at the Start of Associative Learning , 2002 .

[6]  M. Koch,et al.  Lesions of the dorsal hippocampus block trace fear conditioned potentiation of startle. , 2005, Behavioral neuroscience.

[7]  Robert P. Vertes,et al.  Interactions among the medial prefrontal cortex, hippocampus and midline thalamus in emotional and cognitive processing in the rat , 2006, Neuroscience.

[8]  M. Gallagher,et al.  Genetic background differences and nonassociative effects in mouse trace fear conditioning. , 2007, Learning & memory.

[9]  T. H. Brown,et al.  Muscarinic Receptors in Perirhinal Cortex Control Trace Conditioning , 2009, The Journal of Neuroscience.

[10]  Mark P. Brandon,et al.  Linking Cellular Mechanisms to Behavior: Entorhinal Persistent Spiking and Membrane Potential Oscillations May Underlie Path Integration, Grid Cell Firing, and Episodic Memory , 2008, Neural plasticity.

[11]  P. Dash,et al.  A Role for Prefrontal Cortex in Memory Storage for Trace Fear Conditioning , 2004, The Journal of Neuroscience.

[12]  M. McEchron,et al.  Single neurons in the medial prefrontal cortex of the rat exhibit tonic and phasic coding during trace fear conditioning. , 2005, Behavioral neuroscience.

[13]  T. Otto,et al.  Dorsal versus ventral hippocampal contributions to trace and contextual conditioning: Differential effects of regionally selective nmda receptor antagonism on acquisition and expression , 2012, Hippocampus.

[14]  T. Shors,et al.  Trace Conditioning and the Hippocampus: The Importance of Contiguity , 2006, The Journal of Neuroscience.

[15]  Michael S Fanselow,et al.  Dorsal hippocampus involvement in trace fear conditioning with long, but not short, trace intervals in mice. , 2005, Behavioral neuroscience.

[16]  R. Barnet,et al.  Trace and long-delay fear conditioning in the developing rat , 2005, Learning & behavior.

[17]  J. Quinn,et al.  Hippocampus and medial prefrontal cortex contributions to trace and contextual fear memory expression over time. , 2013, Learning & memory.

[18]  Joseph E LeDoux,et al.  Why We Think Plasticity Underlying Pavlovian Fear Conditioning Occurs in the Basolateral Amygdala , 1999, Neuron.

[19]  R. Barnet,et al.  Cholinergic modulation of trace conditioning trained in serial compound: A developmental analysis , 2006, Neurobiology of Learning and Memory.

[20]  Eric A. Yttri,et al.  Intermittent ethanol exposure in adolescent rats: dose-dependent impairments in trace conditioning. , 2004, Alcoholism, clinical and experimental research.

[21]  J. Rawlins,et al.  Ventral hippocampal lesions affect anxiety but not spatial learning , 2003, Behavioural Brain Research.

[22]  M. Lewis,et al.  Reversible inactivation of the entorhinal cortex disrupts the establishment and expression of latent inhibition of cued fear conditioning in C57BL/6 mice , 2007, Hippocampus.

[23]  Elliot A. Ludvig,et al.  Magnitude and timing of conditioned responses in delay and trace classical conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus). , 2009, Behavioral neuroscience.

[24]  J. Rawlins,et al.  Regional dissociations within the hippocampus—memory and anxiety , 2004, Neuroscience & Biobehavioral Reviews.

[25]  P. Dash,et al.  Intra-medial prefrontal administration of SCH-23390 attenuates ERK phosphorylation and long-term memory for trace fear conditioning in rats , 2004, Neurobiology of Learning and Memory.

[26]  C. Bonardi,et al.  Dorsal hippocampal involvement in appetitive trace conditioning and interval timing. , 2012, Behavioral neuroscience.

[27]  M. Fanselow,et al.  Dorsal hippocampus NMDA receptors differentially mediate trace and contextual fear conditioning , 2005, Hippocampus.

[28]  M. Jung,et al.  Neural circuits and mechanisms involved in Pavlovian fear conditioning: A critical review , 2006, Neuroscience & Biobehavioral Reviews.

[29]  T. Gould,et al.  Nicotine withdrawal‐induced deficits in trace fear conditioning in C57BL / 6 mice – a role for high‐affinity β2 subunit‐containing nicotinic acetylcholine receptors , 2009, The European journal of neuroscience.

[30]  S. Tonegawa,et al.  Inhibition of p21-activated kinase rescues symptoms of fragile X syndrome in mice , 2007, Proceedings of the National Academy of Sciences.

[31]  T. Gould,et al.  The role of nicotinic acetylcholine receptors in the medial prefrontal cortex and hippocampus in trace fear conditioning , 2010, Neurobiology of Learning and Memory.

[32]  Min Zhuo,et al.  Predicting Aversive Events and Terminating Fear in the Mouse Anterior Cingulate Cortex during Trace Fear Conditioning , 2012, The Journal of Neuroscience.

[33]  June-Seek Choi,et al.  Hippocampal NMDA receptors are necessary for auditory trace fear conditioning measured with conditioned hypoalgesia in rats , 2008, Behavioural Brain Research.

[34]  C. Wotjak,et al.  Trace fear conditioning depends on NMDA receptor activation and protein synthesis within the dorsal hippocampus of mice , 2005, Behavioural Brain Research.

[35]  R. Lockhart,et al.  Comments regarding multiple response phenomena in long interstimulus interval conditioning. , 2007, Psychophysiology.

[36]  M. Sur,et al.  Reduced conditioned fear response in mice that lack Dlx1 and show subtype-specific loss of interneurons , 2009, Journal of Neurodevelopmental Disorders.

[37]  Christof Koch,et al.  Trace but not delay fear conditioning requires attention and the anterior cingulate cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[38]  M. McEchron,et al.  Single neurons in the dentate gyrus and CA1 of the hippocampus exhibit inverse patterns of encoding during trace fear conditioning. , 2005, Behavioral neuroscience.

[39]  R. Rescorla Effect of a stimulus intervening between CS and US in autoshaping. , 1982, Journal of experimental psychology. Animal behavior processes.

[40]  R. Jaffard,et al.  The effects of ibotenic hippocampal lesions on discriminative fear conditioning to context in mice: impairment or facilitation depending on the associative value of a phasic explicit cue , 2003, The European journal of neuroscience.

[41]  M. Wilson,et al.  Formation of Temporal Memory Requires NMDA Receptors within CA1 Pyramidal Neurons , 2000, Neuron.

[42]  W. Gehring,et al.  More attention must be paid: The neurobiology of attentional effort , 2006, Brain Research Reviews.

[43]  M. Ohno,et al.  Temporal memory deficits in Alzheimer's mouse models: rescue by genetic deletion of BACE1 , 2006, The European journal of neuroscience.

[44]  F. Helmstetter,et al.  Trace and contextual fear conditioning are impaired following unilateral microinjection of muscimol in the ventral hippocampus or amygdala, but not the medial prefrontal cortex , 2012, Neurobiology of Learning and Memory.

[45]  J. Peters,et al.  Extinction circuits for fear and addiction overlap in prefrontal cortex. , 2009, Learning & memory.

[46]  Nicolas Singewald,et al.  Individual differences in recovery from traumatic fear , 2013, Trends in Neurosciences.

[47]  Brianne A. Kent,et al.  Muscarinic Receptors in Amygdala Control Trace Fear Conditioning , 2012, PloS one.

[48]  Alexander J. Rivest,et al.  Entorhinal Cortex Layer III Input to the Hippocampus Is Crucial for Temporal Association Memory , 2011, Science.

[49]  Karl J. Friston,et al.  Amygdala–Hippocampal Involvement in Human Aversive Trace Conditioning Revealed through Event-Related Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[50]  R. Coppola,et al.  Specific versus Nonspecific Brain Activity in a Parametric N-Back Task , 2000, NeuroImage.

[51]  T. Gould,et al.  Nicotine enhances trace cued fear conditioning but not delay cued fear conditioning in C57BL/6 mice , 2004, Behavioural Brain Research.

[52]  Hsien-Ting Huang,et al.  In vivo knockdown of hippocampal miR‐132 expression impairs memory acquisition of trace fear conditioning , 2013, Hippocampus.

[53]  Hong-wei Dong,et al.  Are the Dorsal and Ventral Hippocampus Functionally Distinct Structures? , 2010, Neuron.

[54]  F. Helmstetter,et al.  Trace and contextual fear conditioning require neural activity and NMDA receptor-dependent transmission in the medial prefrontal cortex. , 2010, Learning & memory.

[55]  Andrew M. Poulos,et al.  The neuroscience of mammalian associative learning. , 2005, Annual review of psychology.

[56]  Ralph R. Miller,et al.  Backward blocking in first-order conditioning. , 2010, Journal of experimental psychology. Animal behavior processes.

[57]  J. Churchwell,et al.  Medial prefrontal cortex and pavlovian conditioning: trace versus delay conditioning. , 2002, Behavioral neuroscience.

[58]  B. Williams Marking and bridging versus conditioned reinforcement , 1991 .

[59]  M. Lewis,et al.  Signal transduction mechanisms within the entorhinal cortex that support latent inhibition of cued fear conditioning , 2007, Neurobiology of Learning and Memory.

[60]  M. Gluck,et al.  Why trace and delay conditioning are sometimes (but not always) hippocampal dependent: A computational model , 2013, Brain Research.

[61]  M. Segal,et al.  Striking Variations in Corticosteroid Modulation of Long-Term Potentiation along the Septotemporal Axis of the Hippocampus , 2007, The Journal of Neuroscience.

[62]  P. I. Pavlov Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. , 1929, Annals of Neurosciences.

[63]  M. Davis,et al.  Temporal specificity of fear conditioning: effects of different conditioned stimulus-unconditioned stimulus intervals on the fear-potentiated startle effect. , 1989, Journal of experimental psychology. Animal behavior processes.

[64]  Lesions of the dorsal hippocampus block trace fear conditioned potentiation of startle. , 2005 .

[65]  G. Ellison,et al.  DIFFERENTIAL SALIVARY CONDITIONING TO TRACES. , 1964, Journal of Comparative and Physiological Psychology.

[66]  J. Disterhoft,et al.  Neurotoxic lesions of the dorsal hippocampus disrupt auditory‐cued trace heart rate (fear) conditioning in rabbits , 2000, Hippocampus.

[67]  P. Hunt,et al.  Post-training ethanol disrupts trace conditioned fear in rats: Effects of timing of ethanol, dose and trace interval duration , 2009, Neurobiology of Learning and Memory.

[68]  K. Diba,et al.  Prefrontal Activity Links Nonoverlapping Events in Memory , 2013, The Journal of Neuroscience.

[69]  G. Quirk,et al.  Dissociable Roles of Prelimbic and Infralimbic Cortices, Ventral Hippocampus, and Basolateral Amygdala in the Expression and Extinction of Conditioned Fear , 2011, Neuropsychopharmacology.

[70]  M. Zhuo,et al.  Deficits in Trace Fear Memory and Long-Term Potentiation in a Mouse Model for Fragile X Syndrome , 2005, The Journal of Neuroscience.

[71]  P. Hunt,et al.  Impaired trace fear conditioning following neonatal ethanol: reversal by choline. , 2006, Behavioral neuroscience.

[72]  A. E. Butt,et al.  Differential acetylcholine release in the prefrontal cortex and hippocampus during pavlovian trace and delay conditioning , 2011, Neurobiology of Learning and Memory.

[73]  Ralph R. Miller,et al.  When does integration of independently acquired temporal relationships take place? , 2012, Journal of experimental psychology. Animal behavior processes.

[74]  M. Trivedi,et al.  Lesions of the ventral hippocampus, but not the dorsal hippocampus, impair conditioned fear expression and inhibitory avoidance on the elevated T-maze , 2004, Neurobiology of Learning and Memory.

[75]  Nicolas Guyon,et al.  Time Determines the Neural Circuit Underlying Associative Fear Learning , 2011, Front. Behav. Neurosci..

[76]  P. Rozin,et al.  "Learned safety" as a mechanism in long-delay taste-aversion learning in rats. , 1973, Journal of comparative and physiological psychology.

[77]  R. Vertes,et al.  Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat , 2007, Brain Structure and Function.

[78]  Richard F. Thompson,et al.  Extra-cellular signal-regulated kinase 1/2 (ERK1/2) activated in the hippocampal CA1 neurons is critical for retrieval of auditory trace fear memory , 2010, Brain Research.

[79]  M. Trivedi,et al.  Neurotoxic lesions of the dorsal and ventral hippocampus impair acquisition and expression of trace-conditioned fear-potentiated startle in rats , 2006, Behavioural Brain Research.

[80]  Joseph E LeDoux,et al.  Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning. , 1992, Behavioral neuroscience.

[81]  A. Anderson,et al.  An fMRI study of stroop word-color interference: evidence for cingulate subregions subserving multiple distributed attentional systems , 1999, Biological Psychiatry.

[82]  G. Quirk,et al.  Fear Conditioning and Extinction Differentially Modify the Intrinsic Excitability of Infralimbic Neurons , 2008, The Journal of Neuroscience.

[83]  P. Holland,et al.  The influence of CS-US interval on several different indices of learning in appetitive conditioning. , 2008, Journal of experimental psychology. Animal behavior processes.

[84]  T. Robbins,et al.  Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates , 2004, Neuroscience & Biobehavioral Reviews.

[85]  J. Gewirtz,et al.  Timing of fear expression in trace and delay conditioning measured by fear-potentiated startle in rats. , 2004, Learning & memory.

[86]  E. Kehoe,et al.  Temporally specific extinction of conditioned responses in the rabbit (Oryctolagus cuniculus) nictitating membrane preparation. , 2005, Behavioral neuroscience.

[87]  A. Weitemier,et al.  Subregion-specific differences in hippocampal activity between Delay and Trace fear conditioning: an immunohistochemical analysis , 2004, Brain Research.

[88]  V. Lolordo,et al.  Role of safety in the Pavlovian backward fear conditioning procedure. , 1968, Journal of comparative and physiological psychology.

[89]  K. Lattal,et al.  Exposure to a fearful context during periods of memory plasticity impairs extinction via hyperactivation of frontal-amygdalar circuits. , 2013, Learning & memory.

[90]  Timothy J Jarome,et al.  Memory consolidation in both trace and delay fear conditioning is disrupted by intra-amygdala infusion of the protein synthesis inhibitor anisomycin. , 2011, Learning & memory.

[91]  J. Disterhoft,et al.  Where is the trace in trace conditioning? , 2008, Trends in Neurosciences.

[92]  M. Fanselow,et al.  Post‐training excitotoxic lesions of the dorsal hippocampus attenuate forward trace, backward trace, and delay fear conditioning in a temporally specific manner , 2002, Hippocampus.

[93]  T. Abel,et al.  An immediate-shock freezing deficit with discrete cues: a possible role for unconditioned stimulus processing mechanisms. , 2001, Journal of experimental psychology. Animal behavior processes.

[94]  F. Helmstetter,et al.  NR2A- and NR2B-containing NMDA receptors in the prelimbic medial prefrontal cortex differentially mediate trace, delay, and contextual fear conditioning. , 2013, Learning & memory.

[95]  P. Couvillon,et al.  Temporal control of conditioned responding in goldfish. , 2005, Journal of experimental psychology. Animal behavior processes.

[96]  Fred J Helmstetter,et al.  Neural Substrates Mediating Human Delay and Trace Fear Conditioning , 2004, The Journal of Neuroscience.

[97]  N. A. Marlin Contextual associations in trace conditioning , 1981 .

[98]  T. H. Brown,et al.  Auditory trace fear conditioning requires perirhinal cortex , 2008, Neurobiology of Learning and Memory.

[99]  R. Bevins,et al.  One-trial context fear conditioning as a function of the interstimulus interval , 1995 .

[100]  T. Gould,et al.  β2 subunit-containing nicotinic receptors mediate the enhancing effect of nicotine on trace cued fear conditioning in C57BL/6 mice , 2007, Psychopharmacology.

[101]  T. Tully,et al.  RNA interference in hippocampus demonstrates opposing roles for CREB and PP1α in contextual and temporal long‐term memory , 2009, Genes, brain, and behavior.

[102]  M. Zhuo,et al.  Rapid synaptic potentiation within the anterior cingulate cortex mediates trace fear learning , 2012, Molecular Brain.

[103]  D. Paré,et al.  Plastic synaptic networks of the amygdala for the acquisition, expression, and extinction of conditioned fear. , 2010, Physiological reviews.

[104]  Ralph R. Miller,et al.  Timing: An attribute of associative learning , 2014, Behavioural Processes.

[105]  P. Balsam Relative Time in Trace Conditioning , 1984, Annals of the New York Academy of Sciences.

[106]  R. Vertes,et al.  Analysis of the Actions of Nucleus Reuniens and the Entorhinal Cortex on EEG and Evoked Population Behavior of the Hippocampus , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[107]  Facilitation of responding in a filled-delay trace autoshaping procedure: An occasion-setting hypothesis , 1989 .

[108]  M. Rossner,et al.  Deficits in trace fear memory in a mouse model of the schizophrenia risk gene TCF4 , 2013, Behavioural Brain Research.

[109]  A. Hartley,et al.  Locating and fractionating working memory using functional neuroimaging: Storage, maintenance, and executive functions , 2000, Microscopy research and technique.

[110]  E. Kehoe,et al.  Time and stimulus specificity in extinction of the conditioned nictitating membrane response in the rabbit (Oryctolagus cuniculus). , 2007, Behavioral neuroscience.

[111]  J. W. Rudy,et al.  Understanding contextual fear conditioning: insights from a two-process model , 2004, Neuroscience & Biobehavioral Reviews.

[112]  Ralph R. Miller,et al.  Temporal encoding in trace conditioning , 1995 .

[113]  T. Robbins,et al.  Complementary roles for the amygdala and hippocampus in aversive conditioning to explicit and contextual cues , 1991, Neuroscience.

[114]  K. Lattal,et al.  Double Dissociation of Amygdala and Hippocampal Contributions to Trace and Delay Fear Conditioning , 2011, PloS one.

[115]  J. Grafman,et al.  Dorsolateral prefrontal contributions to human working memory , 2013, Cortex.

[116]  J. Disterhoft,et al.  Hippocampectomy disrupts auditory trace fear conditioning and contextual fear conditioning in the rat , 1999, Hippocampus.

[117]  Brianne A. Kent,et al.  Dual functions of perirhinal cortex in fear conditioning , 2012, Hippocampus.

[118]  J. Sweatt,et al.  A necessity for MAP kinase activation in mammalian spatial learning. , 1999, Learning & memory.

[119]  Joseph E LeDoux,et al.  Detection of a Temporal Error Triggers Reconsolidation of Amygdala-Dependent Memories , 2013, Current Biology.

[120]  T. Otto,et al.  Differential contributions of dorsal vs. ventral hippocampus to auditory trace fear conditioning , 2007, Neurobiology of Learning and Memory.

[121]  P. Dash,et al.  Inhibition of hippocampal protein synthesis following recall disrupts expression of episodic‐like memory in trace conditioning , 2005, Hippocampus.

[122]  T. Otto,et al.  Dissociating space and trace in dorsal and ventral hippocampus , 2009, Hippocampus.

[123]  Christof Koch,et al.  Inverse temporal contributions of the dorsal hippocampus and medial prefrontal cortex to the expression of long-term fear memories. , 2008, Learning & memory.

[124]  R. Vertes Differential projections of the infralimbic and prelimbic cortex in the rat , 2004, Synapse.

[125]  T. Otto,et al.  Time course of dorsal and ventral hippocampal involvement in the expression of trace fear conditioning , 2013, Neurobiology of Learning and Memory.

[126]  E. Coutureau,et al.  Differential contribution of dorsal and ventral hippocampus to trace and delay fear conditioning , 2009, Hippocampus.

[127]  R. Richardson,et al.  Pharmacological dissociation of trace and long-delay fear conditioning in young rats , 2007, Neurobiology of Learning and Memory.

[128]  J. Gewirtz,et al.  Dissociable effects of hippocampus lesions on expression of fear and trace fear conditioning memories in rats , 2006, Hippocampus.

[129]  L. Kamin,et al.  Trace conditioning of the conditioned emotional response. , 1961, Journal of comparative and physiological psychology.

[130]  O. Stiedl,et al.  Time‐dependent involvement of the dorsal hippocampus in trace fear conditioning in mice , 2005, Hippocampus.

[131]  Michael R. Hunsaker,et al.  Effects of ventral and dorsal CA1 subregional lesions on trace fear conditioning , 2006, Neurobiology of Learning and Memory.

[132]  J. Disterhoft,et al.  Hippocampectomy disrupts trace eye-blink conditioning in rabbits. , 1990, Behavioral neuroscience.

[133]  Jane E. Joseph,et al.  Prefrontal cortex and drug abuse vulnerability: Translation to prevention and treatment interventions , 2011, Brain Research Reviews.

[134]  J. Disterhoft,et al.  Hippocampectomy disrupts trace eye-blink conditioning in rabbits. , 1990, Behavioral neuroscience.

[135]  E. Coutureau,et al.  A Cholinergic-Dependent Role for the Entorhinal Cortex in Trace Fear Conditioning , 2009, The Journal of Neuroscience.