A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: context dependency, extinction, and renewal

RationaleRepeated haloperidol treatment in rodents results in a day-to-day intensification of catalepsy (i.e., sensitization). Prior experiments suggest that this sensitization is context-dependent and resistant to extinction training.ObjectivesThe aim of this study was to provide a neurobiological mechanistic explanation for these findings.Materials and methodsWe use a neurocomputational model of the basal ganglia and simulate two alternative models based on the reward prediction error and novelty hypotheses of dopamine function. We also conducted a behavioral rat experiment to adjudicate between these models. Twenty male Sprague–Dawley rats were challenged with 0.25 mg/kg haloperidol across multiple days and were subsequently tested in either a familiar or novel context.ResultsSimulation results show that catalepsy sensitization, and its context dependency, can be explained by “NoGo” learning via simulated D2 receptor antagonism in striatopallidal neurons, leading to increasingly slowed response latencies. The model further exhibits a non-extinguishable component of catalepsy sensitization due to latent NoGo representations that are prevented from being expressed, and therefore from being unlearned, during extinction. In the rat experiment, context dependency effects were not dependent on the novelty of the context, ruling out the novelty model’s account of context dependency.ConclusionsSimulations lend insight into potential complex mechanisms leading to context-dependent catalepsy sensitization, extinction, and renewal.

[1]  Stephen Grossberg,et al.  How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades , 2004, Neural Networks.

[2]  H. Fibiger,et al.  D1 and D2 dopamine receptors differentially regulate c-fos expression in striatonigral and striatopallidal neurons , 1992, Neuroscience.

[3]  F Ivy Carroll,et al.  Concurrent Autoreceptor-Mediated Control of Dopamine Release and Uptake during Neurotransmission: An In Vivo Voltammetric Study , 2002, The Journal of Neuroscience.

[4]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[5]  G. Reynolds Developments in the drug treatment of schizophrenia. , 1992, Trends in pharmacological sciences.

[6]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[7]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[8]  J. M. Daly,et al.  Dopamine Receptors in the Human Brain , 1994 .

[9]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[10]  Ewelina Knapska,et al.  A gene for neuronal plasticity in the mammalian brain: Zif268/Egr-1/NGFI-A/Krox-24/TIS8/ZENK? , 2004, Progress in Neurobiology.

[11]  S. Charpier,et al.  Spike‐Dependent Intrinsic Plasticity Increases Firing Probability in Rat Striatal Neurons In Vivo , 2003, The Journal of physiology.

[12]  W. Schmidt,et al.  State‐dependent blockade of haloperidol‐induced sensitization of catalepsy by MK‐801 , 1999, The European journal of neuroscience.

[13]  A. Reiner,et al.  Evidence for Differential Cortical Input to Direct Pathway versus Indirect Pathway Striatal Projection Neurons in Rats , 2004, The Journal of Neuroscience.

[14]  J. Yelnik Functional anatomy of the basal ganglia , 2002, Movement disorders : official journal of the Movement Disorder Society.

[15]  P. Garris,et al.  A role for presynaptic mechanisms in the actions of nomifensine and haloperidol , 2003, Neuroscience.

[16]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[17]  W. Schmidt,et al.  Intensification of cataleptic response in 6‐hydroxydopamine‐induced neurodegeneration of substantia nigra is not dependent on the degree of dopamine depletion , 2004, Synapse.

[18]  P. Greengard,et al.  Dichotomous Dopaminergic Control of Striatal Synaptic Plasticity , 2008, Science.

[19]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[20]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour , 2001, Biological Cybernetics.

[21]  Trevor W. Robbins,et al.  Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Michael X. Cohen,et al.  A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism , 2008, The Journal of Neuroscience.

[23]  E. Bézard,et al.  From single extracellular unit recording in experimental and human Parkinsonism to the development of a functional concept of the role played by the basal ganglia in motor control , 2002, Progress in Neurobiology.

[24]  G. Di Chiara,et al.  Catalepsy induced by SCH 23390 in rats. , 1985, European Journal of Pharmacology.

[25]  R. Stiller,et al.  Behavioral effects of a single neuroleptic treatment grow with the passage of time , 1986, Brain Research.

[26]  M. D’Esposito,et al.  Reversal learning in Parkinson's disease depends on medication status and outcome valence , 2006, Neuropsychologia.

[27]  M. Morelli,et al.  Different responsiveness of striatonigral and striatopallidal neurons to L‐DOPA after a subchronic intermittent L‐DOPA treatment , 2005, The European journal of neuroscience.

[28]  L. Hazrati,et al.  Functional anatomy of the basal ganglia , 1995 .

[29]  Benjamin M. Robinson,et al.  Selective Reinforcement Learning Deficits in Schizophrenia Support Predictions from Computational Models of Striatal-Cortical Dysfunction , 2007, Biological Psychiatry.

[30]  M. A. Basso,et al.  Neuronal Activity in Substantia Nigra Pars Reticulata during Target Selection , 2002, The Journal of Neuroscience.

[31]  Jack J. Chen,et al.  A review of intermittent subcutaneous apomorphine injections for the rescue management of motor fluctuations associated with advanced Parkinson's disease. , 2005, Clinical therapeutics.

[32]  W. Schmidt,et al.  Catalepsy intensifies context-dependently irrespective of whether it is induced by intermittent or chronic dopamine deficiency , 2003, Behavioural pharmacology.

[33]  B. Pitt Psychopharmacology , 1968, Mental Health.

[34]  C. Gerfen,et al.  D1 and D2 dopamine receptor function in the striatum: coactivation of D1- and D2-dopamine receptors on separate populations of neurons results in potentiated immediate early gene response in D1-containing neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  P. I. Pavlov Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. , 1929, Annals of Neurosciences.

[36]  J. Glowinski,et al.  Bidirectional Activity-Dependent Plasticity at Corticostriatal Synapses , 2005, The Journal of Neuroscience.

[37]  D. Barnes,et al.  Sensitization versus tolerance to haloperidol-induced catalepsy: Multiple determinants , 1990, Pharmacology, Biochemistry and Behavior.

[38]  C. Gerfen Molecular effects of dopamine on striatal-projection pathways , 2000, Trends in Neurosciences.

[39]  F. Gonon,et al.  Cortical Inputs and GABA Interneurons Imbalance Projection Neurons in the Striatum of Parkinsonian Rats , 2006, The Journal of Neuroscience.

[40]  R. Beninger,et al.  Behavioural Sensitization in Addiction, Schizophrenia, Parkinson’s Disease and Dyskinesia , 2006, Neurotoxicity Research.

[41]  D. Surmeier,et al.  D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons , 2007, Trends in Neurosciences.

[42]  M. Gluck,et al.  Context, conditioning, and hippocampal rerepresentation in animal learning. , 1994, Behavioral neuroscience.

[43]  Anatol C. Kreitzer,et al.  Dopamine Modulation of State-Dependent Endocannabinoid Release and Long-Term Depression in the Striatum , 2005, The Journal of Neuroscience.

[44]  E. Friedman,et al.  Differences in the cataleptogenic actions of SCH23390 and selected classical neuroleptics , 2004, Psychopharmacology.

[45]  M. Jackson,et al.  Stimulus‐specific plasticity of prefrontal cortex dopamine neurotransmission , 2004, Journal of neurochemistry.

[46]  E. Vaadia,et al.  Physiological aspects of information processing in the basal ganglia of normal and parkinsonian primates , 1998, Trends in Neurosciences.

[47]  John N. J. Reynolds,et al.  Dopamine-dependent plasticity of corticostriatal synapses , 2002, Neural Networks.

[48]  Michael J. Frank,et al.  Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making , 2006, Neural Networks.

[49]  P. Garris,et al.  Real‐time decoding of dopamine concentration changes in the caudate–putamen during tonic and phasic firing , 2004, Journal of neurochemistry.

[50]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[51]  P. Calabresi,et al.  Dopaminergic control of synaptic plasticity in the dorsal striatum , 2001, The European journal of neuroscience.

[52]  Robert C. Malenka,et al.  Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models , 2007, Nature.

[53]  P. Seeman Dopamine D2High receptors on intact cells , 2008, Synapse.

[54]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[55]  A. Grace,et al.  Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior , 2005, Nature Neuroscience.

[56]  P. Pini Addiction , 1996, The Lancet.

[57]  P. Calabresi,et al.  Chronic Haloperidol Promotes Corticostriatal Long-Term Potentiation by Targeting Dopamine D2L Receptors , 2004, The Journal of Neuroscience.

[58]  L. Nadel,et al.  Context and conditioning: A place for space , 1980 .

[59]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[60]  C. Gerfen The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. , 1992, Annual review of neuroscience.

[61]  T. Robinson,et al.  The induction of behavioural sensitization is associated with cocaine‐induced structural plasticity in the core (but not shell) of the nucleus accumbens , 2004, The European journal of neuroscience.

[62]  P. Greengard,et al.  Regulation of phosphorylation of the GluR1 AMPA receptor by dopamine D2 receptors , 2006, Journal of neurochemistry.

[63]  P. Glimcher,et al.  Statistics of midbrain dopamine neuron spike trains in the awake primate. , 2007, Journal of neurophysiology.

[64]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[65]  D. Lovinger,et al.  Postsynaptic endocannabinoid release is critical to long-term depression in the striatum , 2002, Nature Neuroscience.

[66]  F. Gonon Prolonged and Extrasynaptic Excitatory Action of Dopamine Mediated by D1 Receptors in the Rat Striatum In Vivo , 1997, The Journal of Neuroscience.

[67]  W. Schmidt,et al.  Context-dependent catalepsy intensification is due to classical conditioning and sensitization , 2003, Behavioural pharmacology.

[68]  W. Schmidt,et al.  NMDA receptor antagonists do not block the development of sensitization of catalepsy, but make its expression state-dependent. , 2001, Behavioural Pharmacology.

[69]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[70]  M. Bouton Context and behavioral processes in extinction. , 2004, Learning & memory.

[71]  A. Graybiel The basal ganglia , 1995, Trends in Neurosciences.

[72]  R. O’Reilly,et al.  Contextual fear conditioning, conjunctive representations, pattern completion, and the hippocampus. , 1999, Behavioral neuroscience.

[73]  Burst activity of spiny projection neurons in the striatum encodes superimposed muscle tetani in cataleptic rats , 2003, Experimental Brain Research.

[74]  J. Palacios,et al.  Dopamine receptors in human brain: Autoradiographic distribution of D2 sites , 1989, Neuroscience.

[75]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[76]  Michael J. Frank,et al.  A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. , 2006, Behavioral neuroscience.

[77]  P. Salin,et al.  Bilateral 6‐Hydroxydopamine‐induced Lesion of the Nigrostriatal Dopamine Pathway Reproduces the Effects of Unilateral Lesion on Substance P but not on Enkephalin Expression in Rat Basal Ganglia , 1996, The European journal of neuroscience.

[78]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[79]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[80]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[81]  Paolo Calabresi,et al.  Dopamine-mediated regulation of corticostriatal synaptic plasticity , 2007, Trends in Neurosciences.

[82]  B Kolb,et al.  Persistent Structural Modifications in Nucleus Accumbens and Prefrontal Cortex Neurons Produced by Previous Experience with Amphetamine , 1997, The Journal of Neuroscience.

[83]  Michael J. Frank,et al.  Testing Computational Models of Dopamine and Noradrenaline Dysfunction in Attention Deficit/Hyperactivity Disorder , 2007, Neuropsychopharmacology.

[84]  Michael J. Frank,et al.  Understanding decision-making deficits in neurological conditions: insights from models of natural action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[85]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[86]  Jadin C. Jackson,et al.  Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. , 2007, Psychological review.

[87]  B. Stein,et al.  Opposing basal ganglia processes shape midbrain visuomotor activity bilaterally , 2003, Nature.

[88]  Michael J. Frank,et al.  Single dose of a dopamine agonist impairs reinforcement learning in humans: Evidence from event‐related potentials and computational modeling of striatal‐cortical function , 2009, Human brain mapping.

[89]  C. Gerfen The neostriatal mosaic: multiple levels of compartmental organization , 1992, Trends in Neurosciences.

[90]  P. Sanberg Haloperidol-induced catalepsy is mediated by postsynaptic dopamine receptors , 1980, Nature.

[91]  I. Pavlov,et al.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. , 1929, Annals of neurosciences.