Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior

A way to modulate reward-seeking Which brain regions are causally involved in reward-related behavior? Ferenczi et al. combined focal, cell type-specific, optogenetic manipulations with brain imaging, behavioral testing, and in vivo electrophysiology (see the Perspective by Robbins). Stimulation of midbrain dopamine neurons increased activity in a brain region called the striatum and was correlated with reward-seeking across individual animals. However, elevated excitability of an area called the medial prefrontal cortex reduced both striatal responses to the stimulation of dopamine neurons and the behavioral drive to seek the stimulation of dopamine neurons. Finally, modulating the excitability of medial prefrontal cortex pyramidal neurons drove changes in neural circuit synchrony, as well as corresponding anhedonic behavior. These observations resemble imaging and clinical phenotypes observed in human depression, addiction, and schizophrenia. Science, this issue p. 10.1126/science.aac9698; see also p. 10.1126/science.aad9698 Optogenetic and brain imaging approaches reveal a causal brainwide dynamical mechanism for the hedonic-anhedonic transition. [Also see Perspective by Robbins] INTRODUCTION The drive to seek and experience reward is conserved across species and, in mammals, involves interactions between subcortical dopaminergic systems and limbic structures such as the striatum. Impairment of this process, observed across a number of psychiatric conditions, is the clinical symptom of anhedonia (loss of enjoyment). The neural mechanisms underlying anhedonia are unknown but could result from abnormal interactions between cortical and subcortical reward circuits. We sought to test the hypothesis that elevated medial prefrontal cortex (mPFC) excitability (a clinical feature associated with anhedonia) exerts suppressive control over the interactions between two distant subcortical regions: the dopaminergic midbrain and the striatum. RATIONALE Clinical imaging studies have detected elevated activity in the mPFC in human patients with depression, and treatment is associated with normalization of this overactivity and improvement of anhedonic symptoms. Additionally, human studies have identified areas of the brain that respond to reward anticipation and experience, and this response can be suppressed in psychiatric disease. However, the source of this reward signal and the mechanisms underlying its modulation have not been causally demonstrated. We have integrated a diverse set of chronic and acute optogenetic tools with functional magnetic resonance imaging (fMRI) to provide a bridge between the causal, cellular specificity of rodent optogenetics and the brainwide observations that characterize human neuroimaging, with the goal of locally manipulating and globally visualizing neural activity to understand the regulation of reward-seeking behavior. RESULTS We demonstrate that stimulation of midbrain dopamine neurons drives both striatal fMRI blood oxygen level–dependent (BOLD) activity and reward-seeking behavior, and we show that these are correlated across individuals. We additionally find that silencing of dopamine neurons suppresses activity in the striatum, as well as in other brain regions (such as the hypothalamus), and drives avoidance behavior. Having established this bidirectional control of reward-seeking behavior, we then tested for perturbation of this circuitry via elevation of mPFC excitability. We observed suppression of striatal responses to dopamine, as well as the behavioral drive to seek out dopamine neuron stimulation and other natural rewarding stimuli. Finally, we demonstrate that stably elevated mPFC excitability synchronizes corticolimbic BOLD and electrophysiological activity, which in turn can predict anhedonic behavior in individual animals. CONCLUSION Our findings from experiments involving local cell-specific control, simultaneously with global unbiased observation of neural activity, reveal that the mPFC exerts top-down control over midbrain dopaminergic interactions with the striatum and that, when elevated, activity in the mPFC can suppress natural reward-related behavior. Furthermore, we observe that cortical-subcortical neural dynamics work in concert to regulate reward processing. All of these findings have implications for our understanding of natural reward-related physiology and behavior, as well as the pathogenesis of anhedonia. Reward-related signaling between the dopaminergic midbrain and the striatum is under suppressive control by the mPFC. Optogenetic fMRI was used to locally manipulate and globally visualize brainwide neural activity related to reward. Habituated rats were scanned in the awake state (top photographs). We establish that striatal BOLD activity is increased by optogenetic stimulation of dopamine neurons and decreased by optogenetic neural silencing. We demonstrate that focally elevated mPFC excitability suppresses reward-seeking behavior by exerting top-down control over striatal dopamine-induced activity and drives synchrony between specific corticolimbic circuits. Motivation for reward drives adaptive behaviors, whereas impairment of reward perception and experience (anhedonia) can contribute to psychiatric diseases, including depression and schizophrenia. We sought to test the hypothesis that the medial prefrontal cortex (mPFC) controls interactions among specific subcortical regions that govern hedonic responses. By using optogenetic functional magnetic resonance imaging to locally manipulate but globally visualize neural activity in rats, we found that dopamine neuron stimulation drives striatal activity, whereas locally increased mPFC excitability reduces this striatal response and inhibits the behavioral drive for dopaminergic stimulation. This chronic mPFC overactivity also stably suppresses natural reward-motivated behaviors and induces specific new brainwide functional interactions, which predict the degree of anhedonia in individuals. These findings describe a mechanism by which mPFC modulates expression of reward-seeking behavior, by regulating the dynamical interactions between specific distant subcortical regions.

[1]  A. Grace Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia , 1991, Neuroscience.

[2]  H. Groenewegen,et al.  Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat , 1992, The Journal of comparative neurology.

[3]  H. Rockette,et al.  From the laboratory to the clinic: the "prevalence effect". , 2003, Academic radiology.

[4]  AC Tose Cell , 1993, Cell.

[5]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[6]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[7]  R. Mark Wightman,et al.  Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter , 1996, Nature.

[8]  G H Glover,et al.  Decomposition of inflow and blood oxygen level‐dependent (BOLD) effects with dual‐echo spiral gradient‐recalled echo (GRE) fMRI , 1996, Magnetic resonance in medicine.

[9]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[10]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[11]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[12]  M. Jackson,et al.  Stimulation of prefrontal cortex at physiologically relevant frequencies inhibits dopamine release in the nucleus accumbens , 2001, Journal of neurochemistry.

[13]  J. Bourne,et al.  SCH 23390: the first selective dopamine D1-like receptor antagonist. , 2006, CNS drug reviews.

[14]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[15]  G. Glover,et al.  Spiral‐in/out BOLD fMRI for increased SNR and reduced susceptibility artifacts , 2001, Magnetic resonance in medicine.

[16]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[17]  K. Berridge,et al.  The Neuroscience of Natural Rewards: Relevance to Addictive Drugs , 2002, The Journal of Neuroscience.

[18]  Mark A Frye,et al.  Principal components of the beck depression inventory and regional cerebral metabolism in unipolar and bipolar depression , 2002, Biological Psychiatry.

[19]  D. Rosielle,et al.  Psychiatry , 1905, NeuroImage.

[20]  Geoffrey M. Boynton,et al.  Efficient Design of Event-Related fMRI Experiments Using M-Sequences , 2002, NeuroImage.

[21]  W. Schultz,et al.  Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm , 2003, The Journal of Neuroscience.

[22]  John Suckling,et al.  Neural response to pleasant stimuli in anhedonia: an fMRI study , 2003, Neuroreport.

[23]  R. Wightman,et al.  Detecting subsecond dopamine release with fast-scan cyclic voltammetry in vivo. , 2003, Clinical chemistry.

[24]  Garret D Stuber,et al.  Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. , 2003, Methods in molecular medicine.

[25]  Andrew Simmons,et al.  Neural abnormalities during cognitive generation of affect in Treatment-Resistant depression , 2003, Biological Psychiatry.

[26]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[27]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[28]  Brian Knutson,et al.  Amphetamine Modulates Human Incentive Processing , 2004, Neuron.

[29]  K. Deisseroth,et al.  Millisecond-timescale, genetically targeted optical control of neural activity , 2005, Nature Neuroscience.

[30]  Steven C. R. Williams,et al.  The Neural Correlates of Anhedonia in Major Depressive Disorder , 2005, Biological Psychiatry.

[31]  Wei Chen,et al.  Procedure for minimizing stress for fMRI studies in conscious rats , 2005, Journal of Neuroscience Methods.

[32]  A. Lozano,et al.  Deep Brain Stimulation for Treatment-Resistant Depression , 2005, Neuron.

[33]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[34]  Brian Knutson,et al.  Linking nucleus accumbens dopamine and blood oxygenation , 2007, Psychopharmacology.

[35]  Arno Villringer,et al.  Dysfunction of ventral striatal reward prediction in schizophrenia , 2006, NeuroImage.

[36]  E. Nestler,et al.  The Mesolimbic Dopamine Reward Circuit in Depression , 2006, Biological Psychiatry.

[37]  J. Pruessner,et al.  Individual differences in trait anhedonia: a structural and functional magnetic resonance imaging study in non-clinical subjects , 2007, Molecular Psychiatry.

[38]  Feng Zhang,et al.  An optical neural interface: in vivo control of rodent motor cortex with integrated fiberoptic and optogenetic technology , 2007, Journal of neural engineering.

[39]  K. Ressler,et al.  Targeting abnormal neural circuits in mood and anxiety disorders: from the laboratory to the clinic , 2007, Nature Neuroscience.

[40]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[41]  G. Glover,et al.  Resting-State Functional Connectivity in Major Depression: Abnormally Increased Contributions from Subgenual Cingulate Cortex and Thalamus , 2007, Biological Psychiatry.

[42]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[43]  K. Deisseroth,et al.  eNpHR: a Natronomonas halorhodopsin enhanced for optogenetic applications , 2008, Brain cell biology.

[44]  K. Deisseroth,et al.  Red-shifted optogenetic excitation: a tool for fast neural control derived from Volvox carteri , 2008, Nature Neuroscience.

[45]  Rainer Goebel,et al.  Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns , 2008, NeuroImage.

[46]  H. Heinze,et al.  Mesolimbic Functional Magnetic Resonance Imaging Activations during Reward Anticipation Correlate with Reward-Related Ventral Striatal Dopamine Release , 2008, The Journal of Neuroscience.

[47]  N. Meinshausen,et al.  Stability selection , 2008, 0809.2932.

[48]  P. Gorwood Neurobiological mechanisms of anhedonia , 2008, Dialogues in clinical neuroscience.

[49]  Gary H. Glover,et al.  Interleaved spiral‐in/out with application to functional MRI (fMRI) , 2009, Magnetic resonance in medicine.

[50]  K. Deisseroth,et al.  Bi-stable neural state switches , 2009, Nature Neuroscience.

[51]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[52]  Peter N. C. Mohr,et al.  Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions , 2009, Proceedings of the National Academy of Sciences.

[53]  Elizabeth A. Osuch,et al.  Retrosplenial cortex connectivity in schizophrenia , 2009, Psychiatry Research: Neuroimaging.

[54]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[55]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[56]  Mary Kay Lobo,et al.  Antidepressant Effect of Optogenetic Stimulation of the Medial Prefrontal Cortex , 2010, The Journal of Neuroscience.

[57]  Partha P. Mitra,et al.  Chronux: A platform for analyzing neural signals , 2010, Journal of Neuroscience Methods.

[58]  D. Barch,et al.  Anhedonia and Emotional Experience in Schizophrenia: Neural and Behavioral Indicators , 2010, Biological Psychiatry.

[59]  Dae-Shik Kim,et al.  Global and local fMRI signals driven by neurons defined optogenetically by type and wiring , 2010, Nature.

[60]  Tso-Jung Yen,et al.  Discussion on "Stability Selection" by Meinshausen and Buhlmann , 2010 .

[61]  G. Stuber,et al.  Dopaminergic Terminals in the Nucleus Accumbens But Not the Dorsal Striatum Corelease Glutamate , 2010, The Journal of Neuroscience.

[62]  A. Grace,et al.  Cortico-Basal Ganglia Reward Network: Microcircuitry , 2010, Neuropsychopharmacology.

[63]  Clement Hamani,et al.  Antidepressant-Like Effects of Medial Prefrontal Cortex Deep Brain Stimulation in Rats , 2010, Biological Psychiatry.

[64]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[65]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[66]  Lief E. Fenno,et al.  Neocortical excitation/inhibition balance in information processing and social dysfunction , 2011, Nature.

[67]  T. Moore,et al.  CONTROL OF VISUAL CORTICAL SIGNALS BY PREFRONTAL DOPAMINE , 2011, Nature.

[68]  Ilana B. Witten,et al.  Recombinase-Driver Rat Lines: Tools, Techniques, and Optogenetic Application to Dopamine-Mediated Reinforcement , 2011, Neuron.

[69]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[70]  Joshua D. Berke,et al.  Functional Properties of Striatal Fast-Spiking Interneurons , 2011, Front. Syst. Neurosci..

[71]  Catie Chang,et al.  Variable‐density spiral‐in/out functional magnetic resonance imaging , 2011, Magnetic resonance in medicine.

[72]  A highly sensitive LC-MS/MS method for the determination of S-raclopride in rat plasma: application to a pharmacokinetic study in rats. , 2011, Biomedical chromatography : BMC.

[73]  A. Engel,et al.  Spectral fingerprints of large-scale neuronal interactions , 2012, Nature Reviews Neuroscience.

[74]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[75]  Ali Ghazizadeh,et al.  Prefrontal Cortex Mediates Extinction of Responding by Two Distinct Neural Mechanisms in Accumbens Shell , 2012, The Journal of Neuroscience.

[76]  Robert C. Malenka,et al.  Anhedonia requires MC4 receptor-mediated synaptic adaptations in nucleus accumbens , 2012, Nature.

[77]  K. Deisseroth,et al.  A prefrontal cortex–brainstem neuronal projection that controls response to behavioural challenge , 2012, Nature.

[78]  Larry A. Wasserman,et al.  The huge Package for High-dimensional Undirected Graph Estimation in R , 2012, J. Mach. Learn. Res..

[79]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[80]  M. A. Pisauro,et al.  Fast Hemodynamic Responses in the Visual Cortex of the Awake Mouse , 2013, The Journal of Neuroscience.

[81]  Aaron S. Andalman,et al.  Dopamine neurons modulate neural encoding and expression of depression-related behaviour , 2012, Nature.

[82]  K. Deisseroth,et al.  Rapid regulation of depression-related behaviors by control of midbrain dopamine neurons , 2012, Nature.

[83]  Yihong Yang,et al.  Dorsolateral caudate nucleus differentiates cocaine from natural reward-associated contextual cues , 2013, Proceedings of the National Academy of Sciences.

[84]  K. Nelissen,et al.  Dopaminergic Reward Signals Selectively Decrease fMRI Activity in Primate Visual Cortex , 2013, Neuron.

[85]  E. Nestler,et al.  The brain reward circuitry in mood disorders , 2013, Nature Reviews Neuroscience.

[86]  Jack A. Wells,et al.  fMRI response to blue light delivery in the naïve brain: Implications for combined optogenetic fMRI studies , 2013, NeuroImage.

[87]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[88]  M. Berlim,et al.  Effectiveness and acceptability of deep brain stimulation (DBS) of the subgenual cingulate cortex for treatment-resistant depression: a systematic review and exploratory meta-analysis. , 2014, Journal of affective disorders.

[89]  K. Deisseroth Circuit dynamics of adaptive and maladaptive behaviour , 2014, Nature.

[90]  N. Logothetis,et al.  Dopamine-Induced Dissociation of BOLD and Neural Activity in Macaque Visual Cortex , 2014, Current Biology.

[91]  C. Lüscher,et al.  Pathological circuit function underlying addiction and anxiety disorders , 2014, Nature Neuroscience.

[92]  J. Roiser,et al.  Anti-anhedonic effect of ketamine and its neural correlates in treatment-resistant bipolar depression , 2014, Translational Psychiatry.

[93]  Raag D. Airan,et al.  Natural Neural Projection Dynamics Underlying Social Behavior , 2014, Cell.

[94]  Li Lu,et al.  Coordination of entorhinal–hippocampal ensemble activity during associative learning , 2014, Nature.

[95]  B. Moghaddam,et al.  Teamwork matters: coordinated neuronal activity in brain systems relevant to psychiatric disorders. , 2014, JAMA psychiatry.

[96]  B. Biswal,et al.  Abnormal synchrony and effective connectivity in patients with schizophrenia and auditory hallucinations , 2014, NeuroImage: Clinical.

[97]  Liqun Luo,et al.  Circuit Architecture of VTA Dopamine Neurons Revealed by Systematic Input-Output Mapping , 2015, Cell.

[98]  N. Woodward,et al.  Resting-State Functional Connectivity in Psychiatric Disorders. , 2015, JAMA psychiatry.