Monitoring extracellular pH, oxygen, and dopamine during reward delivery in the striatum of primates

Dopamine projections that extend from the ventral tegmental area to the striatum have been implicated in the biological basis for behaviors associated with reward and addiction. Until recently, it has been difficult to evaluate the complex balance of energy utilization and neural activity in the striatum. Many techniques such as electrophysiology, functional magnetic resonance imaging (fMRI), and fast-scan cyclic voltammetry have been employed to monitor these neurochemical and neurophysiological changes. In this brain region, physiological responses to cues and rewards cause local, transient pH changes. Oxygen and pH are coupled in the brain through a complex system of blood flow and metabolism as a result of transient neural activity. Indeed, this balance is at the heart of imaging studies such as fMRI. To this end, we measured pH and O2 changes with fast-scan cyclic voltammetry in the striatum as indices of changes in metabolism and blood flow in vivo in three Macaca mulatta monkeys during reward-based behaviors. Specifically, the animals were presented with Pavlovian conditioned cues that predicted different probabilities of liquid reward. They also received free reward without predictive cues. The primary detected change consisted of pH shifts in the striatal extracellular environment following the reward predicting cues or the free reward. We observed three types of cue responses that consisted of purely basic pH shifts, basic pH shifts followed by acidic pH shifts, and purely acidic pH shifts. These responses increased with reward probability, but were not significantly different from each other. The pH changes were accompanied by increases in extracellular O2. The changes in pH and extracellular O2 are consistent with current theories of metabolism and blood flow. However, they were of sufficient magnitude that they masked dopamine changes in the majority of cases. The findings suggest a role of these chemical responses in neuronal reward processing.

[1]  R. Wise Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[2]  R. Wightman,et al.  Color images for fast-scan CV measurements in biological systems. , 1998, Analytical chemistry.

[3]  R. Wightman,et al.  Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens , 2007, The European journal of neuroscience.

[4]  Joshua L. Jones,et al.  Basolateral Amygdala Modulates Terminal Dopamine Release in the Nucleus Accumbens and Conditioned Responding , 2010, Biological Psychiatry.

[5]  R. Wightman,et al.  Correlation of local changes in extracellular oxygen and pH that accompany dopaminergic terminal activity in the rat caudate–putamen , 2003, Journal of neurochemistry.

[6]  J. LaManna,et al.  Structural and functional adaptation to hypoxia in the rat brain , 2004, Journal of Experimental Biology.

[7]  M. Chesler Regulation and modulation of pH in the brain. , 2003, Physiological reviews.

[8]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[9]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[10]  W. Schultz,et al.  Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm , 2003, The Journal of Neuroscience.

[11]  J. O'Doherty,et al.  Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems , 2006, Journal of neurophysiology.

[12]  Junxia Xie,et al.  Pharmacological characterisation of dopamine overflow in the striatum of the normal and MPTP-treated common marmoset, studied in vivo using fast cyclic voltammetry, nomifensine and sulpiride , 1998, Journal of Neuroscience Methods.

[13]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[14]  R. Wightman,et al.  Transient changes in mesolimbic dopamine and their association with ‘reward’ , 2002, Journal of neurochemistry.

[15]  Dae-Shik Kim,et al.  High-resolution mapping of iso-orientation columns by fMRI , 2000, Nature Neuroscience.

[16]  R. Wightman,et al.  Characterization of local pH changes in brain using fast-scan cyclic voltammetry with carbon microelectrodes. , 2010, Analytical chemistry.

[17]  R. Mark Wightman,et al.  Peer Reviewed: Color Images for Fast-Scan CV Measurements in Biological Systems , 1998 .

[18]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[19]  Terry Lohrenz,et al.  Sub-Second Dopamine Detection in Human Striatum , 2011, PloS one.

[20]  R. Wightman,et al.  Detecting subsecond dopamine release with fast-scan cyclic voltammetry in vivo. , 2003, Clinical chemistry.

[21]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[22]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[23]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[24]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[25]  R. Wightman,et al.  Cannabinoid modulation of electrically evoked pH and oxygen transients in the nucleus accumbens of awake rats , 2006, Journal of neurochemistry.

[26]  G. Di Chiara,et al.  Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[27]  P. Dechent,et al.  Basal Cerebral Blood Volume during the Poststimulation Undershoot in BOLD MRI of the Human Brain , 2011, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[28]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[29]  Jens Frahm,et al.  The post-stimulation undershoot in BOLD fMRI of human brain is not caused by elevated cerebral blood volume , 2008, NeuroImage.

[30]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[31]  R. Wightman,et al.  Principles of voltammetry and microelectrode surface states , 1993, Journal of Neuroscience Methods.

[32]  H. Landahl,et al.  The application of brain capillary permeability coefficient measurements to pathological conditions and the selection of agents which cross the blood-brain barrier , 1976, Journal of Pharmacokinetics and Biopharmaceutics.

[33]  K. Miyazaki,et al.  Nucleus accumbens , 2018, Radiopaedia.org.

[34]  L. Shah,et al.  Functional magnetic resonance imaging. , 2010, Seminars in roentgenology.

[35]  S. Kitazawa,et al.  Phasic reward responses in the monkey striatum as detected by voltammetry with diamond microelectrodes , 2011, Neuroscience Research.

[36]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[37]  Zimmerman Jb,et al.  Simultaneous electrochemical measurements of oxygen and dopamine in vivo. , 1991 .

[38]  R. Wightman,et al.  Monitoring rapid chemical communication in the brain. , 2008, Chemical reviews.

[39]  S. Cragg,et al.  Dopamine Release and Uptake Dynamics within Nonhuman Primate Striatum In Vitro , 2000, The Journal of Neuroscience.

[40]  R. Wightman,et al.  Resolving neurotransmitters detected by fast-scan cyclic voltammetry. , 2004, Analytical chemistry.

[41]  G. Stuber,et al.  Neural encoding of cocaine‐seeking behavior is coincident with phasic dopamine release in the accumbens core and shell , 2009, The European journal of neuroscience.

[42]  Pavel Takmakov,et al.  Carbon microelectrodes with a renewable surface. , 2010, Analytical chemistry.

[43]  D. Lübbers,et al.  Time course of changes of extracellular H+ and K+ activities during and after direct electrical stimulation of the brain cortex , 1978, Pflügers Archiv.

[44]  B. Ances,et al.  Coupling of Changes in Cerebral Blood Flow with Neural Activity: What Must Initially Dip Must Come Back Up , 2004, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[45]  R. Buxton,et al.  Modeling the hemodynamic response to brain activation , 2004, NeuroImage.

[46]  R. Freeman,et al.  Single-Neuron Activity and Tissue Oxygenation in the Cerebral Cortex , 2003, Science.

[47]  Joshua L. Jones,et al.  Cocaine Cues Drive Opposing Context-Dependent Shifts in Reward Processing and Emotional State , 2011, Biological Psychiatry.

[48]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[49]  Susan A. Greenfield,et al.  Functional Domains in Dorsal Striatum of the Nonhuman Primate Are Defined by the Dynamic Behavior of Dopamine , 2002, The Journal of Neuroscience.

[50]  R. Wightman,et al.  Carbon-fiber microelectrodes modified with 4-sulfobenzene have increased sensitivity and selectivity for catecholamines. , 2006, Langmuir : the ACS journal of surfaces and colloids.

[51]  R. Wightman,et al.  Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli , 2008, Nature Neuroscience.

[52]  Fabrice Wendling,et al.  Relationship Between Flow and Metabolism in BOLD Signals: Insights from Biophysical Models , 2011, Brain Topography.

[53]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[54]  Garret D Stuber,et al.  Overoxidation of carbon-fiber microelectrodes enhances dopamine adsorption and increases sensitivity. , 2003, The Analyst.

[55]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[56]  R. Wightman,et al.  Multivariate concentration determination using principal component regression with residual analysis. , 2009, Trends in analytical chemistry : TRAC.

[57]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[58]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[59]  George I. Christopoulos,et al.  Risk-dependent reward value signal in human prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[60]  M. Raichle Behind the scenes of functional brain imaging: a historical and physiological perspective. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[61]  R. Wightman,et al.  Simultaneous electrochemical measurements of oxygen and dopamine in vivo. , 1991, Analytical chemistry.

[62]  Wolfram Schultz,et al.  Reward Magnitude Coding in Primate Amygdala Neurons , 2010, Journal of neurophysiology.

[63]  M. Roitman,et al.  Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output , 2005, Neuron.

[64]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[65]  R. Wightman,et al.  Synaptic Overflow of Dopamine in the Nucleus Accumbens Arises from Neuronal Activity in the Ventral Tegmental Area , 2009, The Journal of Neuroscience.

[66]  Bruce R. Ransom,et al.  pH and brain function , 1998 .

[67]  R. Wightman,et al.  Conical tungsten tips as substrates for the preparation of ultramicroelectrodes. , 2006, Langmuir : the ACS journal of surfaces and colloids.