Dopaminergic function and intertemporal choice

The discounting of delayed rewards, also known as temporal or delay discounting, is intrinsic to everyday decisions and can be impaired in pathological states such as addiction disorders. Preclinical and human studies suggest a role for dopaminergic function in temporal discounting but this relationship has not yet been verified using molecular imaging of the living human brain. Here, we evaluated dopaminergic function in temporal discounting using positron emission tomography (PET) with two different dopaminergic ligands assessing three populations in whom temporal discounting has been shown to be impaired. First, we show using [11C]raclopride PET that in pathological gamblers, greater temporal discounting correlates with decreased ventral striatal binding potential, convergent with translational findings of lower nucleus accumbens D2/D3 receptor density in high-impulsive rodents. Temporal discounting also correlates with lower ventral striatal dopamine release in response to high-reward magnitude suggesting that dopamine-mediated devaluation of larger delayed rewards may drive choice preferences. Second, we show using [18F]fluorodopa PET that in Parkinson’s disease, temporal discounting correlates with greater left caudate dopaminergic terminal function. Finally, in subjects with Parkinson’s disease and dopamine medication-induced behavioral addictions, temporal discounting is further correlated with greater dopaminergic terminal function in the anterior putamen. These findings provide insights into the relationship between striatal dopamine function and temporal discounting, and its potential role in pathological disorders and mechanisms underlying treatment interventions.

[1]  Andrew J Lees,et al.  Intact Reward Learning but Elevated Delay Discounting in Parkinson's Disease Patients With Impulsive-Compulsive Spectrum Behaviors , 2010, Neuropsychopharmacology.

[2]  A. Strafella,et al.  Reduced dopamine transporter density in the ventral striatum of patients with Parkinson's disease and pathological gambling , 2010, Neurobiology of Disease.

[3]  Osama Mawlawi,et al.  Imaging Human Mesolimbic Dopamine Transmission with Positron Emission Tomography: I. Accuracy and Precision of D2 Receptor Parameter Measurements in Ventral Striatum , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[4]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[5]  R. Dolan,et al.  Dopamine, Time, and Impulsivity in Humans , 2010, The Journal of Neuroscience.

[6]  T. Robbins,et al.  Limbic Corticostriatal Systems and Delayed Reinforcement , 2004, Annals of the New York Academy of Sciences.

[7]  V. Voon,et al.  Medication-related impulse control and repetitive behaviors in Parkinson disease. , 2007, Archives of neurology.

[8]  Kris N Kirby,et al.  Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. , 2004, Addiction.

[9]  N. Petry Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. , 2001, Journal of abnormal psychology.

[10]  Mikhail N. Koffarnus,et al.  The behavioral- and neuro-economic process of temporal discounting: A candidate behavioral marker of addiction , 2014, Neuropharmacology.

[11]  T. Robbins,et al.  l-Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson’s disease , 2003, Neuropsychologia.

[12]  A. Lammertsma,et al.  Simplified Reference Tissue Model for PET Receptor Studies , 1996, NeuroImage.

[13]  T. Paus,et al.  Repetitive Transcranial Magnetic Stimulation of the Human Prefrontal Cortex Induces Dopamine Release in the Caudate Nucleus , 2001, The Journal of Neuroscience.

[14]  T. Robbins,et al.  Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice , 2004, The Journal of Neuroscience.

[15]  L. Vanderschuren,et al.  Critical Involvement of Dopaminergic Neurotransmission in Impulsive Decision Making , 2006, Biological Psychiatry.

[16]  H. de Wit,et al.  Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats , 1999, Psychopharmacology.

[17]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[18]  H. Möller,et al.  Striatal dopamine release after prefrontal repetitive transcranial magnetic stimulation in major depression: preliminary results of a dynamic [123I] IBZM SPECT study. , 2006, Journal of psychiatric research.

[19]  J. Rinne,et al.  Increased medial orbitofrontal [18F]fluorodopa uptake in Parkinsonian impulse control disorders , 2012, Movement disorders : official journal of the Movement Disorder Society.

[20]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[21]  T. Robbins,et al.  Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: Specific deficits in ‘waiting’ versus ‘stopping’ , 2009, Behavioural Brain Research.

[22]  M. Roesch,et al.  Previous Cocaine Exposure Makes Rats Hypersensitive to Both Delay and Reward Magnitude , 2007, The Journal of Neuroscience.

[23]  Martin P. Paulus,et al.  Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task , 2007, Experimental Brain Research.

[24]  David J. Nutt,et al.  Striatal dopamine D2/D3 receptor binding in pathological gambling is correlated with mood-related impulsivity , 2012, NeuroImage.

[25]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[26]  W. Bickel,et al.  Neuromodulation of delay discounting, the reflection effect, and cigarette consumption. , 2013, Journal of substance abuse treatment.

[27]  W. Schultz,et al.  Influence of Reward Delays on Responses of Dopamine Neurons , 2008, The Journal of Neuroscience.

[28]  I. Toni,et al.  Spatial remapping of cortico-striatal connectivity in Parkinson's disease – a resting state fMRI study , 2009, NeuroImage.

[29]  Marios Politis,et al.  Cue-induced striatal dopamine release in Parkinson's disease-associated impulsive-compulsive behaviours. , 2011, Brain : a journal of neurology.

[30]  Valerie Voon,et al.  Impulse control disorders in Parkinson's disease: decreased striatal dopamine transporter levels , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[31]  L. Diergaarde,et al.  Impulsive Choice and Impulsive Action Predict Vulnerability to Distinct Stages of Nicotine Seeking in Rats , 2008, Biological Psychiatry.

[32]  T. Münte,et al.  Intertemporal choice in Parkinson's disease , 2011, Movement disorders : official journal of the Movement Disorder Society.

[33]  C S Patlak,et al.  Graphical Evaluation of Blood-to-Brain Transfer Constants from Multiple-Time Uptake Data , 1983, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[34]  R. Elliott,et al.  Dopaminergic influences on executive function and impulsive behaviour in impulse control disorders in Parkinson's disease. , 2013, Journal of neuropsychology.

[35]  W. Gibb,et al.  The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson's disease. , 1988, Journal of neurology, neurosurgery, and psychiatry.

[36]  C. Patlak,et al.  Graphical Evaluation of Blood-to-Brain Transfer Constants from Multiple-Time Uptake Data. Generalizations , 1985, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[37]  Ji Hyun Ko,et al.  Dopamine‐agonists and impulsivity in Parkinson's disease: Impulsive choices vs. impulsive actions , 2014, Human brain mapping.

[38]  L. Diergaarde,et al.  Trait Impulsive Choice Predicts Resistance to Extinction and Propensity to Relapse to Cocaine Seeking: A Bidirectional Investigation , 2012, Neuropsychopharmacology.

[39]  Saori C. Tanaka,et al.  Inter-individual discount factor differences in reward prediction are topographically associated with caudate activation , 2011, Experimental Brain Research.

[40]  Young T. Hong,et al.  Nucleus Accumbens D2/3 Receptors Predict Trait Impulsivity and Cocaine Reinforcement , 2007, Science.

[41]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[42]  Brian Knutson,et al.  Dissociable neural representations of future reward magnitude and delay during temporal discounting , 2009, NeuroImage.

[43]  Mark Hallett,et al.  Impulsive choice and response in dopamine agonist-related impulse control behaviors , 2009, Psychopharmacology.

[44]  D. Zald,et al.  Dopaminergic Network Differences in Human Impulsivity , 2010, Science.

[45]  A. Gjedde,et al.  Dopamine release in ventral striatum of pathological gamblers losing money , 2010, Acta psychiatrica Scandinavica.

[46]  Jarkko Johansson,et al.  Mesolimbic dopamine release is linked to symptom severity in pathological gambling , 2012, NeuroImage.

[47]  S. Houle,et al.  Increased striatal dopamine release in Parkinsonian patients with pathological gambling: a [11C] raclopride PET study. , 2009, Brain : a journal of neurology.

[48]  Jennifer M. Mitchell,et al.  Dopamine, Corticostriatal Connectivity, and Intertemporal Choice , 2012, The Journal of Neuroscience.

[49]  Valerie Voon,et al.  Parkinson disease: Impulsive choice—Parkinson disease and dopaminergic therapy , 2011, Nature Reviews Neurology.

[50]  Andrew D. Roberts,et al.  FluoroDOPA PET shows the nondopaminergic as well as dopaminergic destinations of levodopa , 1999, Neurology.

[51]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[52]  T. Robbins,et al.  Impulsive Choice Induced in Rats by Lesions of the Nucleus Accumbens Core , 2001, Science.

[53]  M. Carroll,et al.  Impulsive choice as a predictor of acquisition of IV cocaine self- administration and reinstatement of cocaine-seeking behavior in male and female rats. , 2008, Experimental and clinical psychopharmacology.

[54]  M. Laruelle Imaging Synaptic Neurotransmission with in Vivo Binding Competition Techniques: A Critical Review , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[55]  S. Floresco,et al.  Dopaminergic and Glutamatergic Regulation of Effort- and Delay-Based Decision Making , 2008, Neuropsychopharmacology.

[56]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.