Now or later? Striatum and insula activation to immediate versus delayed rewards.

Neuroimaging studies on delay discounting tasks that use reward delays ranging from minutes to days have implicated the insula and striatum in the processing of inter-temporal decisions. This study aimed at assessing whether these brain regions would also be involved in decision-making when subjects have to wait through the delays within the range of seconds. Employing functional magnetic resonance imaging (fMRI) in thirteen healthy volunteers, we repeatedly presented monetaryoptions with delays that differed within the range of multiple seconds. Using a region of interest approach, we found significant activation in the bilateral anterior insula and striatum when subjects chose either the immediate (smaller) or delayed (larger) option. In particular, insular activation was observed after the response and the delay, when the outcome of the immediate or the delayed choice was shown. Significantly greater activation was observed in the ventroanterior striatum while subjects chose the immediate, as opposed to the delayed, options, and also after receiving the outcome of waiting through the longer delay option. The evidence presented here indicates that both the ventral striatum and the insula are involved in the processing of choosing delay options as well as the consequences of choices with delays in the seconds' range.

[1]  K. Lesch,et al.  Neural Hyporesponsiveness and Hyperresponsiveness During Immediate and Delayed Reward Processing in Adult Attention-Deficit/Hyperactivity Disorder , 2009, Biological Psychiatry.

[2]  W. Schultz,et al.  Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum , 2009, Journal of neurophysiology.

[3]  M. Wittmann.  The inner experience of time , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Kenji Doya,et al.  Humans Can Adopt Optimal Discounting Strategy under Real-Time Constraints , 2006, PLoS Comput. Biol..

[5]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[6]  Corianne Rogalsky,et al.  Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism , 2003, NeuroImage.

[7]  J. Monterosso,et al.  Beyond discounting: possible experimental models of impulse control , 1999, Psychopharmacology.

[8]  Rudolf N. Cardinal,et al.  Neural systems implicated in delayed and probabilistic reinforcement , 2006, Neural Networks.

[9]  George Ainslie,et al.  Frontoparietal cortical activity of methamphetamine‐dependent and comparison subjects performing a delay discounting task , 2007, Human brain mapping.

[10]  Martin P Paulus,et al.  Ventromedial prefrontal cortex activation is critical for preference judgments , 2003, Neuroreport.

[11]  Selin A. Malkoc,et al.  Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences , 2008 .

[12]  G. Berns,et al.  Intertemporal choice – toward an integrative framework , 2007, Trends in Cognitive Sciences.

[13]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[14]  Daeyeol Lee,et al.  Neural Dissociation of Delay and Uncertainty in Intertemporal Choice , 2008, The Journal of Neuroscience.

[15]  David S. Leland,et al.  Impaired time perception and motor timing in stimulant-dependent subjects. , 2007, Drug and alcohol dependence.

[16]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[17]  T. Robbins,et al.  Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans , 2003, Nature Neuroscience.

[18]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[19]  Martin P. Paulus,et al.  Accumulation of Neural Activity in the Posterior Insula Encodes the Passage of Time , 2008 .

[20]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[21]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[22]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[23]  V. Calhoun,et al.  Functional neural circuits for mental timekeeping , 2007, Human brain mapping.

[24]  G. Fricchione.  Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[25]  G. Madden,et al.  Delay discounting of real and hypothetical rewards. , 2003, Experimental and clinical psychopharmacology.

[26]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[27]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[28]  T. Robbins,et al.  Limbic Corticostriatal Systems and Delayed Reinforcement , 2004, Annals of the New York Academy of Sciences.

[29]  Laurent Hugueville,et al.  Neural network involved in time perception: An fMRI study comparing long and short interval estimation , 2005, Human brain mapping.

[30]  Martin P Paulus,et al.  Trend detection via temporal difference model predicts inferior prefrontal cortex activation during acquisition of advantageous action selection , 2004, NeuroImage.

[31]  Evelyn C. Ferstl,et al.  The Anterior Frontomedian Cortex and Evaluative Judgment: An fMRI Study , 2002, NeuroImage.

[32]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[33]  Martin P. Paulus,et al.  Temporal horizons in decision making. , 2009 .

[34]  Taiki Takahashi.  Theoretical Frameworks for Neuroeconomics of Intertemporal Choice , 2011, 1111.6496.

[35]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[36]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[37]  G. Loewenstein,et al.  Beyond Time Discounting , 1997 .

[38]  G. Ainslie.  Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[39]  Warren H Meck,et al.  Frontal-striatal circuitry activated by human peak-interval timing in the supra-seconds range. , 2004, Brain research. Cognitive brain research.

[40]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[41]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[42]  Martin P. Paulus,et al.  Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task , 2007, Experimental Brain Research.

[43]  A. Craig.  How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[44]  S. Lane,et al.  Measurement of delay discounting using trial-by-trial consequences , 2003, Behavioural Processes.

[45]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[46]  D. Cross,et al.  Subjective probability and delay. , 1991, Journal of the experimental analysis of behavior.

[47]  Taiki Takahashi.  Loss of self-control in intertemporal choice may be attributable to logarithmic time-perception. , 2013, Medical hypotheses.

[48]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[49]  A. Odum,et al.  Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers , 1999, Psychopharmacology.