Linking dopaminergic reward signals to the development of attentional bias: A positron emission tomographic study

&NA; The attention system is shaped by reward history, such that learned reward cues involuntarily draw attention. Recent research has begun to uncover the neural mechanisms by which learned reward cues compete for attention, implicating dopamine (DA) signaling within the dorsal striatum. How these elevated priority signals develop in the brain during the course of learning is less well understood, as is the relationship between value‐based attention and the experience of reward during learning. We hypothesized that the magnitude of the striatal DA response to reward during learning contributes to the development of a learned attentional bias towards the cue that predicted it, and examined this hypothesis using positron emission tomography with [11C]raclopride. We measured changes in dopamine release for rewarded versus unrewarded visual search for color‐defined targets as indicated by the density and distribution of the available D2/D3 receptors. We then tested for correlations of individual differences in this measure of reward‐related DA release to individual differences in the degree to which previously reward‐associated but currently task‐irrelevant stimuli impair performance in an attention task (i.e., value‐driven attentional bias), revealing a significant relationship in the right anterior caudate. The degree to which reward‐related DA release was right hemisphere lateralized was also predictive of later attentional bias. Our findings provide support for the hypothesis that value‐driven attentional bias can be predicted from reward‐related DA release during learning. HighlightsWe related DA‐release attributable to reward processing to distraction by reward cues.Reward‐related DA‐release in the right anterior caudate predicted later distraction.The right anterior caudate uniquely contributed to attentional capture by reward cues.The attention‐related effects of reward on DA‐release exhibited right hemisphere dominance.Our findings provide neural evidence linking reward processing to attentional learning.

[1]  Claus Svarer,et al.  Methods for Motion Correction Evaluation Using 18F-FDG Human Brain Scans on a High-Resolution PET Scanner , 2012, The Journal of Nuclear Medicine.

[2]  Yun Zhou,et al.  Correlation of the vesicular acetylcholine transporter densities in the striata to the clinical abilities of women with rett syndrome , 2012, Synapse.

[3]  Nora D. Volkow,et al.  Incentive motivation is associated with striatal dopamine asymmetry , 2008, Biological Psychology.

[4]  Dean F. Wong,et al.  The Role of Dopamine in Value-Based Attentional Orienting , 2016, Current Biology.

[5]  Brian A. Anderson,et al.  Value-driven attentional priority is context specific , 2014, Psychonomic Bulletin & Review.

[6]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[7]  Steven Yantis,et al.  Attentional Bias for Non-drug Reward is Magnified in Addiction , 2014 .

[8]  James Robert Brašić,et al.  Relationships Among Ventral Striatal Dopamine Release, Cortisol Secretion, and Subjective Responses to Amphetamine , 2005, Neuropsychopharmacology.

[9]  R. P. Maguire,et al.  Consensus Nomenclature for in vivo Imaging of Reversibly Binding Radioligands , 2007, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[10]  Hans-Jochen Heinze,et al.  The Rapid Capture of Attention by Rewarded Objects , 2016, Journal of Cognitive Neuroscience.

[11]  Monique Ernst,et al.  Increased Occupancy of Dopamine Receptors in Human Striatum during Cue-Elicited Cocaine Craving , 2007, Neuropsychopharmacology.

[12]  Arman Rahmim,et al.  Statistical dynamic image reconstruction in state-of-the-art high-resolution PET , 2005, Physics in medicine and biology.

[13]  Yun Zhou,et al.  Single photon emission computed tomography experience with (S)‐5‐[123I]iodo‐3‐(2‐azetidinylmethoxy)pyridine in the living human brain of smokers and nonsmokers , 2009, Synapse.

[14]  W. Nitz,et al.  MP RAGE: a three-dimensional, T1-weighted, gradient-echo sequence--initial experience in the brain. , 1992, Radiology.

[15]  Aaron R. Seitz,et al.  A unified model for perceptual learning , 2005, Trends in Cognitive Sciences.

[16]  Richard E Carson,et al.  Lateralization and gender differences in the dopaminergic response to unpredictable reward in the human ventral striatum , 2011, The European journal of neuroscience.

[17]  Jeih-San Liow,et al.  Linearized Reference Tissue Parametric Imaging Methods: Application to [11C]DASB Positron Emission Tomography Studies of the Serotonin Transporter in Human Brain , 2003, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[18]  Pieter R. Roelfsema,et al.  Attention-Gated Reinforcement Learning of Internal Representations for Classification , 2005, Neural Computation.

[19]  Patrik Vuilleumier,et al.  Influence of reward learning on visual attention and eye movements in a naturalistic environment: A virtual reality study , 2018, PloS one.

[20]  B. Bogerts,et al.  Reduced volume of limbic system-affiliated basal ganglia in mood disorders: preliminary data from a postmortem study. , 1999, The Journal of neuropsychiatry and clinical neurosciences.

[21]  Steven Yantis,et al.  Attentional bias for nondrug reward is magnified in addiction. , 2013, Experimental and clinical psychopharmacology.

[22]  Monique Ernst,et al.  Increased Occupancy of Dopamine Receptors in Human Striatum during Cue-Elicited Cocaine Craving , 2006, Neuropsychopharmacology.

[23]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[24]  M. Mesulam A cortical network for directed attention and unilateral neglect , 1981, Annals of neurology.

[25]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[26]  Karl J. Friston,et al.  Rigid Body Registration , 2003 .

[27]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[28]  Jacqueline Gottlieb,et al.  Integration of Exogenous Input into a Dynamic Salience Map Revealed by Perturbing Attention , 2006, The Journal of Neuroscience.

[29]  Steven Yantis,et al.  Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing , 2012, Attention, Perception, & Psychophysics.

[30]  Sharif I. Kronemer,et al.  Reward, attention, and HIV-related risk in HIV+ individuals , 2016, Neurobiology of Disease.

[31]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[32]  L. Chelazzi,et al.  Reward-based plasticity of spatial priority maps: Exploiting inter-subject variability to probe the underlying neurobiology , 2017, Cognitive neuroscience.

[33]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[34]  Milky Kohno,et al.  Risk-taking behavior: dopamine D2/D3 receptors, feedback, and frontolimbic activity. , 2015, Cerebral cortex.

[35]  T. Egner,et al.  The Neural Underpinnings of How Reward Associations Can Both Guide and Misguide Attention , 2011, The Journal of Neuroscience.

[36]  D. Zald,et al.  Dopaminergic Mechanisms of Individual Differences in Human Effort-Based Decision-Making , 2012, The Journal of Neuroscience.

[37]  Mircea Ariel Schoenfeld,et al.  The modulatory impact of reward and attention on global feature selection in human visual cortex , 2015 .

[38]  Hyoung F. Kim,et al.  Basal ganglia circuits for reward value-guided behavior. , 2014, Annual review of neuroscience.

[39]  D. Zald,et al.  Dopaminergic Network Differences in Human Impulsivity , 2010, Science.

[40]  M. Peelen,et al.  Neural Mechanisms of Incentive Salience in Naturalistic Human Vision , 2015, Neuron.

[41]  Brian A. Anderson,et al.  Reward processing in the value-driven attention network: reward signals tracking cue identity and location , 2016, Social cognitive and affective neuroscience.

[42]  Carol A. Seger,et al.  The visual corticostriatal loop through the tail of the caudate: circuitry and function , 2013, Front. Syst. Neurosci..

[43]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[44]  A. Rahmim,et al.  The second generation HRRT - a multi-centre scanner performance investigation , 2005, IEEE Nuclear Science Symposium Conference Record, 2005.

[45]  J. Theeuwes Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[46]  Osama Mawlawi,et al.  Imaging Human Mesolimbic Dopamine Transmission with Positron Emission Tomography: I. Accuracy and Precision of D2 Receptor Parameter Measurements in Ventral Striatum , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[47]  Marc Laruelle,et al.  Amphetamine‐stimulated dopamine release competes in vivo for [123I]IBZM binding to the D2 receptor in nonhuman primates , 1992, Synapse.

[48]  Mark A. Gluck,et al.  Love to Win or Hate to Lose? Asymmetry of Dopamine D2 Receptor Binding Predicts Sensitivity to Reward versus Punishment , 2014, Journal of Cognitive Neuroscience.

[49]  Senqing Qi,et al.  Neural correlates of reward-driven attentional capture in visual search , 2013, Brain Research.

[50]  Edythe D. London,et al.  Striatal D1- and D2-type Dopamine Receptors Are Linked to Motor Response Inhibition in Human Subjects , 2015, The Journal of Neuroscience.

[51]  Hiroto Kuwabara,et al.  Risky decision-making and ventral striatal dopamine responses to amphetamine: A positron emission tomography [11C]raclopride study in healthy adults , 2015, NeuroImage.

[52]  N. Volkow,et al.  Cocaine Cues and Dopamine in Dorsal Striatum: Mechanism of Craving in Cocaine Addiction , 2006, The Journal of Neuroscience.

[53]  Brian A Anderson,et al.  What is abnormal about addiction-related attentional biases? , 2016, Drug and alcohol dependence.

[54]  Barry Giesbrecht,et al.  Neural evidence reveals the rapid effects of reward history on selective attention , 2015, Brain Research.

[55]  N Ramnani,et al.  A probabilistic MR atlas of the human cerebellum , 2009, NeuroImage.

[56]  Steven Yantis,et al.  Value-driven attentional priority signals in human basal ganglia and visual cortex , 2014, Brain Research.

[57]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[58]  B. Anderson The attention habit: how reward learning shapes attentional selection , 2016, Annals of the New York Academy of Sciences.