Cognitive Neurostimulation: Learning to Volitionally Sustain Ventral Tegmental Area Activation

Activation of the ventral tegmental area (VTA) and mesolimbic networks is essential to motivation, performance, and learning. Humans routinely attempt to motivate themselves, with unclear efficacy or impact on VTA networks. Using fMRI, we found untrained participants' motivational strategies failed to consistently activate VTA. After real-time VTA neurofeedback training, however, participants volitionally induced VTA activation without external aids, relative to baseline, Pre-test, and control groups. VTA self-activation was accompanied by increased mesolimbic network connectivity. Among two comparison groups (no neurofeedback, false neurofeedback) and an alternate neurofeedback group (nucleus accumbens), none sustained activation in target regions of interest nor increased VTA functional connectivity. The results comprise two novel demonstrations: learning and generalization after VTA neurofeedback training and the ability to sustain VTA activation without external reward or reward cues. These findings suggest theoretical alignment of ideas about motivation and midbrain physiology and the potential for generalizable interventions to improve performance and learning.

[1]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[2]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[3]  R. DeCharms,et al.  Reading and controlling human brain activation using real-time functional magnetic resonance imaging , 2007, Trends in Cognitive Sciences.

[4]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[5]  Stephen D. Mayhew,et al.  Brainstem functional magnetic resonance imaging: Disentangling signal from physiological noise , 2008, Journal of magnetic resonance imaging : JMRI.

[6]  M. D’Esposito,et al.  Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control , 2011, Biological Psychiatry.

[7]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[8]  Kim Mouridsen,et al.  Dopaminergic stimulation enhances confidence and accuracy in seeing rapidly presented words. , 2011, Journal of vision.

[9]  L. Pessoa,et al.  Embedding Reward Signals into Perception and Cognition , 2010, Front. Neurosci..

[10]  Jeremy Hayward,et al.  The Republic: Plato , 2007 .

[11]  Ulrik R Beierholm,et al.  Dopamine Modulates Reward-Related Vigor , 2013, Neuropsychopharmacology.

[12]  James T. Voyvodic,et al.  Real-Time fMRI Paradigm Control, Physiology, and Behavior Combined with Near Real-Time Statistical Analysis , 1999, NeuroImage.

[13]  J. Salamone,et al.  The Mysterious Motivational Functions of Mesolimbic Dopamine , 2012, Neuron.

[14]  M. Jahanshahi,et al.  Willed action and its impairments. , 1998, Cognitive neuropsychology.

[15]  D. Zald,et al.  Dopaminergic Mechanisms of Individual Differences in Human Effort-Based Decision-Making , 2012, The Journal of Neuroscience.

[16]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[17]  Joseph T. McGuire,et al.  Effort discounting in human nucleus accumbens , 2009, Cognitive, affective & behavioral neuroscience.

[18]  Alison R. Preston,et al.  Reward Modulation of Hippocampal Subfield Activation during Successful Associative Encoding and Retrieval , 2012, Journal of Cognitive Neuroscience.

[19]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[20]  Klaas E. Stephan,et al.  Neurofeedback-mediated self-regulation of the dopaminergic midbrain , 2013, NeuroImage.

[21]  Samuel M. McClure,et al.  BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area , 2008, Science.

[22]  Ian C. Ballard,et al.  Dorsolateral Prefrontal Cortex Drives Mesolimbic Dopaminergic Regions to Initiate Motivated Behavior , 2011, The Journal of Neuroscience.

[23]  Richard G. Wise,et al.  Physiological noise modelling for spinal functional magnetic resonance imaging studies , 2008, NeuroImage.

[24]  P. Dayan,et al.  Dopamine, uncertainty and TD learning , 2005, Behavioral and Brain Functions.

[25]  P. Goldman-Rakic The cortical dopamine system: role in memory and cognition. , 1998, Advances in pharmacology.

[26]  Kimberly S. Chiew,et al.  Mechanisms of motivation–cognition interaction: challenges and opportunities , 2014, Cognitive, affective & behavioral neuroscience.

[27]  L. Shah,et al.  Functional magnetic resonance imaging. , 2010, Seminars in roentgenology.

[28]  Rita Z. Goldstein,et al.  Motivation Deficit in ADHD is Associated with Dysfunction of the Dopamine Reward Pathway , 2010, Molecular Psychiatry.

[29]  Nathaniel Daw,et al.  Tonic Dopamine Modulates Exploitation of Reward Learning , 2010, Front. Behav. Neurosci..

[30]  Woogul Lee,et al.  Self-determined, but not non-self-determined, motivation predicts activations in the anterior insular cortex: an fMRI study of personal agency. , 2013, Social cognitive and affective neuroscience.

[31]  Gary H. Glover,et al.  Control of nucleus accumbens activity with neurofeedback , 2014, NeuroImage.

[32]  Lila Davachi,et al.  Associative Encoding and Retrieval Are Predicted by Functional Connectivity in Distinct Hippocampal Area CA1 Pathways , 2014, The Journal of Neuroscience.

[33]  Emrah Duzel,et al.  A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP , 2011, Trends in Neurosciences.

[34]  P. Dayan,et al.  Reinforcement learning: The Good, The Bad and The Ugly , 2008, Current Opinion in Neurobiology.

[35]  O. Phillipson,et al.  The topographic order of inputs to nucleus accumbens in the rat , 1985, Neuroscience.

[36]  References , 1971 .

[37]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[38]  T. Ono,et al.  Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding in the monkey , 1987, Brain Research.

[39]  R. Wightman,et al.  Rapid Dopamine Signaling in the Nucleus Accumbens during Contingent and Noncontingent Cocaine Administration , 2005, Neuropsychopharmacology.

[40]  R. Veit,et al.  Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI) , 2004, Journal of Physiology-Paris.

[41]  Nicolas Schweighofer,et al.  Positive and negative modulation of word learning by reward anticipation , 2008, Human brain mapping.

[42]  E. Marder Neuromodulation of Neuronal Circuits: Back to the Future , 2012, Neuron.

[43]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[44]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[45]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[46]  M. Frank,et al.  From reinforcement learning models to psychiatric and neurological disorders , 2011, Nature Neuroscience.

[47]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[48]  M. Delgado,et al.  The Inherent Reward of Choice , 2011, Psychological science.

[49]  J. Swanson,et al.  Evaluating dopamine reward pathway in ADHD: clinical implications. , 2009, JAMA.

[50]  T. Braver,et al.  A theory of cognitive control, aging cognition, and neuromodulation , 2002, Neuroscience & Biobehavioral Reviews.

[51]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[52]  Rui M. Costa,et al.  Frontocerebellar Connectivity: Climbing through the Inferior Olive , 2010, Front. Neurosci..

[53]  B. Moghaddam,et al.  Distinct prestimulus and poststimulus activation of VTA neurons correlates with stimulus detection. , 2013, Journal of neurophysiology.

[54]  H. Heinze,et al.  Mesolimbic Functional Magnetic Resonance Imaging Activations during Reward Anticipation Correlate with Reward-Related Ventral Striatal Dopamine Release , 2008, The Journal of Neuroscience.

[55]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[56]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[57]  Mark G. Packard,et al.  The dopaminergic mesencephalic projections to the hippocampal formation in the rat , 1997, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[58]  N. Daw,et al.  Generalization of value in reinforcement learning by humans , 2012, The European journal of neuroscience.

[59]  A. Grace,et al.  The Yin and Yang of dopamine release: a new perspective , 2007, Neuropharmacology.

[60]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[61]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[62]  J. Xiong,et al.  Neural differences between intrinsic reasons for doing versus extrinsic reasons for doing: An fMRI study , 2012, Neuroscience Research.

[63]  Takeo Watanabe,et al.  Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus Presentation , 2011, Science.

[64]  D. Spalding The Principles of Psychology , 1873, Nature.

[65]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[66]  A. Dickinson,et al.  Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour , 2001, The European journal of neuroscience.

[67]  Scott A. Huettel,et al.  Resting state networks distinguish human ventral tegmental area from substantia nigra , 2014, NeuroImage.

[68]  J. Panksepp,et al.  Behavioral functions of the mesolimbic dopaminergic system: An affective neuroethological perspective , 2007, Brain Research Reviews.

[69]  W. Rice ANALYZING TABLES OF STATISTICAL TESTS , 1989, Evolution; international journal of organic evolution.

[70]  D. Shohamy,et al.  Dopamine and adaptive memory , 2010, Trends in Cognitive Sciences.

[71]  Makoto Tsubokura,et al.  Technology of automobile and visualization studies , 2008, J. Vis..

[72]  W. Schultz Multiple dopamine functions at different time courses. , 2007, Annual review of neuroscience.

[73]  Kenji Matsumoto,et al.  Neural basis of the undermining effect of monetary reward on intrinsic motivation , 2010, Proceedings of the National Academy of Sciences.