Motivation in Motor Learning : Dissociable effect of Punishment and Reward

• Users may freely distribute the URL that is used to identify this publication. • Users may download and/or print one copy of the publication from the University of Birmingham research portal for the purpose of private study or non-commercial research. • User may use extracts from the document in line with the concept of ‘fair dealing’ under the Copyright, Designs and Patents Act 1988 (?) • Users may not further distribute the material nor use it for the purposes of commercial gain.

[1]  K. Doya.  Complementary roles of basal ganglia and cerebellum in learning and motor control , 2000, Current Opinion in Neurobiology.

[2]  Emilio Bizzi,et al.  Disruption of Primary Motor Cortex before Learning Impairs Memory of Movement Dynamics , 2006, The Journal of Neuroscience.

[3]  J. Mercer,et al.  PROSPECT THEORY AND POLITICAL SCIENCE , 2005 .

[4]  Monique Ernst,et al.  Decision-making in a Risk-taking Task: A PET Study , 2002, Neuropsychopharmacology.

[5]  Sarah E. Criscimagna-Hemminger,et al.  Contributions of the motor cortex to adaptive control of reaching depend on the perturbation schedule. , 2011, Cerebral cortex.

[6]  C. Ávila,et al.  The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray's anxiety and impulsivity dimensions. , 2001 .

[7]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[8]  Vincent S. Huang,et al.  Robotic neurorehabilitation: a computational motor learning perspective , 2009, Journal of NeuroEngineering and Rehabilitation.

[9]  Vincent S. Huang,et al.  Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models , 2011, Neuron.

[10]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[11]  D Timmann,et al.  Adaptation to visuomotor rotation and force field perturbation is correlated to different brain areas in patients with cerebellar degeneration. , 2009, Journal of neurophysiology.

[12]  T. Mima,et al.  Momentary reward induce changes in excitability of primary motor cortex , 2011, Clinical Neurophysiology.

[13]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[14]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[15]  Tao Liu,et al.  Differential Effect of Reward and Punishment on Procedural Learning , 2009, The Journal of Neuroscience.

[16]  Reza Shadmehr,et al.  Impairment of Retention But Not Acquisition of a Visuomotor Skill Through Time-Dependent Disruption of Primary Motor Cortex , 2007, The Journal of Neuroscience.

[17]  Ferdinando A. Mussa-Ivaldi,et al.  Robot-assisted adaptive training: custom force fields for teaching movement patterns , 2004, IEEE Transactions on Biomedical Engineering.

[18]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[19]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[20]  Ana Pekanovic,et al.  Dopaminergic Projections from Midbrain to Primary Motor Cortex Mediate Motor Skill Learning , 2011, The Journal of Neuroscience.

[21]  Reza Shadmehr,et al.  Learning from Sensory and Reward Prediction Errors during Motor Adaptation , 2011, PLoS Comput. Biol..

[22]  Colin Camerer,et al.  Amygdala damage eliminates monetary loss aversion , 2010, Proceedings of the National Academy of Sciences.

[23]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[24]  D. Wolpert,et al.  Context-Dependent Decay of Motor Memories during Skill Acquisition , 2013, Current Biology.

[25]  Ulrik R Beierholm,et al.  Dopamine Modulates Reward-Related Vigor , 2013, Neuropsychopharmacology.

[26]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[27]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[28]  Eran Dayan,et al.  Stochastic reinforcement benefits skill acquisition , 2014, Learning & memory.

[29]  Roshan Cools,et al.  Dissociable responses to punishment in distinct striatal regions during reversal learning , 2010, NeuroImage.

[30]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[31]  R. Miall,et al.  Secondary tasks impair adaptation to step- and gradual-visual displacements , 2010, Experimental Brain Research.

[32]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[33]  R. Nichols.  Serotonin, presynaptic 5‐HT3 receptors and synaptic plasticity in the developing cerebellum , 2011, The Journal of physiology.

[34]  S. C. Cramer,et al.  Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains , 2013 .

[35]  J. Schmahmann,et al.  Aversion-Related Circuitry in the Cerebellum: Responses to Noxious Heat and Unpleasant Images , 2011, The Journal of Neuroscience.

[36]  J. Krakauer.  Motor learning: its relevance to stroke recovery and neurorehabilitation. , 2006, Current opinion in neurology.

[37]  Yohsuke R. Miyamoto,et al.  Temporal structure of motor variability is dynamically regulated and predicts motor learning ability , 2014, Nature Neuroscience.

[38]  R. Ivry,et al.  Annals of the New York Academy of Sciences the Role of Strategies in Motor Learning , 2022 .

[39]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[40]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[41]  B. Franke,et al.  Dissociable Effects of Dopamine and Serotonin on Reversal Learning , 2013, Neuron.

[42]  A. Haith,et al.  Model-based and model-free mechanisms of human motor learning. , 2013, Advances in experimental medicine and biology.

[43]  L. L. Porter,et al.  Local application of dopamine inhibits pyramidal tract neuron activity in the rodent motor cortex. , 2002, Journal of neurophysiology.

[44]  Andreas R. Luft,et al.  Dopaminergic Meso-Cortical Projections to M1: Role in Motor Learning and Motor Cortex Plasticity , 2013, Front. Neurol..

[45]  Raymond J. Delnicki,et al.  Overcoming Motor “Forgetting” Through Reinforcement Of Learned Actions , 2012, The Journal of Neuroscience.

[46]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[47]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[48]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[49]  R. F. Thompson,et al.  Cerebellum: essential involvement in the classically conditioned eyelid response. , 1984, Science.

[50]  Sven Bestmann,et al.  Punishment-Induced Behavioral and Neurophysiological Variability Reveals Dopamine-Dependent Selection of Kinematic Movement Parameters , 2013, The Journal of Neuroscience.

[51]  Kevin Murphy,et al.  Punishing an Error Improves Learning: The Influence of Punishment Magnitude on Error-Related Neural Activity and Subsequent Learning , 2010, The Journal of Neuroscience.

[52]  John W Krakauer,et al.  Motor learning and consolidation: the case of visuomotor rotation. , 2009, Advances in experimental medicine and biology.

[53]  P. Celnik,et al.  Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns. , 2011, Cerebral cortex.