Action Reprogramming in Parkinson's Disease: Response to Prediction Error Is Modulated by Levels of Dopamine

Humans are able to use knowledge of previous events to estimate the probability of future actions. Consequently, an unexpected event will elicit a prediction error as the prepared action has to be replaced by an unprepared option in a process known as “action reprogramming” (AR). Here we show that people with Parkinson's disease (PD) have a dopamine-sensitive deficit in AR that is proportional to the size of the prediction error. Participants performed a probabilistic reaction time (RT) task in the context of either a predictable or unpredictable environment. For an overall predictable sequence, PD patients, on and off dopamine medication, and healthy controls showed similar improvements in RT. However, in the context of a generally predictable sequence, PD patients off medication were impaired in reacting to unexpected events that elicit large prediction errors and require AR. Critically, this deficit in AR was modulated by the prediction error associated with the upcoming event. The prolongation of RT was not observed during an overall unpredictable sequence, in which relatively unexpected events evoke little prediction error and the requirement for AR should be minimal, given the context. The data are compatible with recent theoretical accounts suggesting that levels of dopamine encode the reliability, i.e., precision, of sensory information. In this scheme, PD patients off medication have low dopamine levels and may therefore be less confident about incoming sensory information and more reliant on top-down predictions. Consequently, when these internal predictions are incorrect, PD patients take longer to respond appropriately to unexpected sensory information.

[1]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[2]  M. Hoehn,et al.  Parkinsonism , 1967, Neurology.

[3]  J. Requin,et al.  The effect of conditional probability of the response signal on the simple reaction time. , 1969, Acta psychologica.

[4]  K. Jellinger,et al.  Brain dopamine and the syndromes of Parkinson and Huntington. Clinical, morphological and neurochemical correlations. , 1973, Journal of the neurological sciences.

[5]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[6]  D. Rubin,et al.  Estimation in Covariance Components Models , 1981 .

[7]  M. Horstink,et al.  Cognitive and motor shifting aptitude disorder in Parkinson's disease. , 1984, Journal of neurology, neurosurgery, and psychiatry.

[8]  S. Fahn Unified Parkinson's Disease Rating Scale , 1987 .

[9]  S. Fahn Members of the UPDRS Development Committee. Unified Parkinson's Disease Rating Scale , 1987 .

[10]  C. Marsden,et al.  An investigation of the phenomenon of “set” in Parkinson's disease , 1988, Movement disorders : official journal of the Movement Disorder Society.

[11]  W. Beatty,et al.  Problem Solving in Parkinson's Disease: Comparison of Performance on the Wisconsin and California Card Sorting Tests , 1990, Journal of geriatric psychiatry and neurology.

[12]  Molecular neuroanatomic mechanisms of Parkinson's disease: a proposed therapeutic approach. , 1992, Neurologic clinics.

[13]  J. Hughes,et al.  Accuracy of clinical diagnosis of idiopathic Parkinson's disease: a clinico-pathological study of 100 cases. , 1992, Journal of neurology, neurosurgery, and psychiatry.

[14]  D Servan-Schreiber,et al.  A theory of dopamine function and its role in cognitive deficits in schizophrenia. , 1993, Schizophrenia bulletin.

[15]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[16]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[17]  S. Gilman,et al.  Presynaptic monoaminergic vesicles in Parkinson's disease and normal aging , 1996, Annals of neurology.

[18]  W. Schultz Dopamine neurons and their role in reward mechanisms , 1997, Current Opinion in Neurobiology.

[19]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[20]  A. Bonnet [The Unified Parkinson's Disease Rating Scale]. , 2000, Revue neurologique.

[21]  T. Robbins,et al.  Mechanisms of cognitive set flexibility in Parkinson's disease. , 2001, Brain : a journal of neurology.

[22]  T. Robbins,et al.  Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. , 2001, Cerebral cortex.

[23]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[24]  B A J Reddi,et al.  Accuracy, information, and response time in a saccadic decision task. , 2003, Journal of neurophysiology.

[25]  R. Carpenter,et al.  Contrast, Probability, and Saccadic Latency Evidence for Independence of Detection and Decision , 2004, Current Biology.

[26]  Leslie G. Ungerleider,et al.  Formation of a Motor Memory by Action Observation , 2005, The Journal of Neuroscience.

[27]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[28]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[29]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[30]  P. Redgrave,et al.  The short-latency dopamine signal: a role in discovering novel actions? , 2006, Nature Reviews Neuroscience.

[31]  V. Voon,et al.  Dopamine receptor agonists and levodopa and inducing psychosis-like behavior in the MPTP primate model of Parkinson disease. , 2006, Archives of neurology.

[32]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[33]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[34]  O. Hikosaka,et al.  Switching from automatic to controlled action by monkey medial frontal cortex , 2007, Nature Neuroscience.

[35]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[36]  Karl J. Friston,et al.  Influence of Uncertainty and Surprise on Human Corticospinal Excitability during Preparation for Action , 2008, Current Biology.

[37]  S. Debener,et al.  Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise , 2008, The Journal of Neuroscience.

[38]  O. Hikosaka,et al.  Role for Subthalamic Nucleus Neurons in Switching from Automatic to Controlled Eye Movement , 2008, The Journal of Neuroscience.

[39]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[40]  Patrick W Stroman,et al.  Role of the basal ganglia in switching a planned response , 2009, The European journal of neuroscience.

[41]  Peter N. C. Mohr,et al.  Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions , 2009, Proceedings of the National Academy of Sciences.

[42]  M. Hallett,et al.  Mechanisms Underlying Dopamine-Mediated Reward Bias in Compulsive Behaviors , 2010, Neuron.

[43]  O. Hikosaka,et al.  Perceptual Learning, Motor Learning and Automaticity Switching from Automatic to Controlled Behavior: Cortico-basal Ganglia Mechanisms , 2022 .

[44]  N. Bohnen,et al.  Effect of dopaminergic medications on the time course of explicit motor sequence learning in Parkinson's disease. , 2010, Journal of neurophysiology.

[45]  M D'Esposito,et al.  Enhanced frontal function in Parkinson's disease. , 2010, Brain : a journal of neurology.

[46]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[47]  Ethan R. Buch,et al.  Cortical and subcortical interactions during action reprogramming and their related white matter pathways , 2010, Proceedings of the National Academy of Sciences.

[48]  William D. Penny,et al.  Bayesian model selection maps for group studies , 2009, NeuroImage.

[49]  Karl J. Friston,et al.  Behavioral / Systems / Cognitive Striatal Prediction Error Modulates Cortical Coupling , 2010 .

[50]  B. Averbeck,et al.  Effects of Dopamine Medication on Sequence Learning with Stochastic Feedback in Parkinson's Disease , 2010, Front. Syst. Neurosci..

[51]  Joshua L. Plotkin,et al.  Synaptically driven state transitions in distal dendrites of striatal spiny neurons , 2011, Nature Neuroscience.

[52]  Penny A. MacDonald,et al.  The effect of dopamine therapy on ventral and dorsal striatum-mediated cognition in Parkinson's disease: support from functional MRI. , 2011, Brain : a journal of neurology.

[53]  W. Penny,et al.  Time Scales of Representation in the Human Brain: Weighing Past Information to Predict Future Events , 2011, Front. Hum. Neurosci..

[54]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .