Neural Correlates of Predictive and Postdictive Switching Mechanisms for Internal Models

Switching of sensorimotor tasks may be classified into predictive switching based on contextual information and postdictive switching based on the error between sensorimotor feedback and predictions. We used functional neuroimaging to study the brain regions involved in each type of switching of internal models for visuomotor rotations (clockwise and counterclockwise rotations of visual feedback). The color of a cue presented before movement initiation corresponded to direction of rotation of the feedback in an instructed condition, but not in a noninstructed condition. Switching-related activity was identified as activity that transiently increased after the direction of rotation was changed. The switching-related activity in cue periods in the instructed condition, when a predictive switch is possible, was observed in the superior parietal lobule (SPL). However, the switching-related activity in feedback periods in the noninstructed condition, when prediction error is crucial for the postdictive switch, was observed in the inferior parietal lobule (IPL) and prefrontal cortex. The functional influence of the SPL on the lateral cerebellum, namely, a possible neural correlate for internal models, increased in the instructed condition, but the influence of the IPL on the cerebellum was increased in the noninstructed condition. We observed a rapid activity increase in the instructed condition and a gradual activity increase in the noninstructed condition mainly in the lateral occipito-temporal cortices (LOTC) and supplementary motor cortex (SMA). These results are consistent with separate mechanisms for predictive and postdictive switches and suggest that the LOTC and SMA receive output signals from appropriate internal models.

[1]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[2]  J. Krakauer,et al.  Differential cortical and subcortical activations in learning rotations and gains for reaching: a PET study. , 2004, Journal of neurophysiology.

[3]  Dottie M. Clower,et al.  The Inferior Parietal Lobule Is the Target of Output from the Superior Colliculus, Hippocampus, and Cerebellum , 2001, The Journal of Neuroscience.

[4]  D. Wolpert,et al.  The cerebellum is involved in predicting the sensory consequences of action , 1999, Neuroreport.

[5]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[6]  F. Lacquaniti,et al.  Eye-hand coordination during reaching. I. Anatomical relationships between parietal and frontal cortex. , 2001, Cerebral cortex.

[7]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[8]  M. Kawato,et al.  Cerebro-cerebellar functional connectivity revealed by the laterality index in tool-use learning. , 1999, Neuroreport.

[9]  R. Passingham,et al.  Specialisation within the prefrontal cortex: the ventral prefrontal cortex and associative learning , 2000, Experimental Brain Research.

[10]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[11]  E. Crone,et al.  Neural evidence for dissociable components of task-switching. , 2006, Cerebral cortex.

[12]  Richard M Wilkie,et al.  Neural Systems in the Visual Control of Steering , 2007, The Journal of Neuroscience.

[13]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[14]  K Kawano,et al.  Inverse‐Dynamics Representation of Eye Movements by Cerebellar Purkinje Cell Activity during Short‐Latency Ocular‐Following Responses , 1996, Annals of the New York Academy of Sciences.

[15]  J R Flanagan,et al.  Composition and Decomposition of Internal Models in Motor Learning under Altered Kinematic and Dynamic Environments , 1999, The Journal of Neuroscience.

[16]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[17]  T. Bussey,et al.  Role of prefrontal cortex in a network for arbitrary visuomotor mapping , 2000, Experimental Brain Research.

[18]  S. Yantis,et al.  Transient neural activity in human parietal cortex during spatial attention shifts , 2002, Nature Neuroscience.

[19]  R. Miall,et al.  The cerebellum coordinates eye and hand tracking movements , 2001, Nature Neuroscience.

[20]  J. F. Stein,et al.  Role of the cerebellum in the visual guidance of movement , 1986, Nature.

[21]  D. Gitelman,et al.  Functional Specificity of Superior Parietal Mediation of Spatial Shifting , 2001, NeuroImage.

[22]  D. Pandya,et al.  Anatomical investigation of projections to the basis pontis from posterior parietal association cortices in rhesus monkey , 1989, The Journal of comparative neurology.

[23]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Annette M. Schmid,et al.  An fMRI study of anticipation and learning of smooth pursuit eye movements in humans , 2001, Neuroreport.

[25]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[26]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[27]  G M Rose,et al.  Exposing Rats to a Predator Blocks Primed Burst Potentiation in the Hippocampus In Vitro , 1999, The Journal of Neuroscience.

[28]  D. Pandya,et al.  Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns , 1999, The European journal of neuroscience.

[29]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[30]  W. Schultz Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology , 2004, Current Opinion in Neurobiology.

[31]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[32]  M. Kawato,et al.  Encoding of movement dynamics by Purkinje cell simple spike activity during fast arm movements under resistive and assistive force fields. , 2007, Journal of neurophysiology.

[33]  A. Dove,et al.  Prefrontal cortex activation in task switching: an event-related fMRI study. , 2000, Brain research. Cognitive brain research.

[34]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[35]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[36]  M. Kawato,et al.  Behavioral/systems/cognitive Functional Magnetic Resonance Imaging Examination of Two Modular Architectures for Switching Multiple Internal Models , 2022 .

[37]  J. Culham,et al.  The role of parietal cortex in visuomotor control: What have we learned from neuroimaging? , 2006, Neuropsychologia.

[38]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[39]  Vinod Goel,et al.  Differential involvement of left prefrontal cortexin inductive and deductive reasoning , 2004, Cognition.

[40]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[41]  T. Vilis,et al.  Integration of target and effector information in human posterior parietal cortex for the planning of action. , 2005, Journal of neurophysiology.

[42]  H. Eng,et al.  Synthesis of β-Tubulin, Actin, and Other Proteins in Axons of Sympathetic Neurons in Compartmented Cultures , 1999, The Journal of Neuroscience.

[43]  M. Kawato,et al.  Reorganization of Brain Activity for Multiple Internal Models After Short But Intensive Training , 2007, Cortex.

[44]  Mitsuo Kawato,et al.  Central control of grasp: Manipulation of objects with complex and simple dynamics , 2007, NeuroImage.

[45]  S. Kitazawa,et al.  Effects of delayed visual information on the rate and amount of prism adaptation in the human , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  J C Mazziotta,et al.  Reafferent copies of imitated actions in the right superior temporal cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Hermann J. Müller,et al.  Selective and interactive neural correlates of visual dimension changes and response changes , 2006, NeuroImage.

[48]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[49]  P. Strick,et al.  Cerebellar Loops with Motor Cortex and Prefrontal Cortex of a Nonhuman Primate , 2003, The Journal of Neuroscience.

[50]  M. Kawato,et al.  Random presentation enables subjects to adapt to two opposing forces on the hand , 2004, Nature Neuroscience.

[51]  K. Zilles,et al.  Crossmodal Processing of Object Features in Human Anterior Intraparietal Cortex An fMRI Study Implies Equivalencies between Humans and Monkeys , 2002, Neuron.

[52]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[53]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[54]  M. Kawato,et al.  Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocculus during ocular following responses in monkeys I. Simple spikes. , 1998, Journal of neurophysiology.

[55]  Stephen H. Scott,et al.  Overlap of internal models in motor cortex for mechanical loads during reaching , 2002, Nature.

[56]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[57]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[58]  M. Kawato,et al.  Acquisition and contextual switching of multiple internal models for different viscous force fields , 2003, Neuroscience Research.

[59]  M. Ito,et al.  Long-term depression. , 1989, Annual review of neuroscience.

[60]  M. Kawato,et al.  Explicit contextual information selectively contributes to predictive switching of internal models , 2007, Experimental Brain Research.

[61]  K. Doya,et al.  Anterior and superior lateral occipito-temporal cortex responsible for target motion prediction during overt and covert visual pursuit , 2006, Neuroscience Research.

[62]  D. Wolpert,et al.  Abnormalities in the awareness and control of action. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[63]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[64]  J. Kravitz,et al.  Conditioned adaptation to prismatic displacement with a tone as the conditional stimulus , 1972 .

[65]  M. Kawato,et al.  Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocculus during ocular following responses in monkeys II. Complex spikes. , 1998, Journal of neurophysiology.

[66]  M. D’Esposito,et al.  Modulation of task-related neural activity in task-switching: an fMRI study. , 2000, Brain research. Cognitive brain research.

[67]  Zoubin Ghahramani,et al.  Modular decomposition in visuomotor learning , 1997, Nature.