Computational principles of sensorimotor control that minimize uncertainty and variability

Sensory and motor noise limits the precision with which we can sense the world and act upon it. Recent research has begun to reveal computational principles by which the central nervous system reduces the sensory uncertainty and movement variability arising from this internal noise. Here we review the role of optimal estimation and sensory filtering in extracting the sensory information required for motor planning, and the role of optimal control, motor adaptation and impedance control in the specification of the motor output signal.

[1]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[2]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[3]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[4]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[5]  J. Eccles,et al.  Central inhibitory action attributable to presynaptic depolarization produced by muscle afferent volleys , 1961, The Journal of physiology.

[6]  D. Wolpert,et al.  When Feeling Is More Important Than Seeing in Sensorimotor Adaptation , 2002, Current Biology.

[7]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[8]  G. Xiong,et al.  Connections of Purkinje cell axons of lobule X with vestibulospinal neurons projecting to the cervical cord in the rat , 2000, Experimental Brain Research.

[9]  D. Wolpert,et al.  Explaining the symptoms of schizophrenia: Abnormalities in the awareness of action , 2000, Brain Research Reviews.

[10]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[11]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[12]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[13]  D. Wolpert,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999, Journal of Cognitive Neuroscience.

[14]  E. Fetz,et al.  Sensory input to primate spinal cord is presynaptically inhibited during voluntary movement , 2003, Nature Neuroscience.

[15]  O. Oscarsson.  Functional units of the cerebellum - sagittal zones and microzones , 1979, Trends in Neurosciences.

[16]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[17]  R. Shadmehr,et al.  Long-term adaptation to dynamics of reaching movements: a PET study , 2001, Experimental Brain Research.

[18]  D. Wolpert,et al.  Attenuation of Self-Generated Tactile Sensations Is Predictive, not Postdictive , 2006, PLoS biology.

[19]  C. C. Bell.  Duration of plastic change in a modifiable efference copy , 1986, Brain Research.

[20]  J. Albus.  A Theory of Cerebellar Function , 1971 .

[21]  R. Sperry.  Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[22]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[23]  Jefferson E. Roy,et al.  Selective Processing of Vestibular Reafference during Self-Generated Head Motion , 2001, The Journal of Neuroscience.

[24]  S. Blakemore,et al.  The perception of self-produced sensory stimuli in patients with auditory hallucinations and passivity experiences: evidence for a breakdown in self-monitoring , 2000, Psychological Medicine.

[25]  C. Bell,et al.  Properties of a modifiable efference copy in an electric fish. , 1982, Journal of neurophysiology.

[26]  R A Scheidt,et al.  Impedance control and internal model formation when reaching in a randomly varying dynamical environment. , 2001, Journal of neurophysiology.

[27]  P. Morasso.  Spatial control of arm movements , 2004, Experimental Brain Research.

[28]  Mitsuo Kawato,et al.  A neural network model for arm trajectory formation using forward and inverse dynamics models , 1993, Neural Networks.

[29]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[30]  D. Wolpert,et al.  Perception of the Consequences of Self-Action Is Temporally Tuned and Event Driven , 2005, Current Biology.

[31]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[32]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[33]  P. Viviani,et al.  The law relating the kinematic and figural aspects of drawing movements. , 1983, Acta psychologica.

[34]  P. R. Davidson,et al.  Widespread access to predictive models in the motor system: a short review , 2005, Journal of neural engineering.

[35]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[36]  M. Ito,et al.  Cerebellar long-term depression: characterization, signal transduction, and functional roles. , 2001, Physiological reviews.

[37]  Michael I. Jordan,et al.  Computational models of sensorimotor integration , 1997 .

[38]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[40]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[41]  J. Houk,et al.  Inferior olivary neurons in the awake cat: detection of contact and passive body displacement. , 1985, Journal of neurophysiology.

[42]  C. Bell.  An efference copy which is modified by reafferent input. , 1981, Science.

[43]  Daniel M. Wolpert,et al.  The Cerebellum Contributes to Somatosensory Cortical Activity during Self-Produced Tactile Stimulation , 1999, NeuroImage.

[44]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[45]  伊藤 正男.  The cerebellum and neural control , 1984 .

[46]  D. Wolpert,et al.  Evidence for sensory prediction deficits in schizophrenia. , 2005, The American journal of psychiatry.

[47]  Reza Shadmehr,et al.  Learning the dynamics of reaching movements results in the modification of arm impedance and long-latency perturbation responses , 2001, Biological Cybernetics.

[48]  S. Gandevia,et al.  Reduction in perceived intensity of cutaneous stimuli during movement: a quantitative study , 2004, Experimental Brain Research.

[49]  Kelvin E. Jones,et al.  Sources of signal-dependent noise during isometric force production. , 2002, Journal of neurophysiology.

[50]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[51]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[52]  I Feinberg,et al.  Efference copy and corollary discharge: implications for thinking and its disorders. , 1978, Schizophrenia bulletin.

[53]  M Ito,et al.  Neurophysiological aspects of the cerebellar motor control system. , 1970, International journal of neurology.

[54]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[55]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[56]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[57]  T. Ebner,et al.  Purkinje cell complex and simple spike changes during a voluntary arm movement learning task in the monkey. , 1992, Journal of neurophysiology.

[58]  G T Gdowski,et al.  Firing behavior of vestibular neurons during active and passive head movements: vestibulo-spinal and other non-eye-movement related neurons. , 1999, Journal of neurophysiology.

[59]  Kelvin E. Jones,et al.  The scaling of motor noise with muscle strength and motor unit number in humans , 2004, Experimental Brain Research.

[60]  R. T. Cox.  Probability, frequency and reasonable expectation , 1990 .

[61]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[62]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  Zoubin Ghahramani,et al.  Computational motor control , 2004 .

[64]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[65]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[66]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[67]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[68]  D. Armstrong,et al.  Complex spikes in Purkinje cells in the lateral vermis (b zone) of the cat cerebellum during locomotion. , 1987, The Journal of physiology.

[69]  J. Bower,et al.  Congruence of spatial organization of tactile projections to granule cell and Purkinje cell layers of cerebellar hemispheres of the albino rat: vertical organization of cerebellar cortex. , 1983, Journal of neurophysiology.

[70]  Curtis C Bell,et al.  Memory-based expectations in electrosensory systems , 2001, Current Opinion in Neurobiology.

[71]  D. Wolpert,et al.  Central cancellation of self-produced tickle sensation , 1998, Nature Neuroscience.

[72]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[73]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[74]  K. Grant,et al.  Storage of a sensory pattern by anti-Hebbian synaptic plasticity in an electric fish. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[75]  Jefferson E. Roy,et al.  Dissociating Self-Generated from Passively Applied Head Motion: Neural Mechanisms in the Vestibular Nuclei , 2004, The Journal of Neuroscience.

[76]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[77]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[78]  Anne C. Sittig,et al.  The precision of proprioceptive position sense , 1998, Experimental Brain Research.

[79]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[80]  J. McGrath,et al.  The cognitive neuropsychology of schizophrenia. , 1997 .

[81]  C. E. Chapman,et al.  Sensory perception during movement in man , 2004, Experimental Brain Research.

[82]  N Hogan,et al.  Stability in Force-Production Tasks , 2001, Journal of motor behavior.

[83]  Manoj Srinivasan,et al.  Computer optimization of a minimal biped model discovers walking and running , 2006, Nature.

[84]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[85]  J. Meditch,et al.  Applied optimal control , 1972, IEEE Transactions on Automatic Control.

[86]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[87]  C. Harris.  On the optimal control of behaviour: a stochastic perspective , 1998, Journal of Neuroscience Methods.

[88]  S. Langer,et al.  Presynaptic receptors , 1978, Nature.

[89]  W. T. Thach,et al.  Purkinje cell activity during motor learning , 1977, Brain Research.

[90]  A. J. Carlson.  ON THE ACTION OF CHLORAL HYDRATE ON THE HEART WITH REFERENCE TO THE SO-CALLED PHYSIOLOGICAL PROPERTIES OF HEART MUSCLE , 1906 .

[91]  D. Wolpert,et al.  Sensorimotor attenuation by central motor command signals in the absence of movement , 2006, Nature Neuroscience.

[92]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[93]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[94]  E. Holst.  Relations between the central Nervous System and the peripheral organs , 1954 .

[95]  D. Wolpert,et al.  Two Eyes for an Eye: The Neuroscience of Force Escalation , 2003, Science.

[96]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[97]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[98]  R. Malenka,et al.  Velocity-dependent suppression of cutaneous sensitivity during movement , 1982, Experimental Neurology.

[99]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.