Representations of uncertainty in sensorimotor control

Uncertainty is ubiquitous in our sensorimotor interactions, arising from factors such as sensory and motor noise and ambiguity about the environment. Setting it apart from previous theories, a quintessential property of the Bayesian framework for making inference about the state of world so as to select actions, is the requirement to represent the uncertainty associated with inferences in the form of probability distributions. In the context of sensorimotor control and learning, the Bayesian framework suggests that to respond optimally to environmental stimuli the central nervous system needs to construct estimates of the sensorimotor transformations, in the form of internal models, as well as represent the structure of the uncertainty in the inputs, outputs and in the transformations themselves. Here we review Bayesian inference and learning models that have been successful in demonstrating the sensitivity of the sensorimotor system to different forms of uncertainty as well as recent studies aimed at characterizing the representation of the uncertainty at different computational levels.

[1]  Richard N Aslin,et al.  Bayesian learning of visual chunks by human observers , 2008, Proceedings of the National Academy of Sciences.

[2]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[3]  Alexandre Pouget,et al.  Optimal Sensorimotor Integration in Recurrent Cortical Networks: A Neural Implementation of Kalman Filters , 2007, The Journal of Neuroscience.

[4]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[5]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[6]  A. Faisal,et al.  Near Optimal Combination of Sensory and Motor Uncertainty in Time During a Naturalistic Perception-Action Task , 2008, Journal of neurophysiology.

[7]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[8]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[9]  Katharina Havermann,et al.  The influence of the consistency of postsaccadic visual errors on saccadic adaptation. , 2010, Journal of neurophysiology.

[10]  Daniel A. Braun,et al.  Structure learning in action , 2010, Behavioural Brain Research.

[11]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[12]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[13]  Hang Zhang,et al.  Gambling in the Visual Periphery: A Conjoint-Measurement Analysis of Human Ability to Judge Visual Uncertainty , 2010, PLoS Comput. Biol..

[14]  David M. Sobel,et al.  A theory of causal learning in children: causal maps and Bayes nets. , 2004, Psychological review.

[15]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[16]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[17]  Daniel A. Braun,et al.  Risk-sensitivity and the mean-variance trade-off: decision making in sensorimotor control , 2011, Proceedings of the Royal Society B: Biological Sciences.

[18]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[19]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[20]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[21]  Thomas L. Griffiths,et al.  Analyzing human feature learning as nonparametric Bayesian inference , 2008, NIPS.

[22]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[23]  Reza Shadmehr,et al.  Some Perspectives on Saccade Adaptation , 2009, Annals of the New York Academy of Sciences.

[24]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[25]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[26]  Daniel A. Braun,et al.  Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty , 2010, PLoS Comput. Biol..

[27]  D. Wolpert,et al.  Structure Learning in a Sensorimotor Association Task , 2010, PloS one.

[28]  Brian C. McCann,et al.  Learning Stochastic Reward Distributions in a Speeded Pointing Task , 2008, The Journal of Neuroscience.

[29]  Daniel R Lametti,et al.  Control of movement variability and the regulation of limb impedance. , 2007, Journal of neurophysiology.

[30]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[31]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[32]  Thomas L. Griffiths,et al.  Latent Features in Similarity Judgments: A Nonparametric Bayesian Approach , 2008, Neural Computation.

[33]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[34]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[35]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[36]  S. Vijayakumar,et al.  A Computational Model of Limb Impedance Control Based on Principles of Internal Model Uncertainty , 2010, PloS one.

[37]  Daniel A. Braun,et al.  Optimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom , 2009, PLoS Comput. Biol..

[38]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[39]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[40]  Peter W Battaglia,et al.  Humans Trade Off Viewing Time and Movement Duration to Improve Visuomotor Accuracy in a Fast Reaching Task , 2007, The Journal of Neuroscience.

[41]  R A Scheidt,et al.  Impedance control and internal model formation when reaching in a randomly varying dynamical environment. , 2001, Journal of neurophysiology.

[42]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[43]  Emanuel Todorov,et al.  Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control , 2007, The Journal of Neuroscience.

[44]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[45]  Daniel A. Braun,et al.  Learning Optimal Adaptation Strategies in Unpredictable Motor Tasks , 2009, The Journal of Neuroscience.

[46]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[47]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[48]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[49]  J. Diedrichsen Optimal Task-Dependent Changes of Bimanual Feedback Control and Adaptation , 2007, Current Biology.

[50]  Thomas L. Griffiths,et al.  Structure Learning in Human Causal Induction , 2000, NIPS.

[51]  Eilon Vaadia,et al.  Neural basis of sensorimotor learning: modifying internal models , 2008, Current Opinion in Neurobiology.

[52]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[53]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[54]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[55]  Reza Shadmehr,et al.  On-Line Processing of Uncertain Information in Visuomotor Control , 2008, The Journal of Neuroscience.

[56]  D. Wolpert,et al.  Specificity of Reflex Adaptation for Task-Relevant Variability , 2008, The Journal of Neuroscience.