Structure Learning in Bayesian Sensorimotor Integration

Previous studies have shown that sensorimotor processing can often be described by Bayesian learning, in particular the integration of prior and feedback information depending on its degree of reliability. Here we test the hypothesis that the integration process itself can be tuned to the statistical structure of the environment. We exposed human participants to a reaching task in a three-dimensional virtual reality environment where we could displace the visual feedback of their hand position in a two dimensional plane. When introducing statistical structure between the two dimensions of the displacement, we found that over the course of several days participants adapted their feedback integration process in order to exploit this structure for performance improvement. In control experiments we found that this adaptation process critically depended on performance feedback and could not be induced by verbal instructions. Our results suggest that structural learning is an important meta-learning component of Bayesian sensorimotor integration.

[1]  Daniel A. Braun,et al.  Learning Optimal Adaptation Strategies in Unpredictable Motor Tasks , 2009, The Journal of Neuroscience.

[2]  Daniel A. Braun,et al.  A sensorimotor paradigm for Bayesian model selection , 2012, Front. Hum. Neurosci..

[3]  Daniel A. Braun,et al.  Monte Carlo methods for exact & efficient solution of the generalized optimality equations , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  David S. Leslie,et al.  Optimistic Bayesian Sampling in Contextual-Bandit Problems , 2012, J. Mach. Learn. Res..

[5]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[6]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[7]  M. Landy,et al.  Dynamic Estimation of Task-Relevant Variance in Movement under Risk , 2012, The Journal of Neuroscience.

[8]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[9]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[10]  D. Wolpert,et al.  Motor learning , 2010, Current Biology.

[11]  Jordi Grau-Moya,et al.  Risk-Sensitivity in Bayesian Sensorimotor Integration , 2012, PLoS Comput. Biol..

[12]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[13]  R C Miall,et al.  System Identification Applied to a Visuomotor Task: Near-Optimal Human Performance in a Noisy Changing Task , 2003, The Journal of Neuroscience.

[14]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[15]  Daniel A. Braun,et al.  A Minimum Relative Entropy Principle for Learning and Acting , 2008, J. Artif. Intell. Res..

[16]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[17]  S. Denison,et al.  Probabilistic models, learning algorithms, and response variability: sampling in cognitive development , 2014, Trends in Cognitive Sciences.

[18]  Daniel A. Braun,et al.  Occam's Razor in sensorimotor learning , 2013, Proceedings of the Royal Society B: Biological Sciences.

[19]  Konrad Paul Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007, Science.

[20]  J. Tenenbaum,et al.  Theory-based Bayesian models of inductive learning and reasoning , 2006, Trends in Cognitive Sciences.

[21]  J. Diedrichsen.  Optimal Task-Dependent Changes of Bimanual Feedback Control and Adaptation , 2007, Current Biology.

[22]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[23]  R. J. van Beers,et al.  How the Statistics of Sequential Presentation Influence the Learning of Structure , 2013, PloS one.

[24]  Nir Vulkan.  An Economist's Perspective on Probability Matching , 2000 .

[25]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[26]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[27]  J. Tenenbaum,et al.  Structured statistical models of inductive reasoning. , 2009, Psychological review.

[28]  Jörn Diedrichsen,et al.  Structural learning in feedforward and feedback control. , 2012, Journal of neurophysiology.

[29]  Daniel A. Braun,et al.  Inferring Visuomotor Priors for Sensorimotor Learning , 2011, PLoS Comput. Biol..

[30]  Kazuyuki Aihara,et al.  Bayesian Inference Explains Perception of Unity and Ventriloquism Aftereffect: Identification of Common Sources of Audiovisual Stimuli , 2007, Neural Computation.

[31]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[32]  Rajiv Ranganathan,et al.  Learning Redundant Motor Tasks with and without Overlapping Dimensions: Facilitation and Interference Effects , 2014, The Journal of Neuroscience.

[33]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[34]  Thomas L. Griffiths,et al.  "Burn-in, bias, and the rationality of anchoring" , 2012, NIPS.

[35]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[36]  Mark Mon-Williams,et al.  Exploring structural learning in handwriting , 2010, Experimental Brain Research.

[37]  K.-S. Choi,et al.  Control of vortex shedding from a hemisphere by local suction , 2006, J. Vis..

[38]  D. Kersten,et al.  Illusions, perception and Bayes , 2002, Nature Neuroscience.

[39]  Dmitry Kobak,et al.  Adaptation Paths to Novel Motor Tasks Are Shaped by Prior Structure Learning , 2012, The Journal of Neuroscience.

[40]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[41]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[42]  D. Wolpert,et al.  Structure Learning in a Sensorimotor Association Task , 2010, PloS one.

[43]  C. Shea,et al.  Enhancing motor learning through external-focus instructions and feedback , 1999 .

[44]  Lars-Göran Mattsson,et al.  Probabilistic choice and procedurally bounded rationality , 2002, Games Econ. Behav..

[45]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[46]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[47]  D. Wolpert.  Probabilistic models in human sensorimotor control. , 2007, Human movement science.

[48]  M. Landy,et al.  Movement planning with probabilistic target information. , 2007, Journal of neurophysiology.

[49]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[50]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[51]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[52]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[53]  Ahna R Girshick,et al.  Probabilistic combination of slant information: weighted averaging and robustness as optimal percepts. , 2009, Journal of vision.

[54]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[55]  Eli Brenner,et al.  Structure learning and the Occam's razor principle: a new view of human function acquisition , 2014, Front. Comput. Neurosci..