Learning Priors for Bayesian Computations in the Nervous System

Our nervous system continuously combines new information from our senses with information it has acquired throughout life. Numerous studies have found that human subjects manage this by integrating their observations with their previous experience (priors) in a way that is close to the statistical optimum. However, little is known about the way the nervous system acquires or learns priors. Here we present results from experiments where the underlying distribution of target locations in an estimation task was switched, manipulating the prior subjects should use. Our experimental design allowed us to measure a subject's evolving prior while they learned. We confirm that through extensive practice subjects learn the correct prior for the task. We found that subjects can rapidly learn the mean of a new prior while the variance is learned more slowly and with a variable learning rate. In addition, we found that a Bayesian inference model could predict the time course of the observed learning while offering an intuitive explanation for the findings. The evidence suggests the nervous system continuously updates its priors to enable efficient behavior.

[1]  Anthony M. Zador,et al.  Asymmetric Dynamics in Optimal Variance Adaptation , 1998, Neural Computation.

[2]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[3]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[4]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[6]  R. Shadmehr,et al.  Long-term adaptation to dynamics of reaching movements: a PET study , 2001, Experimental Brain Research.

[7]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[8]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[9]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[10]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[11]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[12]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[13]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[14]  J. Tenenbaum,et al.  Theory-based Bayesian models of inductive learning and reasoning , 2006, Trends in Cognitive Sciences.

[15]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[16]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[17]  R. Shadmehr,et al.  Effects of human cerebellar thalamus disruption on adaptive control of reaching. , 2006, Cerebral cortex.

[18]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[19]  M. Landy,et al.  Movement planning with probabilistic target information. , 2007, Journal of neurophysiology.

[20]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[21]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[22]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[23]  Timothy E. J. Behrens,et al.  Choice, uncertainty and value in prefrontal and cingulate cortex , 2008, Nature Neuroscience.

[24]  Colin Camerer,et al.  Explicit neural signals reflecting reward uncertainty , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[26]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[27]  Konrad Paul Kording,et al.  Relevance of error: what drives motor adaptation? , 2009, Journal of neurophysiology.

[28]  ChrisD . Frith,et al.  Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia , 2009, Nature Reviews Neuroscience.

[29]  D. Dima,et al.  Understanding why patients with schizophrenia do not perceive the hollow mask illusion using dynamic causal modelling. , 2009, NeuroImage.