Structure Learning in a Sensorimotor Association Task

Learning is often understood as an organism's gradual acquisition of the association between a given sensory stimulus and the correct motor response. Mathematically, this corresponds to regressing a mapping between the set of observations and the set of actions. Recently, however, it has been shown both in cognitive and motor neuroscience that humans are not only able to learn particular stimulus-response mappings, but are also able to extract abstract structural invariants that facilitate generalization to novel tasks. Here we show how such structure learning can enhance facilitation in a sensorimotor association task performed by human subjects. Using regression and reinforcement learning models we show that the observed facilitation cannot be explained by these basic models of learning stimulus-response associations. We show, however, that the observed data can be explained by a hierarchical Bayesian model that performs structure learning. In line with previous results from cognitive tasks, this suggests that hierarchical Bayesian inference might provide a common framework to explain both the learning of specific stimulus-response associations and the learning of abstract structures that are shared by different task environments.

[1]  W. Köhler.  The Mentality of Apes. , 2018, Nature.

[2]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[3]  H. Harlow,et al.  The formation of learning sets. , 1949, Psychological review.

[4]  Cognitive versus stimulus-response theories of learning. , 1950, Psychological review.

[5]  N. Mackintosh,et al.  Intradimensional and extradimensional shift learning by pigeons , 1969 .

[6]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[7]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[8]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[9]  T. Robbins,et al.  The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates , 1988, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[10]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[11]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[12]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[13]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[14]  Thomas L. Griffiths,et al.  Structure Learning in Human Causal Induction , 2000, NIPS.

[15]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[16]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[17]  Dirk van Rijn,et al.  Proceedings of the 31st annual conference of the Cognitive Science Society , 2003 .

[18]  David S. Touretzky,et al.  Model Uncertainty in Classical Conditioning , 2003, NIPS.

[19]  N. Mackintosh,et al.  Intradimensional and extradimensional shifts in spatial learning. , 2003, Journal of experimental psychology. Animal behavior processes.

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  J. Tenenbaum,et al.  Theory-based Bayesian models of inductive learning and reasoning , 2006, Trends in Cognitive Sciences.

[22]  H. Würbel,et al.  Animal neuropsychology: Validation of the Intra-Dimensional Extra-Dimensional set shifting task for mice , 2006, Behavioural Brain Research.

[23]  Aaron C. Courville,et al.  Bayesian theories of conditioning in a changing world , 2006, Trends in Cognitive Sciences.

[24]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[25]  Zhanna Reznikova,et al.  Animal Intelligence: From Individual to Social Cognition , 2007 .

[26]  J. Tenenbaum,et al.  Bayesian Special Section Learning Overhypotheses with Hierarchical Bayesian Models , 2022 .

[27]  David Badre,et al.  Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes , 2008, Trends in Cognitive Sciences.

[28]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[29]  J. Kruschke.  Bayesian approaches to associative learning: From passive to active learning , 2008, Learning & behavior.

[30]  Thomas L. Griffiths,et al.  A Rational Analysis of Rule-Based Concept Learning , 2008, Cogn. Sci..

[31]  Daniel A. Braun,et al.  Learning Optimal Adaptation Strategies in Unpredictable Motor Tasks , 2009, The Journal of Neuroscience.

[32]  J. Tenenbaum,et al.  Learning to learn categories , 2009 .

[33]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[34]  J. Tenenbaum,et al.  Structured statistical models of inductive reasoning. , 2009, Psychological review.

[35]  Natalie M. Myres,et al.  Distinctive Paleo-Indian Migration Routes from Beringia Marked by Two Rare mtDNA Haplogroups , 2009, Current Biology.

[36]  I. Pavlov,et al.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex , 2010, Annals of Neurosciences.

[37]  J. Tenenbaum,et al.  A probabilistic model of theory formation , 2010, Cognition.

[38]  P. I. Pavlov.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. , 1929, Annals of Neurosciences.

[39]  Thomas L. Griffiths,et al.  Learning the Form of Causal Relationships Using Hierarchical Bayesian Models , 2009, Cogn. Sci..

[40]  Daniel A. Braun,et al.  Structure learning in action , 2010, Behavioural Brain Research.