A computational model of infant learning and reasoning with probabilities.

Recent experiments reveal that 6- to 12-month-old infants can learn probabilities and reason with them. In this work, we present a novel computational system called Neural Probability Learner and Sampler (NPLS) that learns and reasons with probabilities, providing a computationally sufficient mechanism to explain infant probabilistic learning and inference. In 24 computer simulations, NPLS shows how probability distributions can emerge naturally from neural-network learning of event sequences, providing a novel explanation of infant probabilistic learning and reasoning. Three mathematical proofs show how and why NPLS simulates the infant results so accurately. The results are situated in relation to seven other active research lines. This work provides an effective way to integrate Bayesian and neural-network approaches to cognition. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

[1]  K. Plunkett,et al.  Infant categorization as a dynamic process linked to memory , 2020, Royal Society Open Science.

[2]  Ardavan Salehi Nobandegani,et al.  A Resource-Rational Process-Level Account of the St. Petersburg Paradox , 2020, CogSci.

[3]  J. Call,et al.  Intuitive statistical inferences in chimpanzees and humans follow Weber’s law , 2018, Cognition.

[4]  S. Gershman.  Deconstructing the human algorithms for exploration , 2018, Cognition.

[5]  Noah D. Goodman,et al.  The anchoring bias reflects rational use of cognitive resources , 2018, Psychonomic bulletin & review.

[6]  Rahul Bhui,et al.  Decision by sampling implements efficient coding of psychoeconomic functions , 2017, bioRxiv.

[7]  S. Gershman,et al.  Where do hypotheses come from? , 2017, Cognitive Psychology.

[8]  Ardavan Salehi Nobandegani,et al.  Converting Cascade-Correlation Neural Nets into Probabilistic Generative Models , 2017, CogSci.

[9]  Denis Mareschal,et al.  TRACX2: a connectionist autoencoder using graded chunks to model infant visual statistical learning , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  M. Félix,et al.  Pervasive robustness in biological systems , 2015, Nature Reviews Genetics.

[11]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  C. Summerfield,et al.  Do humans make good decisions? , 2015, Trends in Cognitive Sciences.

[14]  Milad Kharratzadeh,et al.  Neural implementation of probabilistic models of cognition , 2015, Cognitive Systems Research.

[15]  Cristina Savin,et al.  Spatio-temporal Representations of Uncertainty in Spiking Neural Networks , 2014, NIPS.

[16]  Thomas L. Griffiths,et al.  Win-Stay, Lose-Sample: A simple sequential algorithm for approximating Bayesian inference , 2014, Cognitive Psychology.

[17]  Jonathan D. Cohen,et al.  Humans use directed and random exploration to solve the explore-exploit dilemma. , 2014, Journal of experimental psychology. General.

[18]  S. Denison,et al.  Probabilistic models, learning algorithms, and response variability: sampling in cognitive development , 2014, Trends in Cognitive Sciences.

[19]  Stephanie Denison,et al.  The origins of probabilistic inference in human infants , 2014, Cognition.

[20]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[21]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[22]  Thomas R. Shultz,et al.  Computational Models in Developmental Psychology , 2013 .

[23]  Thomas R. Shultz,et al.  A constructive neural-network approach to modeling psychological development , 2012 .

[24]  Adam N. Sanborn,et al.  Bridging Levels of Analysis for Probabilistic Models of Cognition , 2012 .

[25]  Shipra Agrawal,et al.  Analysis of Thompson Sampling for the Multi-armed Bandit Problem , 2011, COLT.

[26]  LouAnn Gerken,et al.  Infants avoid 'labouring in vain' by attending more to learnable than unlearnable linguistic patterns. , 2011, Developmental science.

[27]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[28]  Yoshua Bengio,et al.  A Spike and Slab Restricted Boltzmann Machine , 2011, AISTATS.

[29]  Edward Vul,et al.  Pure Reasoning in 12-Month-Old Infants as Probabilistic Inference , 2011, Science.

[30]  G. Alvarez.  Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[31]  T. Shultz.  Computational Modeling of Infant Concept Learning: The Developmental Shift from Features to Correlations , 2010 .

[32]  S. Denison,et al.  Twelve- to 14-month-old infants can predict single-event probability with large set sizes. , 2010, Developmental science.

[33]  Denis Mareschal,et al.  Computational perspectives on cognitive development. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[34]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[35]  R. Gómez,et al.  Twelve-Month-Old Infants Benefit From Prior Experience in Statistical Learning , 2008, Psychological science.

[36]  Hiroaki Kitano,et al.  Biological robustness , 2008, Nature Reviews Genetics.

[37]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[38]  Fei Xu,et al.  Intuitive statistics by 8-month-old infants , 2008, Proceedings of the National Academy of Sciences.

[39]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  Michael W. Spratling,et al.  Neuroconstructivism - I: How the Brain Constructs Cognition , 2007 .

[41]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[42]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[43]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[44]  Thomas R. Shultz,et al.  Neural networks discover a near-identity relation to distinguish simple syntactic forms , 2006, Minds and Machines.

[45]  T. Shultz,et al.  Modeling developmental cognitive neuroscience , 2006, Trends in Cognitive Sciences.

[46]  J. Elman.  Connectionist models of cognitive development: where next? , 2005, Trends in Cognitive Sciences.

[47]  Thomas R. Shultz,et al.  Modeling Age Differences in Infant Category Learning. , 2004, Infancy : the official journal of the International Society on Infant Studies.

[48]  James L. McClelland,et al.  Connectionist models of development , 2003 .

[49]  T. Shultz.  Computational Developmental Psychology , 2003 .

[50]  Thomas R. Shultz,et al.  Neural Network Simulation of Infant Familiarization to Artificial Sentences: Rule-Like Behavior Without Explicit Rules and Variables. , 2001, Infancy : the official journal of the International Society on Infant Studies.

[51]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[52]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[53]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[54]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[55]  Shumeet Baluja,et al.  Reducing Network Depth in the Cascade-Correlation Learning Architecture, , 1994 .

[56]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[57]  Kelly L. Madole,et al.  Infants' object examining: Habituation and categorization ☆ ☆☆ , 1991 .

[58]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[59]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[60]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[61]  M E BITTERMAN,et al.  Probability-Learning by the Turtle , 1965, Science.

[62]  M. E. Bitterman,et al.  Probability-Matching in the Fish , 1961 .

[63]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[64]  Ardavan Salehi Nobandegani,et al.  On Robustness: An Undervalued Dimension of Human Rationality , 2019, CogSci.

[65]  Ardavan Salehi Nobandegani,et al.  Neural Network Modeling of Learning to Actively Learn , 2019, CogSci.

[66]  J. Brown.  Behavioral Ecology and Sociobiology , 2019, Encyclopedia of Animal Behavior.

[67]  Ardavan Salehi Nobandegani,et al.  Example Generation Under Constraints Using Cascade Correlation Neural Nets , 2018, CogSci.

[68]  Thomas R. Shultz,et al.  Constructive Artificial Neural-Network Models for Cognitive Development , 2017 .

[69]  Diana Sommer,et al.  The Origin Of The Idea Of Chance In Children , 2016 .

[70]  E. Doty,et al.  KNOWING WHEN TO QUIT ON UNLEARNABLE PROBLEMS: ANOTHER STEP TOWARDS AUTONOMOUS LEARNING , 2014 .

[71]  S. Denison,et al.  BRIEF REPORT The Emergence of Probabilistic Reasoning in Very Young Infants: Evidence From 4.5- and 6-Month-Olds , 2012 .

[72]  S. Denison,et al.  Preschoolers sample from probability distributions , 2010 .

[73]  R. Salakhutdinov.  Learning and Evaluating Boltzmann Machines , 2008 .

[74]  Katherine D. Kinzler,et al.  Core knowledge. , 2007, Developmental science.

[75]  R. Menzel,et al.  Memory dynamics and foraging strategies of honeybees , 2004, Behavioral Ecology and Sociobiology.

[76]  H. Poor.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[77]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..