An emergentist perspective on the origin of number sense

The finding that human infants and many other animal species are sensitive to numerical quantity has been widely interpreted as evidence for evolved, biologically determined numerical capacities across unrelated species, thereby supporting a ‘nativist’ stance on the origin of number sense. Here, we tackle this issue within the ‘emergentist’ perspective provided by artificial neural network models, and we build on computer simulations to discuss two different approaches to think about the innateness of number sense. The first, illustrated by artificial life simulations, shows that numerical abilities can be supported by domain-specific representations emerging from evolutionary pressure. The second assumes that numerical representations need not be genetically pre-determined but can emerge from the interplay between innate architectural constraints and domain-general learning mechanisms, instantiated in deep learning simulations. We show that deep neural networks endowed with basic visuospatial processing exhibit a remarkable performance in numerosity discrimination before any experience-dependent learning, whereas unsupervised sensory experience with visual sets leads to subsequent improvement of number acuity and reduces the influence of continuous visual cues. The emergent neuronal code for numbers in the model includes both numerosity-sensitive (summation coding) and numerosity-selective response profiles, closely mirroring those found in monkey intraparietal neurons. We conclude that a form of innatism based on architectural and learning biases is a fruitful approach to understanding the origin and development of number sense. This article is part of a discussion meeting issue ‘The origins of numerical abilities'.

[1]  E. V. Famiglietti,et al.  Structural basis for ON-and OFF-center responses in retinal ganglion cells. , 1976, Science.

[2]  Sandy Lovie How the mind works , 1980, Nature.

[3]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[4]  R. Church,et al.  A mode control model of counting and timing processes. , 1983, Journal of experimental psychology. Animal behavior processes.

[5]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[6]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[7]  T. Tuulmets,et al.  Occupancy model of perceived numerosity , 1991, Perception & psychophysics.

[8]  Karen Wynn,et al.  Addition and subtraction by human infants , 1992, Nature.

[9]  C. Gallistel,et al.  Preverbal and verbal counting and computation , 1992, Cognition.

[10]  Stanislas Dehaene,et al.  Development of Elementary Numerical Abilities: A Neuronal Model , 1993, Journal of Cognitive Neuroscience.

[11]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[12]  Frank H. Durgin,et al.  Texture density adaptation and the perceived numerosity and distribution of texture. , 1995 .

[13]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[14]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[15]  E. Spelke,et al.  Nativism, empiricism, and the development of knowledge. , 1998 .

[16]  H S Terrace,et al.  Ordering of the numerosities 1 to 9 by monkeys. , 1998, Science.

[17]  S. Dehaene,et al.  Abstract representations of numbers in the animal and human brain , 1998, Trends in Neurosciences.

[18]  Kelly S. Mix,et al.  Number Versus Contour Length in Infants' Discrimination of Small Visual Sets , 1999 .

[19]  Brian Butterworth,et al.  The Mathematical Brain , 1999 .

[20]  E. Spelke,et al.  Large number discrimination in 6-month-old infants , 2000, Cognition.

[21]  C. Gallistel,et al.  Non-verbal numerical cognition: from reals to integers , 2000, Trends in Cognitive Sciences.

[22]  C R Gallistel,et al.  Numerical Subtraction in the Pigeon: Evidence for a Linear Subjective Number Scale , 2001, Psychological science.

[23]  E. Spelke,et al.  Infants' Discrimination of Number vs. Continuous Extent , 2002, Cognitive Psychology.

[24]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[25]  Denis Mareschal,et al.  Models of habituation in infancy , 2002, Trends in Cognitive Sciences.

[26]  Stanislas Dehaene,et al.  The neural basis of the Weber–Fechner law: a logarithmic mental number line , 2003, Trends in Cognitive Sciences.

[27]  R. Jaeger,et al.  Salamanders (Plethodon cinereus) go for more: rudiments of number in an amphibian , 2003, Animal Cognition.

[28]  Marco Zorzi,et al.  Computational Modeling of Numerical Cognition , 2004 .

[29]  Philippe Pinel,et al.  Tuning Curves for Approximate Numerosity in the Human Intraparietal Sulcus , 2004, Neuron.

[30]  Andreas Nieder,et al.  A parieto-frontal network for visual numerical information in the monkey. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[31]  S. Dehaene,et al.  Exact and Approximate Arithmetic in an Amazonian Indigene Group , 2004, Science.

[32]  Wim Fias,et al.  Representation of Number in Animals and Humans: A Neural Model , 2004, Journal of Cognitive Neuroscience.

[33]  E. Spelke,et al.  Language and Conceptual Development series Core systems of number , 2004 .

[34]  Wendi Fellner,et al.  Understanding of the concept of numerically "less" by bottlenose dolphins (Tursiops truncatus). , 2005, Journal of comparative psychology.

[35]  A. Nieder Counting on neurons: the neurobiology of numerical competence , 2005, Nature Reviews Neuroscience.

[36]  Fei Xu,et al.  Number sense in human infants. , 2005, Developmental science.

[37]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[38]  J. Cantlon,et al.  Shared System for Ordering Small and Large Numbers in Monkeys and Humans , 2006, Psychological science.

[39]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[40]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[41]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[42]  E. Brannon,et al.  Monotonic Coding of Numerosity in Macaque Lateral Intraparietal Area , 2007, PLoS biology.

[43]  Marco Zorzi,et al.  Nested incremental modeling in the development of computational theories: the CDP+ model of reading aloud. , 2007, Psychological review.

[44]  Elizabeth M Brannon,et al.  How much does number matter to a monkey (Macaca mulatta)? , 2007, Journal of experimental psychology. Animal behavior processes.

[45]  José Carlos Príncipe,et al.  Special issue on echo state networks and liquid state machines , 2007, Neural Networks.

[46]  Stephen F. Goodwin,et al.  Sexual Dimorphism: Can You Smell the Difference? , 2008, Current Biology.

[47]  Justin Halberda,et al.  Individual differences in non-verbal number acuity correlate with maths achievement , 2008, Nature.

[48]  C. Gallistel,et al.  The generative basis of natural number concepts , 2008, Trends in Cognitive Sciences.

[49]  D. Ansari Effects of development and enculturation on number representation in the brain , 2008, Nature Reviews Neuroscience.

[50]  Marco Dadda,et al.  Do fish count? Spontaneous discrimination of quantity in female mosquitofish , 2008, Animal Cognition.

[51]  Justin Halberda,et al.  Developmental change in the acuity of the "Number Sense": The Approximate Number System in 3-, 4-, 5-, and 6-year-olds and adults. , 2008, Developmental psychology.

[52]  D. Burr,et al.  A Visual Sense of Number , 2007, Current Biology.

[53]  S. Dehaene,et al.  Representation of number in the brain. , 2009, Annual review of neuroscience.

[54]  E. Spelke,et al.  Newborn infants perceive abstract numbers , 2009, Proceedings of the National Academy of Sciences.

[55]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[56]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[57]  Marco Zorzi,et al.  Through Neural Stimulation to Behavior Manipulation: A Novel Method for Analyzing Dynamical Cognitive Models , 2010, Cogn. Sci..

[58]  Andrea Facoetti,et al.  Developmental trajectory of number acuity reveals a severe impairment in developmental dyscalculia , 2010, Cognition.

[59]  James L. McClelland,et al.  Letting structure emerge: connectionist and dynamical systems approaches to cognition , 2010, Trends in Cognitive Sciences.

[60]  A. Bisazza,et al.  Ontogeny of Numerical Abilities in Fish , 2010, PloS one.

[61]  Justin Halberda,et al.  Impaired acuity of the approximate number system underlies mathematical learning disability (dyscalculia). , 2011, Child development.

[62]  J. Atkinson,et al.  Development of human visual function , 2011, Vision Research.

[63]  F. Kingdom,et al.  A common visual metric for approximate number and density , 2011, Proceedings of the National Academy of Sciences.

[64]  Melissa E. Libertus,et al.  Preschool acuity of the approximate number system correlates with school math ability. , 2011, Developmental science.

[65]  Quan Wang,et al.  Familiarity-to-novelty shift driven by learning: A conceptual and computational model , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[66]  S. Carey Précis of The Origin of Concepts , 2011, Behavioral and Brain Sciences.

[67]  S. Varma,et al.  Dyscalculia: From Brain to Education , 2011, Science.

[68]  Christian Agrillo,et al.  Number versus continuous quantity in numerosity judgments by fish , 2011, Cognition.

[69]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[70]  Marco Zorzi,et al.  Emergence of a 'visual number sense' in hierarchical generative models , 2012, Nature Neuroscience.

[71]  Bert Reynvoet,et al.  The interplay between nonsymbolic number and its continuous visual properties. , 2012, Journal of experimental psychology. General.

[72]  Marco Dadda,et al.  A new training procedure for studying discrimination learning in fish , 2012, Behavioural Brain Research.

[73]  R. Folmer rTMS for Tinnitus , 2012, Front. Hum. Neurosci..

[74]  Lorenzo Rosasco,et al.  The computational magic of the ventral stream: sketch of a theory (and why some deep architectures work). , 2012 .

[75]  Mikko Sams,et al.  Naturalistic fMRI Mapping Reveals Superior Temporal Sulcus as the Hub for the Distributed Brain Network for Social Perception , 2012, Front. Hum. Neurosci..

[76]  Elizabeth M. Brannon,et al.  Malleability of the approximate number system: effects of feedback and training , 2012, Front. Hum. Neurosci..

[77]  Pooja Viswanathan,et al.  Neuronal correlates of a visual “sense of number” in primate parietal and prefrontal cortices , 2013, Proceedings of the National Academy of Sciences.

[78]  Justin Halberda,et al.  Developmental change in the acuity of approximate number and area representations. , 2013, Developmental psychology.

[79]  Glyn Humphreys,et al.  Mu rhythm desynchronization reveals motoric influences of hand action on object recognition , 2013, Front. Hum. Neurosci..

[80]  Neil Marlow,et al.  Individual Differences in Inhibitory Control, Not Non-Verbal Number Acuity, Correlate with Mathematics Achievement , 2013, PloS one.

[81]  Tom Verguts,et al.  Spontaneous summation or numerosity-selective coding? , 2013, Front. Hum. Neurosci..

[82]  Michele De Filippo De Grazia,et al.  Deep Unsupervised Learning on a Desktop PC: A Primer for Cognitive Scientists , 2013, Front. Psychol..

[83]  Elizabeth M Brannon,et al.  Training the Approximate Number System Improves Math Proficiency , 2013, Psychological science.

[84]  Alberto Testolin,et al.  Modeling language and cognition with deep unsupervised learning: a tutorial overview , 2013, Front. Psychol..

[85]  P. Suñé,et al.  Positive Outcomes Influence the Rate and Time to Publication, but Not the Impact Factor of Publications of Clinical Trial Results , 2013, PloS one.

[86]  Ariel Starr,et al.  Number sense in infancy predicts mathematical abilities in childhood , 2013, Proceedings of the National Academy of Sciences.

[87]  Ivilin Peev Stoianov,et al.  Number skills are maintained in healthy ageing , 2014, Cognitive Psychology.

[88]  Michael C Crair,et al.  Role of emergent neural activity in visual map development , 2014, Current Opinion in Neurobiology.

[89]  Elizabeth M. Brannon,et al.  Modeling the approximate number system to quantify the contribution of visual stimulus features , 2015, Cognition.

[90]  Helen M. Ditz,et al.  Neurons selective to the number of visual items in the corvid songbird endbrain , 2015, Proceedings of the National Academy of Sciences.

[91]  S. Schultz,et al.  Visual Receptive Field Properties of Neurons in the Mouse Lateral Geniculate Nucleus , 2016, PloS one.

[92]  Stefan Mihalas,et al.  A Comparison of Visual Response Properties in the Lateral Geniculate Nucleus and Primary Visual Cortex of Awake and Anesthetized Mice , 2016, The Journal of Neuroscience.

[93]  Marco Zorzi,et al.  Spontaneous non-verbal counting in toddlers. , 2016, Developmental science.

[94]  A. Nieder The neuronal code for number , 2016, Nature Reviews Neuroscience.

[95]  R. Cohen Kadosh,et al.  Sensory-integration system rather than approximate number system underlies numerosity processing: A critical review. , 2016, Acta psychologica.

[96]  Jie-Li Tsai,et al.  Modulation of scene consistency and task demand on language-driven eye movements for audio-visual integration. , 2016, Acta psychologica.

[97]  Alberto Testolin,et al.  Probabilistic Models and Generative Neural Networks: Towards an Unified Framework for Modeling Normal and Impaired Neurocognitive Functions , 2016, Front. Comput. Neurosci..

[98]  Jie Chen,et al.  Computational Characterization of Osteoporosis Associated SNPs and Genes Identified by Genome-Wide Association Studies , 2016, PloS one.

[99]  Daniel Ansari,et al.  Probing the nature of deficits in the 'Approximate Number System' in children with persistent Developmental Dyscalculia. , 2016, Developmental science.

[100]  Guido Marco Cicchini,et al.  Spontaneous perception of numerosity in humans , 2016, Nature Communications.

[101]  R. Núñez,et al.  Is There Really an Evolved Capacity for Number? , 2017, Trends in Cognitive Sciences.

[102]  Michael Schneider,et al.  Associations of non-symbolic and symbolic numerical magnitude processing with mathematical competence: a meta-analysis. , 2017, Developmental science.

[103]  Maria Elena Miletto Petrazzini,et al.  Numerical abilities in fish: A methodological review , 2017, Behavioural Processes.

[104]  Yi Wang,et al.  A Phase-Locking Analysis of Neuronal Firing Rhythms with Transcranial Magneto-Acoustical Stimulation Based on the Hodgkin-Huxley Neuron Model , 2017, Front. Comput. Neurosci..

[105]  Marco Zorzi,et al.  Computational foundations of the visual number sense , 2017, Behavioral and Brain Sciences.

[106]  Alberto Testolin,et al.  The Role of Architectural and Learning Constraints in Neural Network Models: A Case Study on Visual Space Coding , 2017, Front. Comput. Neurosci..

[107]  Alberto Testolin,et al.  Letter perception emerges from unsupervised deep learning and recycling of natural image features , 2017, Nature Human Behaviour.