Coevolution of learning and data-acquisition mechanisms: a model for cognitive evolution

A fundamental and frequently overlooked aspect of animal learning is its reliance on compatibility between the learning rules used and the attentional and motivational mechanisms directing them to process the relevant data (called here data-acquisition mechanisms). We propose that this coordinated action, which may first appear fragile and error prone, is in fact extremely powerful, and critical for understanding cognitive evolution. Using basic examples from imprinting and associative learning, we argue that by coevolving to handle the natural distribution of data in the animal's environment, learning and data-acquisition mechanisms are tuned jointly so as to facilitate effective learning using relatively little memory and computation. We then suggest that this coevolutionary process offers a feasible path for the incremental evolution of complex cognitive systems, because it can greatly simplify learning. This is illustrated by considering how animals and humans can use these simple mechanisms to learn complex patterns and represent them in the brain. We conclude with some predictions and suggested directions for experimental and theoretical work.

[1]  Yadin Dudai,et al.  Predicting not to predict too much: how the cellular machinery of memory anticipates the uncertain future , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  P. Thompson,et al.  Neurobiology of intelligence: science and ethics , 2004, Nature Reviews Neuroscience.

[3]  Z. Harris A Theory of Language and Information: A Mathematical Approach , 1991 .

[4]  Tamar Keasar,et al.  Bees in two-armed bandit situations: foraging choices and possible decision mechanisms , 2002 .

[5]  Eytan Ruppin,et al.  Evolution of Reinforcement Learning in Uncertain Environments , 2001 .

[6]  A. Kacelnik,et al.  Framing effects and risky decisions in starlings , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[7]  A I Houston,et al.  Memory and the efficient use of information. , 1987, Journal of theoretical biology.

[8]  L A Real,et al.  Animal choice behavior and the evolution of cognitive architecture , 1991, Science.

[9]  J. Byrne Learning and memory : a comprehensive reference , 2008 .

[10]  R. B. Payne,et al.  Song learning in brood-parasitic indigobirds Vidua chalybeata : song mimicry of the host species , 1998, Animal Behaviour.

[11]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[12]  U. Frith Autism: Explaining the Enigma , 2005 .

[13]  H. S. V. Kampen A framework for the study of filial imprinting and the development of attachment , 1996 .

[14]  Eytan Ruppin,et al.  Unsupervised learning of natural languages , 2006 .

[15]  J. Christie Spatial contiguity facilitates Pavlovian conditioning , 1996, Psychonomic bulletin & review.

[16]  C. Heyes What's social about social learning? , 2012, Journal of comparative psychology.

[17]  C. Gallistel The organization of learning , 1990 .

[18]  S. Edelman,et al.  General cognitive principles for learning structure in time and space , 2010, Trends in Cognitive Sciences.

[19]  Shimon Edelman,et al.  An empirical generative framework for computational modeling of language acquisition. , 2010, Journal of child language.

[20]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[21]  N. Schmajuk,et al.  Classical conditioning mechanisms can differentiate between seeing and doing in rats. , 2012, Journal of experimental psychology. Animal behavior processes.

[22]  R. Dukas Learning: Mechanisms, Ecology, and Evolution , 2009 .

[23]  Cecilia Heyes,et al.  Simple minds: a qualified defence of associative learning , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  K. Pryor Clicker training for dogs , 1999 .

[25]  Roderich Groß,et al.  Simple learning rules to cope with changing environments , 2008, Journal of The Royal Society Interface.

[26]  A. Zahavi,et al.  Constraints on egg discrimination and cuckoo-host co-evolution , 1995, Animal Behaviour.

[27]  R. Miall,et al.  A system in the human brain for predicting the actions of others , 2004, Nature Neuroscience.

[28]  Barbara L Finlay,et al.  Mapping behavioural evolution onto brain evolution: the strategic roles of conserved organization in individuals and species , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  S. Edelman On look-ahead in language: navigating a multitude of familiar paths∗ , 2009 .

[30]  P. Bateson How do sensitive periods arise and what are they for? , 1979, Animal Behaviour.

[31]  Patrick Bateson,et al.  Is Imprinting Such a Special Case , 1990 .

[32]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[33]  Denis Mareschal,et al.  TRACX: a recognition-based connectionist framework for sequence segmentation and chunk extraction. , 2011, Psychological review.

[34]  R. Rescorla,et al.  Spatial contiguity facilitates Pavlovian second-order conditioning. , 1979, Journal of experimental psychology. Animal behavior processes.

[35]  Alliston K. Reid,et al.  Border collie comprehends object names as verbal referents , 2011, Behavioural Processes.

[36]  Timothy Q. Gentner,et al.  Recursive syntactic pattern learning by songbirds , 2006, Nature.

[37]  S. I. Rothstein,et al.  Mechanisms of Avian Egg Recognition: Possible Learned and Innate Factors , 1974 .

[38]  S. Edelman,et al.  Learn locally, act globally: Learning language from variation set cues , 2008, Cognition.

[39]  Michael R. Waldmann,et al.  Causal Reasoning in Rats , 2006, Science.

[40]  B. Lyon,et al.  Coots use hatch order to learn to recognize and reject conspecific brood parasitic chicks , 2010, Nature.

[41]  Arnon Lotem,et al.  Co-evolution of learning complexity and social foraging strategies. , 2010, Journal of theoretical biology.

[42]  Isaac Meilijson,et al.  Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors , 2002, Adapt. Behav..

[43]  Esther Mondragón,et al.  Rule Learning by Rats , 2008, Science.

[44]  S. Shettleworth Cognition, evolution, and behavior , 1998 .

[45]  Andrew Sih,et al.  Linking behavioural syndromes and cognition: a behavioural ecology perspective , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  J. Pearce,et al.  Theories of associative learning in animals. , 2001, Annual review of psychology.

[47]  Alexander Lange,et al.  Bayesian Approximations and Extensions: Optimal Decisions for Small Brains and Possibly Big Ones Too , 2022 .

[48]  Shimon Edelman,et al.  Learning a graph-structured generative probabilistic grammar of linguistic experience , 2011, CogSci.

[49]  M. Brent Speech segmentation and word discovery: a computational perspective , 1999, Trends in Cognitive Sciences.

[50]  Joseph Y. Halpern,et al.  A Data-Acquisition Model for Learning and Cognitive Development and Its Implications for Autism , 2008 .

[51]  John Garcia,et al.  Learning with prolonged delay of reinforcement , 1966 .

[52]  Ami Klin,et al.  Young autistic children's listening preferences in regard to speech: A possible characterization of the symptom of social withdrawal , 1991, Journal of autism and developmental disorders.

[53]  Arnon Lotem,et al.  Learning to recognize nestlings is maladaptive for cuckoo Cuculus canorus hosts , 1993, Nature.

[54]  R. Rescorla Behavioral studies of Pavlovian conditioning. , 1988, Annual review of neuroscience.

[55]  C. R. Gallistel,et al.  1.12 – Learning and Representation , 2008 .

[56]  A. Dickinson Associative learning and animal cognition , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  Patricia Howlin,et al.  Children with Autism and Asperger Syndrome: A Guide for Practitioners and Carers , 1999 .

[58]  P. Bateson THE CHARACTERISTICS AND CONTEXT OF IMPRINTING , 1966, Biological reviews of the Cambridge Philosophical Society.

[59]  A. Lotem,et al.  How to Detect a Cuckoo Egg: A Signal‐Detection Theory Model for Recognition and Learning , 1999, The American Naturalist.

[60]  A. Kacelnik,et al.  Tool-related Cognition in New Caledonian Crows , 2006 .