Can natural selection encode Bayesian priors?

The evolutionary success of many organisms depends on their ability to make decisions based on estimates of the state of their environment (e.g., predation risk) from uncertain information. These decision problems have optimal solutions and individuals in nature are expected to evolve the behavioural mechanisms to make decisions as if using the optimal solutions. Bayesian inference is the optimal method to produce estimates from uncertain data, thus natural selection is expected to favour individuals with the behavioural mechanisms to make decisions as if they were computing Bayesian estimates in typically-experienced environments, although this does not necessarily imply that favoured decision-makers do perform Bayesian computations exactly. Each individual should evolve to behave as if updating a prior estimate of the unknown environment variable to a posterior estimate as it collects evidence. The prior estimate represents the decision-maker's default belief regarding the environment variable, i.e., the individual's default 'worldview' of the environment. This default belief has been hypothesised to be shaped by natural selection and represent the environment experienced by the individual's ancestors. We present an evolutionary model to explore how accurately Bayesian prior estimates can be encoded genetically and shaped by natural selection when decision-makers learn from uncertain information. The model simulates the evolution of a population of individuals that are required to estimate the probability of an event. Every individual has a prior estimate of this probability and collects noisy cues from the environment in order to update its prior belief to a Bayesian posterior estimate with the evidence gained. The prior is inherited and passed on to offspring. Fitness increases with the accuracy of the posterior estimates produced. Simulations show that prior estimates become accurate over evolutionary time. In addition to these 'Bayesian' individuals, we also introduce 'frequentist' individuals that do not use a prior and instead use frequentist inference when estimating the probability. Competition between the two shows that the former tend to have an evolutionary advantage over the latter, as predicted by the literature, and that this advantage is lowest when the information available to individuals poses the least uncertainty.

[1]  W. Boeing,et al.  Costs and benefits of Daphnia defense against Chaoborus in nature , 2005 .

[2]  M. Ah-King On anisogamy and the evolution of 'sex roles'. , 2013, Trends in Ecology & Evolution.

[3]  Pete C. Trimmer,et al.  Unbiased individuals use valuable information when making decisions: a reply to Johnson and Fowler. , 2013, Trends in ecology & evolution.

[4]  B. Hayden,et al.  Gambling for Gatorade: risk-sensitive decision making for fluid rewards in humans , 2008, Animal Cognition.

[5]  A. Agrawal,et al.  Transgenerational induction of defences in animals and plants , 1999, Nature.

[6]  W. G. Sprules,et al.  Demographic Costs of Antipredator Defenses in Daphnia Pulex , 1990 .

[7]  Lauren Ancel Meyers,et al.  Fighting change with change: adaptive variation in an uncertain world , 2002 .

[8]  R. Gerlai,et al.  Can angelfish (Pterophyllum scalare) count? Discrimination between different shoal sizes follows Weber’s law , 2010, Animal Cognition.

[9]  Ola Olsson,et al.  Bayes' theorem and its applications in animal behaviour , 2006 .

[10]  T. Piersma,et al.  Phenotypic flexibility and the evolution of organismal design , 2003 .

[11]  A. Houston,et al.  Integrating function and mechanism. , 2009, Trends in ecology & evolution.

[12]  J. Baldwin A New Factor in Evolution , 1896, The American Naturalist.

[13]  A Houston,et al.  The application of statistical decision theory to animal behaviour. , 1980, Journal of theoretical biology.

[14]  J. Tenenbaum,et al.  Theory-based Bayesian models of inductive learning and reasoning , 2006, Trends in Cognitive Sciences.

[15]  A. Kacelnik,et al.  Risky Theories—The Effects of Variance on Foraging Decisions , 1996 .

[16]  Alasdair I Houston,et al.  On evolutionary explanations of cognitive biases. , 2013, Trends in ecology & evolution.

[17]  J. McNamara Optimal patch use in a stochastic environment , 1982 .

[18]  Sasha R. X. Dall,et al.  Information and its use by animals in evolutionary ecology. , 2005, Trends in ecology & evolution.

[19]  A. Beckerman,et al.  Costs, benefits and the evolution of inducible defences: a case study with Daphnia pulex , 2008, Journal of evolutionary biology.

[20]  Carl T. Bergstrom,et al.  The fitness value of information , 2005, Oikos.

[21]  R. Tollrian Neckteeth formation in Daphnia pulex as an example of continuous phenotypic plasticity: morphological effects of Chaoborus kairomone concentration and their quantification , 1993 .

[22]  James A. R. Marshall,et al.  Decision-making under uncertainty: biases and Bayesians , 2011, Animal Cognition.

[23]  R. Levins Evolution in Changing Environments: Some Theoretical Explorations. (MPB-2) , 1968 .

[24]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..