Evolutionary implementation of Bayesian computations

The Bayesian framework offers a flexible language for the consistent modular assembly of statistical models used by both minds and machines. Another algorithmic domain capable of adaptation in potentially high-dimensional and uncertain environments is Darwinian evolution. The equivalence of their fundamental dynamical equations, replicator dynamics and Bayesian update, hints at a deeper algorithmic analogy. Here we show, based on a unified mathematical discussion of evolutionary dynamics and statistical learning in terms of Bayesian graphical models, that this is indeed the case. Building blocks of Bayesian computations, such as inference in hierarchical models, filtering in hidden Markov models, gradient likelihood optimization, and expectation-maximization dynamics of mixture models, map naturally to fundamental concepts of evolution: multilevel selection, quasispecies dynamics, phenotypic adaptation and ecological competition, respectively. We believe that these correspondences point towards a more comprehensive understanding of flavors of adaptive computation observed in Nature, as well as suggesting new ways to combine insights from the two domains in engineering applications.

[1]  Jussi Lehtonen The Price Equation, Gradient Dynamics, and Continuous Trait Game Theory , 2018, The American Naturalist.

[2]  R. Lewontin ‘The Selfish Gene’ , 1977, Nature.

[3]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[4]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[5]  Jordan W. Suchow,et al.  Evolution in Mind: Evolutionary Dynamics, Cognitive Processes, and Bayesian Inference , 2017, Trends in Cognitive Sciences.

[6]  Karl J. Friston,et al.  A variational approach to niche construction , 2018, Journal of The Royal Society Interface.

[7]  George R. Price,et al.  Selection and Covariance , 1970, Nature.

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[10]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[11]  Eörs Szathmáry,et al.  Selectionist and Evolutionary Approaches to Brain Function: A Critical Appraisal , 2012, Front. Comput. Neurosci..

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Eörs Szathmáry,et al.  Multilevel selection as Bayesian inference, major transitions in individuality as structure learning , 2019, Royal Society Open Science.

[14]  John C. Baez,et al.  Relative Entropy in Biological Systems , 2015, Entropy.

[15]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[16]  A. Gardner,et al.  Major evolutionary transitions in individuality , 2015, Proceedings of the National Academy of Sciences.

[17]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[18]  W. Zurek Quantum Darwinism , 2009, 0903.5082.

[19]  Dániel Czégel,et al.  Major evolutionary transitions as Bayesian structure learning , 2018, bioRxiv.

[20]  Eörs Szathmáry,et al.  Breeding novel solutions in the brain: a model of Darwinian neurodynamics , 2016, F1000Research.

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  D. Queller Fundamental Theorems of Evolution , 2017, The American Naturalist.

[23]  J. Tenenbaum,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Theory-based Bayesian models of inductive learning and reasoning , 2022 .

[24]  Kathrin Abendroth,et al.  The Geometry Of Population Genetics , 2016 .

[25]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[26]  S. Frank,et al.  Natural selection. IV. The Price equation * , 2012, Journal of evolutionary biology.

[27]  Omer Deniz Akyildiz A probabilistic interpretation of replicator-mutator dynamics , 2017, 1712.07879.

[28]  Eörs Szathmáry,et al.  How Can Evolution Learn? , 2016, Trends in ecology & evolution.

[29]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[30]  Eörs Szathmáry,et al.  How Can Evolution Learn? - A Reply to Responses. , 2016, Trends in ecology & evolution.

[31]  Marc Harper,et al.  The Replicator Equation as an Inference Dynamic , 2009, ArXiv.

[32]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[33]  C. Shalizi Dynamics of Bayesian Updating with Dependent Data and Misspecified Models , 2009, 0901.1342.

[34]  J. Fiser Perceptual learning and representational learning in humans and animals , 2009, Learning & behavior.

[35]  Samir Okasha,et al.  Why Won't the Group Selection Controversy Go Away? , 2001, The British Journal for the Philosophy of Science.

[36]  D. Dennett,et al.  Darwinizing culture : the status of memetics as a science , 2001 .

[37]  W. Geisler,et al.  Bayesian natural selection and the evolution of perceptual systems. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  A. Alexandrova The British Journal for the Philosophy of Science , 1965, Nature.