Multiplicative updates in coordination games and the theory of evolution

In this paper we point out a new and unexpected connection between three fields: Evolution Theory, Game Theory, and Algorithms. In particular, we study the standard equations of population genetics for Evolution, in the presence of recombination (sex), focusing on the important special case of weak selection [1,2] in which all fitness values are assumed to be close to one another. Weak selection is the mathematical regime capturing the widely accepted Neutral Theory proposed by Kimura in the 1970s [3], hypothesizing that evolution proceeds for the most part not by substantial increases in fitness but by essentially random drift. We show that in this regime evolution through natural selection and sex is tantamount to a game played through the multiplicative weight updates game dynamics [4]. The players of the game are the genes (genetic loci), the strategies available to each player are the alleles of the gene, and the probabilities whereby a player plays a strategy is the strategy's frequency in the population. The utility to each player/gene of each strategy profile is the fitness of the corresponding genotype (organism). That is, the game is a coordination game between genes, in which the players' interests are perfectly aligned. Importantly, the utility maximized in this game, as well as the amount by which each allele is boosted, is precisely the allele's mixability, or average fitness, a quantity recently proposed in [5] as a novel concept that is crucial in understanding natural selection under sex, thus providing a rigorous demonstration of that insight. We also establish a result regarding the maintenance of genetic diversity (multiplicity of alleles per gene). We prove that the equilibria in two-person coordination games are likely to have large supports, and thus genetic diversity need not suffer much at equilibrium. Establishing large supports involves answering through a novel technique the following question: what is the probability that for a random square matrix $A$ (with entries drawn independently from smooth distributions that are symmetric around zero) both systems Ax=1 and ATy=1 have positive solutions? The proof is through a simple potential function argument. Both the question and the technique may be of broader interest. It has often seemed astonishing --- even to experienced students of Evolution, Darwin included --- that the crude mechanism of natural selection is responsible for producing the dazzling variety of Life around us. The present mathematical connection of Evolution with the multiplicative weight updates algorithm --- a technique that has surprised our field time and again with its fantastic effectiveness and versatility --- may carry some explanatory force in this regard.

[1]  Satyen Kale Efficient algorithms using the multiplicative weights update method , 2007 .

[2]  Adi Livnat,et al.  An analytical contrast between fitness maximization and selection for mixability. , 2011, Journal of theoretical biology.

[3]  Leslie G. Valiant,et al.  Evolvability , 2009, JACM.

[4]  T. Nagylaki The evolution of multilocus systems under weak selection. , 1993, Genetics.

[5]  Y. Mansour,et al.  Regret Minimization , and Equilibria , 2022 .

[6]  J. Hofbauer,et al.  Convergence of multilocus systems under weak epistasis or weak selection , 1999, Journal of mathematical biology.

[7]  K. Holsinger The neutral theory of molecular evolution , 2004 .

[8]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[9]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[10]  Matthew O. Jackson,et al.  On the formation of interaction networks in social coordination games , 2002, Games Econ. Behav..

[11]  R. Bürger Some Mathematical Models in Evolutionary Genetics , 2011 .

[12]  Adi Livnat,et al.  A mixability theory for the role of sex in evolution , 2008, Proceedings of the National Academy of Sciences.

[13]  N. J. A. Sloane,et al.  The solution to Berlekamp's switching game , 1989, Discret. Math..

[14]  N. Barton,et al.  Why sex and recombination? , 2009, Cold Spring Harbor symposia on quantitative biology.

[15]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[16]  Mihalis Yannakakis,et al.  How easy is local search? , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[17]  M. Kimura,et al.  Evolution in Sexual and Asexual Populations , 1965, The American Naturalist.