Evolution and learning in heterogeneous environments

A real-world environment is complex and non-uniform, varying over space and time. This thesis demonstrates the impact of such environmental heterogeneity upon the ways in which organisms acquire information about the world, via a series of individual-based computational models that apply progressively more detailed forms of environmental structure to understand the causal impact of four distinct environmental factors: temporal variability; task complexity; population structure; and spatial heterogeneity. We define a baseline model, comprised of an evolving population of polygenic individuals that can follow three learning modes: innate behaviour, in which an organism acts according to its genetically-encoded traits; individual learning, in which an organism engages in trial-and-error to modify its inherited behaviours; and social learning, in which an individual mimics the behaviours of its peers. This model is used to show that environmental variability and task complexity affect the adaptive success of each learning mode, with social learning only arising as a dominant strategy in environments of median variability and complexity. Beyond a certain complexity threshold, individual learning is shown to be the sole dominant strategy. Social learning is shown to play a beneficial role following a sudden environmental change, contributing to the dissemination of novel traits in a population of poorly-adapted individuals. Introducing population structure in the form of a k-regular graph, we show that bounded and rigid neighbourhood relationships can have deleterious effects on a population, diminishing its evolutionary rate and equilibrium fitness, and, in some cases, preventing the population from crossing a fitness valley to a global optimum. A larger neighbourhood size is shown to increase the effectiveness of social learning, and results in a more rapid evolutionary convergence rate. The research subsequently focuses on spatially heterogeneous environments, proposing a new method of constructing an environment characterised by two key metrics derived from landscape ecology, “patchiness” and “gradient”. We show that spatial complexity slows the rate of genetic adaptation when movement is restricted, but can increase the rate of evolution for mobile individuals. Social learning is shown to be particularly beneficial within heterogeneous environments, particularly when mobility is restricted, suggesting that phenotypic plasticity may act as a substitute for mobility.

[1]  R. Lande Genetics and demography in biological conservation. , 1988, Science.

[2]  I. Coolen,et al.  Social Learning in Noncolonial Insects? , 2005, Current Biology.

[3]  J. Verner Time Budget of the Male Long-Billed Marsh Wren during the Breeding Season , 1965 .

[4]  T. Freeberg Culture and courtship in vertebrates: a review of social learning and transmission of courtship systems and mating patterns , 2000, Behavioural Processes.

[5]  L. Giraldeau,et al.  The Effect of Exploration on the Use of Producer-Scrounger Tactics , 2012, PloS one.

[6]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[7]  M. Feldman,et al.  Niche construction, biological evolution, and cultural change , 2000, Behavioral and Brain Sciences.

[8]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[9]  John Maynard Smith,et al.  When learning guides evolution , 1987, Nature.

[10]  P. A. P. Moran,et al.  Random processes in genetics , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[11]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[12]  M. Pigliucci,et al.  Phenotypic plasticity and evolution by genetic assimilation , 2006, Journal of Experimental Biology.

[13]  Eric Winsberg,et al.  Simulations, Models, and Theories: Complex Physical Systems and Their Representations , 2001, Philosophy of Science.

[14]  Peter J. Bentley,et al.  PLANTWORLD: Population Dynamics in Contrasting Environments , 2002, GECCO Late Breaking Papers.

[15]  Lee A. DuBridge The Importance of Space , 1960 .

[16]  R. Lenski,et al.  Evidence for multiple adaptive peaks from populations of bacteria evolving in a structured habitat. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Richard K. Belew,et al.  Evolution, Learning, and Culture: Computational Metaphors for Adaptive Algorithms , 1990, Complex Syst..

[18]  Colin A. Chapman,et al.  Producers, Scroungers, and Group Foraging , 1991, The American Naturalist.

[19]  Robert C. Frohn,et al.  Remote Sensing for Landscape Ecology: New Metric Indicators for Monitoring, Modeling, and Assessment of Ecosystems , 1998 .

[20]  Jay M. Ver Hoef,et al.  Spatial Analysis in Ecology , 2006 .

[21]  G. F. Gause,et al.  EXPERIMENTAL ANALYSIS OF VITO VOLTERRA'S MATHEMATICAL THEORY OF THE STRUGGLE FOR EXISTENCE. , 1934, Science.

[22]  K. Laland Social learning strategies , 2004, Learning & behavior.

[23]  R. Lande Adaptation to an extraordinary environment by evolution of phenotypic plasticity and genetic assimilation , 2009, Journal of evolutionary biology.

[24]  Ute Dreher,et al.  Evolution In Changing Environments Some Theoretical Explorations , 2016 .

[25]  D. E. Matthews Evolution and the Theory of Games , 1977 .

[26]  R. Austin,et al.  Bacterial metapopulations in nanofabricated landscapes , 2006, Proceedings of the National Academy of Sciences.

[27]  Anurag A. Agrawal,et al.  Phenotypic Plasticity in the Interactions and Evolution of Species , 2001, Science.

[28]  Steven F. Railsback,et al.  Individual-based modeling and ecology , 2005 .

[29]  E. Borenstein,et al.  The effect of phenotypic plasticity on evolution in multipeaked fitness landscapes , 2006, Journal of evolutionary biology.

[30]  C. Heyes,et al.  SOCIAL LEARNING IN ANIMALS: CATEGORIES AND MECHANISMS , 1994, Biological reviews of the Cambridge Philosophical Society.

[31]  J. Pearce Animal Learning and Cognition: An Introduction , 1997 .

[32]  W. Wcislo BEHAVIORAL ENVIRONMENTS AND EVOLUTIONARY CHANGE , 1989 .

[33]  P. Marler A comparative approach to vocal learning: Song development in white-crowned sparrows. , 1970 .

[34]  C. Waddington,et al.  GENETIC ASSIMILATION OF AN ACQUIRED CHARACTER , 1953 .

[35]  Stephan Hartmann,et al.  The World as a Process , 1996 .

[36]  W. Romme,et al.  FIRE AND LANDSCAPE DIVERSITY IN SUBALPINE FORESTS OF YELLOWSTONE NATIONAL PARK , 1982 .

[37]  D. Grünbaum The logic of ecological patchiness , 2012, Interface Focus.

[38]  W. Thorpe Learning and instinct in animals , 1956 .

[39]  R. Macarthur The Problem of Pattern and Scale in Ecology: The Robert H. MacArthur Award Lecture , 2005 .

[40]  Eric J. Gustafson,et al.  Quantifying Landscape Spatial Pattern: What Is the State of the Art? , 1998, Ecosystems.

[41]  M. West-Eberhard Phenotypic Plasticity and the Origins of Diversity , 1989 .

[42]  C. Huffaker Experimental studies on predation : dispersion factors and predator-prey oscillations , 1958 .

[43]  Brooke S. Baythavong Linking the Spatial Scale of Environmental Variation and the Evolution of Phenotypic Plasticity: Selection Favors Adaptive Plasticity in Fine-Grained Environments , 2011, The American Naturalist.

[44]  Joe Yuichiro Wakano,et al.  Evolution of social learning: a mathematical analysis. , 2004, Theoretical population biology.

[45]  Eytan Ruppin,et al.  The evolution of imitation and mirror neurons in adaptive agents , 2005, Cognitive Systems Research.

[46]  Michael L. Best,et al.  How Culture Can Guide Evolution: An Inquiry into Gene/Meme Enhancement and Opposition , 1999, Adapt. Behav..

[47]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[48]  B. Galef Social Learning in Animals , 2006 .

[49]  Michael Travisano,et al.  Adaptive radiation in a heterogeneous environment , 1998, Nature.

[50]  J. Reynolds,et al.  A Simulation Experiment to Quantify Spatial Heterogeneity in Categorical Maps , 1994 .

[51]  Andreas Flache,et al.  Do Irregular Grids make a Difference? Relaxing the Spatial Regularity Assumption in Cellular Models of Social Dynamics , 2001, J. Artif. Soc. Soc. Simul..

[52]  F. J. Odling-Smee,et al.  Niche Construction: The Neglected Process in Evolution , 2003 .

[53]  S. Walker Social Learning: Psychological and Biological Perspectives, Thomas R. Zentall, Bennet G. Galef Jr. (Eds.). Lawrence Erlbaum, Hillsdale, New Jersey (1988), xi , 1988 .

[54]  L. Fahrig,et al.  Connectivity is a vital element of landscape structure , 1993 .

[55]  R. Dukas Effects of learning on evolution: robustness, innovation and speciation , 2013, Animal Behaviour.

[56]  L. Ancel,et al.  Undermining the Baldwin expediting effect: does phenotypic plasticity accelerate evolution? , 2000, Theoretical population biology.

[57]  Tina W. Wey,et al.  Social network analysis of animal behaviour: a promising tool for the study of sociality , 2008, Animal Behaviour.

[58]  D. Gordon The fusion of behavioral ecology and ecology , 2011 .

[59]  F. Galis,et al.  Phenotypic plasticity and the possible role of genetic assimilation: Hypoxia‐induced trade‐offs in the morphological traits of an African cichlid , 2000 .

[60]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[61]  Robin I. M. Dunbar,et al.  CULTURAL EVOLUTION IN A STRUCTURED POPULATION , 1998 .

[62]  J. Lawton,et al.  Linking Species and Ecosystems , 1996 .

[63]  Ole Tange,et al.  GNU Parallel: The Command-Line Power Tool , 2011, login Usenix Mag..

[64]  N. Dingemanse,et al.  Fitness consequences of avian personalities in a fluctuating environment , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[65]  C. Lee,et al.  Evolution of Physiological Tolerance and Performance During Freshwater Invasions1 , 2003, Integrative and comparative biology.

[66]  J. Reynolds,et al.  On definition and quantification of heterogeneity , 1995 .

[67]  N. Moran The Evolutionary Maintenance of Alternative Phenotypes , 1992, The American Naturalist.

[68]  E. Crispo,et al.  THE BALDWIN EFFECT AND GENETIC ASSIMILATION: REVISITING TWO MECHANISMS OF EVOLUTIONARY CHANGE MEDIATED BY PHENOTYPIC PLASTICITY , 2007, Evolution; international journal of organic evolution.

[69]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations , 2004, Bulletin of mathematical biology.

[70]  R. McCleery,et al.  Adaptive Phenotypic Plasticity in Response to Climate Change in a Wild Bird Population , 2008, Science.

[71]  Béla Bollobás,et al.  Random Graphs , 1985 .

[72]  Seth Bullock,et al.  Simulation models as opaque thought experiments , 2000 .

[73]  M. Nowak Evolutionary Dynamics: Exploring the Equations of Life , 2006 .

[74]  P. Richerson,et al.  The cultural transmission of acquired variation: effects on genetic fitness. , 1983, Journal of theoretical biology.

[75]  R. Levins Evolution in Changing Environments: Some Theoretical Explorations. (MPB-2) , 1968 .

[76]  S. Tebbich,et al.  Do woodpecker finches acquire tool-use by social learning? , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[77]  F. J. Odling-Smee Niche-constructing phenotypes. , 1988 .

[78]  M. West-Eberhard Developmental plasticity and evolution , 2003 .

[79]  P. Kirk Visscher,et al.  Lifetime learning by foraging honey bees , 1994, Animal Behaviour.

[80]  J. Krause,et al.  Shoal composition determines foraging success in the guppy , 2009 .

[81]  Andreas Handel,et al.  Heterogeneous Adaptive Trajectories of Small Populations on Complex Fitness Landscapes , 2008, PloS one.

[82]  Joachim Krug,et al.  EVOLUTIONARY ADVANTAGE OF SMALL POPULATIONS ON COMPLEX FITNESS LANDSCAPES , 2010, Evolution; international journal of organic evolution.

[83]  D. H. Reed Relationship between Population Size and Fitness , 2005 .

[84]  G. Simpson THE BALDWIN EFFECT , 1953 .

[85]  C. L. Morgan,et al.  ON MODIFICATION AND VARIATION. , 1896, Science.

[86]  R. Lewontin,et al.  A STUDY OF REACTION NORMS IN NATURAL POPULATIONS OF DROSOPHILA PSEUDOOBSCURA , 1982, Evolution; international journal of organic evolution.

[87]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[88]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[89]  Luc-Alain Giraldeau,et al.  The evolution of social learning rules: payoff-biased and frequency-dependent biased transmission. , 2009, Journal of theoretical biology.

[90]  K. Laland,et al.  Social Learning in Animals: Empirical Studies and Theoretical Models , 2005 .

[91]  M. Egas,et al.  How Adaptive Learning Affects Evolution: Reviewing Theory on the Baldwin Effect , 2011, Evolutionary Biology.

[92]  Peter J Bentley,et al.  Methods for improving simulations of biological systems: systemic computation and fractal proteins , 2009, Journal of The Royal Society Interface.

[93]  Gueorgi Kossinets,et al.  Empirical Analysis of an Evolving Social Network , 2006, Science.

[94]  J. Henrich,et al.  The evolution of cultural evolution , 2003 .

[95]  Uta Berger,et al.  Pattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from Ecology , 2005, Science.

[96]  A. Templeton,et al.  Evolution in fine-grained environments. I. Environmental runs and the evolution of homeostasis. , 1978, Theoretical population biology.

[97]  T. Valone,et al.  Potential disadvantages of using socially acquired information. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[98]  R. O'Neill,et al.  A factor analysis of landscape pattern and structure metrics , 1995, Landscape Ecology.

[99]  R. Dukas,et al.  Social learning about egg-laying substrates in fruitflies , 2009, Proceedings of the Royal Society B: Biological Sciences.

[100]  Luke Rendell,et al.  The Importance of Space in Models of Social Learning, Cultural Evolution and Niche Construction , 2012, Adv. Complex Syst..

[101]  J. Reynolds,et al.  A new contagion index to quantify spatial patterns of landscapes , 1993, Landscape Ecology.

[102]  H. Roche,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010 .

[103]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[104]  Mark Lubell,et al.  Conformists and mavericks: the empirics of frequency-dependent cultural transmission , 2008 .

[105]  Joe Yuichiro Wakano,et al.  A mixed strategy model for the emergence and intensification of social learning in a periodically changing natural environment. , 2006, Theoretical population biology.

[106]  Kevin N. Laland,et al.  Do animals have culture? , 2003 .

[107]  C. Heyes,et al.  Social learning in animals : the roots of culture , 1996 .

[108]  Robin I. M. Dunbar,et al.  Neocortex size and social network size in primates , 2001, Animal Behaviour.

[109]  L. Luckinbill,et al.  Coexistence in Laboratory Populations of Paramecium Aurelia and Its Predator Didinium Nasutum , 1973 .

[110]  Fritz Rohrlich,et al.  Computer Simulation in the Physical Sciences , 1990, PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[111]  B. Galef,et al.  Social Transmission of Acquired Behavior: A Discussion of Tradition and Social Learning in Vertebrates , 1976 .

[112]  Sebastian J Schreiber,et al.  Interactive effects of temporal correlations, spatial heterogeneity and dispersal on population persistence , 2010, Proceedings of the Royal Society B: Biological Sciences.

[113]  Nick J. Royle,et al.  An Introduction to Behavioural Ecology Nicholas B. Davies John R. , 2013, Animal Behaviour.

[114]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.

[115]  Massimo Pigliucci,et al.  Phenotypic Plasticity: Beyond Nature and Nurture , 2001 .

[116]  Giles Mayley,et al.  Landscapes, Learning Costs, and Genetic Assimilation , 1996, Evolutionary Computation.

[117]  Andrew Gonzalez,et al.  STABLE COEXISTENCE IN A FLUCTUATING ENVIRONMENT: AN EXPERIMENTAL DEMONSTRATION , 2005 .

[118]  R. Sibly,et al.  Producers and scroungers: A general model and its application to captive flocks of house sparrows , 1981, Animal Behaviour.

[119]  Janne-Tuomas Seppänen,et al.  Interspecific Social Learning: Novel Preference Can Be Acquired from a Competing Species , 2007, Current Biology.

[120]  C. Lumsden Culture and the Evolutionary Process, Robert Boyd, Peter J. Richerson. University of Chicago Press, Chicago & London (1985), viii, +301. Price $29.95 , 1986 .

[121]  P. Marler,et al.  Nature's Music: The Science of Birdsong , 2004 .

[122]  S. Scheiner Genetics and Evolution of Phenotypic Plasticity , 1993 .

[123]  J. Baldwin A New Factor in Evolution , 1896, The American Naturalist.

[124]  K. Laland,et al.  The local enhancement conundrum: in search of the adaptive value of a social learning mechanism. , 2014, Theoretical population biology.

[125]  J. Krebs,et al.  An introduction to behavioural ecology , 1981 .

[126]  A. D. Bradshaw,et al.  Evolutionary Significance of Phenotypic Plasticity in Plants , 1965 .

[127]  R. Dukas Evolutionary biology of insect learning. , 2008, Annual review of entomology.

[128]  Frederic Mery,et al.  A fitness cost of learning ability in Drosophila melanogaster , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[129]  Giles Mayley Guiding or Hiding: Explorations into the Effects of Learning on the Rate of Evolution , 1997 .

[130]  E. D. Di Paolo,et al.  Spatial effects favour the evolution of niche construction. , 2006, Theoretical population biology.

[131]  Hoffmann,et al.  Heritable variation and evolution under favourable and unfavourable conditions. , 1999, Trends in ecology & evolution.

[132]  Daniel Jones,et al.  Social learning and evolution in a structured environment , 2011, ECAL.

[133]  A. Houston,et al.  Environmental variability can select for optimism or pessimism. , 2011, Ecology letters.

[134]  P. Reich,et al.  The Influence of Functional Diversity and Composition on Ecosystem Processes , 1997 .

[135]  V. Volterra Variations and Fluctuations of the Number of Individuals in Animal Species living together , 1928 .

[136]  D. Sumpter,et al.  The evolution of helping and harming on graphs: the return of the inclusive fitness effect , 2007, Journal of evolutionary biology.

[137]  S. Wright,et al.  Evolution in Mendelian Populations. , 1931, Genetics.

[138]  Alastair Channon,et al.  Testing the Variability Selection Hypothesis: The Adoption of Social Learning in Increasingly Variable Environments , 2012, ALIFE.

[139]  James S. Clark,et al.  Ecological and Evolutionary Consequences of Patchiness: A Marine-Terrestrial Perspective , 1993 .

[140]  M. Feldman,et al.  Individual Versus Social Learning: Evolutionary Analysis in a Fluctuating Environment , 1996 .

[141]  G. E. Hutchinson,et al.  The Balance of Nature and Human Impact: The paradox of the plankton , 2013 .

[142]  Kevin McGarigal,et al.  Landscape Pattern Metrics , 2014 .

[143]  D. Papineau Social Learning and the Baldwin Effect , 2005 .

[144]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[145]  Lester R. Aronson,et al.  Evolution and Modification of Behavior, Konrad Lorenz. University of Chicago Press (1965), Price 25s , 1967 .

[146]  R. Anderson,et al.  Learning and evolution: a quantitative genetics approach. , 1995, Journal of theoretical biology.

[147]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[148]  R. Macarthur,et al.  On Optimal Use of a Patchy Environment , 1966, The American Naturalist.

[149]  Elhanan Borenstein,et al.  EVOLUTION OF LEARNING IN FLUCTUATING ENVIRONMENTS: WHEN SELECTION FAVORS BOTH SOCIAL AND EXPLORATORY INDIVIDUAL LEARNING , 2008, Evolution; international journal of organic evolution.

[150]  R. Dukas,et al.  Socially Influenced Behaviour and Learning in Locusts , 2012 .

[151]  M. Feldman,et al.  ON THE EVOLUTION OF PHENOTYPIC PLASTICITY IN A SPATIALLY HETEROGENEOUS ENVIRONMENT , 1996, Evolution; international journal of organic evolution.

[152]  Peter D. Taylor,et al.  Evolution of cooperation in a finite homogeneous graph , 2007, Nature.

[153]  E. Ranta,et al.  Population variability in space and time. , 2000, Trends in ecology & evolution.

[154]  G. Hunt,et al.  Diversification and cumulative evolution in New Caledonian crow tool manufacture , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[155]  E. Jablonka,et al.  Animal Traditions: Behavioural Inheritance in Evolution , 2000 .

[156]  M. Björklund,et al.  Selection in a fluctuating environment leads to decreased genetic variation and facilitates the evolution of phenotypic plasticity , 2012, Journal of evolutionary biology.

[157]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[158]  P. Richerson,et al.  • AN EVOLUTIONARY MODEL OF SOCIAL LEARNING: THE EFFECTS OF SPATIAL AND TEMPORAL VARIATON , 2013 .

[159]  F. Valladares,et al.  Global change and the evolution of phenotypic plasticity in plants , 2010, Annals of the New York Academy of Sciences.

[160]  M. Boyce,et al.  Demography in an increasingly variable world. , 2006, Trends in ecology & evolution.

[161]  Mark A. Bedau,et al.  Can Unrealistic Computer Models Illuminate Theoretical Biology , 1999 .

[162]  Christian Rutz,et al.  Development of tool use in New Caledonian crows: inherited action patterns and social influences , 2006, Animal Behaviour.

[163]  Z Toroczkai,et al.  Chaotic flow: the physics of species coexistence. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[164]  P. Todd,et al.  Exploring Adaptive Agency I: Theory and Methods for Simulating the Evolution of Learning , 1991 .

[165]  Doreen Schweizer,et al.  Cellular Automata And Complexity Collected Papers , 2016 .

[166]  T. Kameda,et al.  Cost-benefit analysis of social/cultural learning 1 Cost-Benefit Analysis of Social/Cultural Learning in a Non-Stationary Uncertain Environment: An Evolutionary Simulation and an Experiment with Human Subjects , 2002 .

[167]  K. Laland,et al.  More on how and why: cause and effect in biology revisited , 2013 .

[168]  A. R. Palmer,et al.  Effects of Manipulated Diet on Size and Performance of Brachyuran Crab Claws , 1994, Science.

[169]  M. Benton Evolution in four dimensions: Genetic, epigenetic, behavioral, and symbolic variation in the history of life , 2005 .