Evolving Learnable Neural Networks Under Changing Environments with Various Rates of Inheritance of Acquired Characters: Comparison of Darwinian and Lamarckian Evolution

The processes of adaptation in natural organisms consist of two complementary phases: learning, occurring within each individual's lifetime, and evolution, occurring over successive generations of the population. In this article, we study the relationship between learning and evolution in a simple abstract model, where neural networks capable of learning are evolved using genetic algorithms (GAs). Individuals try to maximize their life energy by learning certain rules that distinguish between two groups of materials: food and poison. The connective weights of individuals' neural networks undergo modification, that is, certain characters will be acquired, through their lifetime learning. By setting various rates for the heritability of acquired characters, which is a motive force of Lamarckian evolution, we observe adaptational processes of populations over successive generations. Paying particular attention to behaviors under changing environments, we show the following results. Populations with lower rates of heritability not only show more stable behavior against environmental changes, but also maintain greater adaptability with respect to such changing environments. Consequently, the population with zero heritability, that is, the Darwinian population, attains the highest level of adaptation to dynamic environments.

[1]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[2]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[3]  Giles Mayley,et al.  Landscapes, Learning Costs, and Genetic Assimilation , 1996, Evolutionary Computation.

[4]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[5]  John J. Grefenstette,et al.  Lamarckian Learning in Multi-Agent Environments , 1991, ICGA.

[6]  Akira Imada,et al.  Lamarckian evolution of associative memory , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[7]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[8]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[9]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[10]  Christopher G. Langton,et al.  Artificial Life , 2019, Philosophical Posthumanism.

[11]  J. Baldwin A New Factor in Evolution , 1896, The American Naturalist.

[12]  Takahiro Sasaki,et al.  Adaptation toward Changing Environments: Why Darwinian in Nature? , 1997 .

[13]  Yuval Davidor,et al.  Genetic Algorithms and Robotics - A Heuristic Strategy for Optimization , 1991, World Scientific Series in Robotics and Intelligent Systems.

[14]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[15]  R. Sokal Evolutionary Genetics , 1972, The Quarterly Review of Biology.

[16]  Hajime Kita,et al.  Adaptation to Changing Environments by Means of the Memory Based Thermodynamical Genetic Algorithm , 1997, ICGA.