Cultural enhancement of neuroevolution

Any transmission of behavior from one generation to the next via non-genetic means is a process of culture. Culture provides major advantages for survival in the biological world. This dissertation develops four methods that harness the mechanisms of culture to enhance the power of neuroevolution: culling overlarge litters, mate selection by complementary competence, phenotypic diversity maintenance, and teaching offspring to respond like an elder. The methods are efficient because they operate without requiring additional fitness evaluations, and because each method addresses a different aspect of neuroevolution, they also combine smoothly. The combined system balances diversity and selection pressure, and improves performance both in terms of learning speed and solution quality in sequential decision tasks.

[1]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[2]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[3]  R. Lewontin.  ‘The Selfish Gene’ , 1977, Nature.

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Darrell Whitley,et al.  Genitor: a different genetic algorithm , 1988 .

[8]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[9]  Richard K. Belew,et al.  When Both Individuals and Populations Search: Adding Simple Learning to the Genetic Algorithm , 1989, ICGA.

[10]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[11]  L. Darrell Whitley,et al.  The GENITOR Algorithm and Selection Pressure: Why Rank-Based Allocation of Reproductive Trials is Best , 1989, ICGA.

[12]  Larry J. Eshelman,et al.  Spurious Correlations and Premature Convergence in Genetic Algorithms , 1990, FOGA.

[13]  Andrew G. Barto,et al.  Connectionist learning for control , 1990 .

[14]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[15]  Gilbert Syswerda,et al.  A Study of Reproduction in Generational and Steady State Genetic Algorithms , 1990, FOGA.

[16]  Richard K. Belew,et al.  Evolution, Learning, and Culture: Computational Metaphors for Adaptive Algorithms , 1990, Complex Syst..

[17]  H. J. Arnold.  Introduction to the Practice of Statistics , 1990 .

[18]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[19]  Larry J. Eshelman,et al.  Preventing Premature Convergence in Genetic Algorithms by Preventing Incest , 1991, ICGA.

[20]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning with Multilayer Neural Networks , 1991, ICGA.

[21]  Lashon B. Booker,et al.  Proceedings of the fourth international conference on Genetic algorithms , 1991 .

[22]  Lawrence Davis,et al.  Bit-Climbing, Representational Bias, and Test Suite Design , 1991, ICGA.

[23]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[24]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[25]  G. M. Werner.  Evolution of Communication in Artificial Organisms, Artifial Life II , 1991 .

[26]  Lakmal Seneviratne,et al.  Adaptive Control Of Robot Manipulators , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Kenneth A. De Jong,et al.  Generation Gaps Revisited , 1992, FOGA.

[28]  Kennetb A. De.  Genetic Algorithms Are NOT Function Optimizers , 1992 .

[29]  Frank L. Lewis,et al.  Robot Control: Dynamics, Motion Planning, and Analysis , 1992 .

[30]  R. Belew.  Interposing an ontogenic model between Genetic Algorithms and Neural Networks , 1992 .

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Richard K. Belew,et al.  Interposing an Ontogenetic Model Between Genetic Algorithms and Neural Networks , 1992, NIPS.

[33]  Timothy Masters,et al.  Practical neural network recipes in C , 1993 .

[34]  Stefano Nolfi,et al.  Auto-teaching: networks that develop their own teaching input , 1993 .

[35]  Stefano Nolfi,et al.  Self-selection of Input Stimuli for Improving Performance , 1993 .

[36]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[37]  Stephanie Forrest,et al.  Proceedings of the 5th International Conference on Genetic Algorithms , 1993 .

[38]  Larry J. Eshelman,et al.  Crossover's Niche , 1993, ICGA.

[39]  L. Darrell Whitley,et al.  Serial and Parallel Genetic Algorithms as Function Optimizers , 1993, ICGA.

[40]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[41]  Mark W. Spong,et al.  Swinging up the Acrobot: an example of intelligent control , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[42]  Heinrich Braun,et al.  ENZO-M - A Hybrid Approach for Optimizing Neural Networks by Evolution and Learning , 1994, PPSN.

[43]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[44]  L. Booker.  Foundations of genetic algorithms. 2: L. Darrell Whitley (Ed.), Morgan Kaufmann, San Mateo, CA, 1993, ISBN 1-55860-263-1, 322 pp., US$45.95 , 1994 .

[45]  Peter Nordin,et al.  Complexity Compression and Evolution , 1995, ICGA.

[46]  L. Darrell Whitley,et al.  Cellular Encoding Applied to Neurocontrol , 1995, ICGA.

[47]  Stefano Nolfi,et al.  Evolving Mobile Robots in Simulated and Real Environments , 1995, Artificial Life.

[48]  Filippo Menczer,et al.  Maturation and the Evolution of Imitative Learning in Artificial Organisms , 1995, Adapt. Behav..

[49]  Kenneth A. De Jong,et al.  On Decentralizing Selection Algorithms , 1995, ICGA.

[50]  Zbigniew Michalewicz,et al.  Using Cultural Algorithms for Constraint Handling in GENOCOP , 1995, Evolutionary Programming.

[51]  Samir W. Mahfoud.  A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[52]  David Lindley,et al.  Introduction to the Practice of Statistics , 1990, The Mathematical Gazette.

[53]  Richard S. Sutton,et al.  Connectionist Learning for Control , 1995 .

[54]  Lothar Thiele,et al.  A Mathematical Analysis of Tournament Selection , 1995, ICGA.

[55]  Worthy N. Martin,et al.  Enhancing GA Performance through Crossover Prohibitions Based on Ancestry , 1995, International Conference on Genetic Algorithms.

[56]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[57]  Lee Spector,et al.  Cultural transmission of information in genetic programming , 1996 .

[58]  L. Steels.  Self-organising vocabularies , 1996 .

[59]  William E. Hart,et al.  Optimization with genetic algorithm hybrids that use local searches , 1996 .

[60]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .

[61]  Padraic Monaghan,et al.  Proceedings of the 23rd annual conference of the cognitive science society , 2001 .

[62]  Takahiro Sasaki,et al.  Adaptation toward Changing Environments: Why Darwinian in Nature? , 1997 .

[63]  Risto Miikkulainen,et al.  Culling and Teaching in Neuro-Evolution , 1997, ICGA.

[64]  Sushil J. Louis,et al.  Solving Similar Problems Using Genetic Algorithms and Case-Based Memory , 1997, ICGA.

[65]  David E. Moriarty,et al.  Symbiotic Evolution of Neural Networks in Sequential Decision Tasks , 1997 .

[66]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[67]  Michèle Sebag,et al.  Toward Civilized Evolution: Developing Inhibitions , 1997, ICGA.

[68]  Robert G. Reynolds,et al.  Regulating the Amount of Information Used for Self-Adaptation in Cultural Algorithm , 1997, ICGA.

[69]  Georges R. Harik,et al.  Foundations of Genetic Algorithms , 1997 .

[70]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[71]  D. Parisi,et al.  “Genotypes” for neural networks , 1998 .

[72]  Phil Husbands,et al.  Evolutionary robotics , 2014, Evolutionary Intelligence.

[73]  Haynes.  Collective Adaptation: The Exchange of Coding Segments. , 1999, Evolutionary computation.

[74]  P. Gawthrop,et al.  A globally valid continuous-time GPC through successive system linearisation , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[75]  Risto Miikkulainen,et al.  Solving Non-Markovian Control Tasks with Neuro-Evolution , 1999, IJCAI.

[76]  Stefano Nolfi,et al.  Desired answers do not correspond to good teaching inputs in ecological neural networks , 2000 .

[77]  Brian Hazlehurst,et al.  Learning in the Cultural Process , 2000 .

[78]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[79]  S. Luke,et al.  Culture Enhances the Evolvability of Cognition , 2001 .

[80]  Thomas M. Loughin,et al.  Data Analysis by Resampling: Concepts and Applications , 2001, Technometrics.

[81]  Robert G. Reynolds,et al.  Using Cultural Algorithms to improve knowledge base maintainability , 2001 .

[82]  Risto Miikkulainen,et al.  Efficient evolution of neural network topologies , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[83]  B. MacLennan.  Synthetic Ethology An Approach to the Study of Communication , 2004 .

[84]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 2004 .