Cooperative co-evolutionary neural networks

The paper presents Cooperative Co–Evolutionary Neural Networks (CCENN), that is, a new method for evolving modular artificial neural networks (MANN). In CCENN, individual module–networks evolve in separate populations and to form a complete MANN each population delegates a single module. Modules collaborating within the same artificial neural network (ANN) are not connected and they work like networks in an ensemble–based approach, i.e. output of a complete ANN is determined based on a negotiation process between the module–networks. A module with the greatest negotiation strength is allowed to set one of the outputs of the entire ANN, to fix all the outputs, the modules negotiate many times. To test performance of CCENN, it was used to evolve neuro–controllers for a team of underwater vehicles whose common goal was to capture other vehicle behaving by a deterministic strategy (predator–prey problem). The experiments were carried out in simulation whereas their results were used to compare CCENN with two other neuro–evolutionary methods designed for building monolithic ANNs.

[1]  Roberto Battiti,et al.  Democracy in neural nets: Voting schemes for classification , 1994, Neural Networks.

[2]  Tsu-Chang Lee,et al.  Structure level adaptation for artificial neural networks , 1991 .

[3]  Petros Faloutsos,et al.  Complex networks of simple neurons for bipedal locomotion , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[5]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[6]  Piotr Szymak,et al.  Decision system for a team of autonomous underwater vehicles - Preliminary report , 2011, Neurocomputing.

[7]  Jean-Arcady Meyer,et al.  Evolution and Development of Modular Control Architectures for 1D Locomotion in Six-legged Animats , 1998, Connect. Sci..

[8]  Tomasz Praczyk Forming Neural Networks by Means of Assembler Encoding-Preliminary Report , 2011, Intell. Autom. Soft Comput..

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  Stefano Nolfi,et al.  Duplication of Modules Facilitates the Evolution of Functional Specialization , 1999, Artificial Life.

[11]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[12]  Stéphane Doncieux,et al.  Evolving modular neural-networks through exaptation , 2009, 2009 IEEE Congress on Evolutionary Computation.

[13]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[14]  Sung-Bae Cho,et al.  Evolutionary Learning of Modular Neural Networks with Genetic Programming , 1998, Applied Intelligence.

[15]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[16]  V. Ramakrishnan,et al.  Measurement of the top-quark mass with dilepton events selected using neuroevolution at CDF. , 2008, Physical review letters.

[17]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[18]  T. Praczyk,et al.  Using Assembler Encoding to Solve Inverted Pendulum Problem , 2009, Comput. Informatics.

[19]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[20]  Tomasz Praczyk Solving the pole balancing problem by means of assembler encoding , 2014, J. Intell. Fuzzy Syst..

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  Mohammad Mehdi Ebadzadeh,et al.  Automatic Design of Modular Neural Networks Using Genetic Programming , 2007, ICANN.

[23]  Jean-Arcady Meyer,et al.  Evolving modular neural networks to solve challenging control problems , 2004 .

[24]  Galina L. Rogova,et al.  Combining the results of several neural network classifiers , 1994, Neural Networks.

[25]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.