Competitive two-island cooperative co-evolution for training feedforward neural networks for pattern classification problems

In the application of cooperative coevolution for neuro-evolution, problem decomposition methods rely on architectural properties of the neural network to divide it into subcomponents. During every stage of the evolutionary process, different problem decomposition methods yield unique characteristics that may be useful in an environment that enables solution sharing. In this paper, we implement a two-island competition environment in cooperative coevolution based neuro-evolution for feedforward neural networks for pattern classification problems. In particular the combinations of three problem decomposition methods that are based on the architectural properties that refers to neural level, network level and layer level decomposition. The experimental results show that the performance of the competition method is better than that of the standalone problem decomposition cooperative neuro-evolution methods.

[1]  César Hervás-Martínez,et al.  COVNET: a cooperative coevolutionary model for evolving artificial neural networks , 2003, IEEE Trans. Neural Networks.

[2]  R. Salomon.  Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[3]  Mengjie Zhang,et al.  Adapting modularity during learning in cooperative co-evolutionary recurrent neural networks , 2012, Soft Comput..

[4]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[5]  César Hervás-Martínez,et al.  Multi-objective cooperative coevolution of artificial neural networks (multi-objective cooperative networks) , 2002, Neural Networks.

[6]  C. Rowe,et al.  The Relationship between Sympatric Defended Species Depends upon Predators' Discriminatory Behaviour , 2012, PloS one.

[7]  G. Bella.  A Bug's Life: Competition Among Species Towards the Environment , 2007 .

[8]  Risto Miikkulainen,et al.  Accelerated Neural Evolution through Cooperatively Coevolved Synapses , 2008, J. Mach. Learn. Res..

[9]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[10]  Rohitash Chandra.  Memetic cooperative coevolution of Elman recurrent neural networks , 2014, Soft Comput..

[11]  Mengjie Zhang,et al.  Crossover-based local search in cooperative co-evolutionary feedforward neural networks , 2012, Appl. Soft Comput..

[12]  Mengjie Zhang,et al.  An Encoding Scheme for Cooperative Coevolutionary Feedforward Neural Networks , 2010, Australasian Conference on Artificial Intelligence.

[13]  N. Garc'ia-Pedrajas,et al.  CIXL2: A Crossover Operator for Evolutionary Algorithms Based on Population Features , 2005, J. Artif. Intell. Res..

[14]  Mengjie Zhang,et al.  Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction , 2012, Neurocomputing.

[15]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[16]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[18]  Mengjie Zhang,et al.  On the issue of separability for problem decomposition in cooperative neuro-evolution , 2012, Neurocomputing.

[19]  Rohitash Chandra,et al.  Multi-objective cooperative coevolution of neural networks for time series prediction , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[20]  Mengjie Zhang,et al.  Encoding subcomponents in cooperative co-evolutionary recurrent neural networks , 2011, Neurocomputing.

[21]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[22]  Rohitash Chandra.  Competitive two-island cooperative coevolution for training Elman recurrent networks for time series prediction , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[23]  Rohitash Chandra,et al.  Competition and Collaboration in Cooperative Coevolution of Elman Recurrent Neural Networks for Time-Series Prediction , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[25]  Mengjie Zhang,et al.  Modularity adaptation in cooperative coevolution of feedforward neural networks , 2011, The 2011 International Joint Conference on Neural Networks.

[26]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[27]  Min Shi,et al.  Natural vs. Unnatural Decomposition in Cooperative Coevolution , 2011, ICIC.

[28]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[29]  Hongfei Teng,et al.  Cooperative Co-evolutionary Differential Evolution for Function Optimization , 2005, ICNC.

[30]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.