Automatic model decomposition and reuse in an evolutionary cognitive mechanism

This paper addresses the problem of automatically obtaining primitives of the models an evolutionary cognitive mechanism is producing for a robot through its real time interaction with the world. The models are instantiated as Artificial Neural Networks (ANNs) and the objective is to obtain ANNs that cooperate in the process of modelling complex functions. An algorithm where the combination of networks takes place at the phenotypic or functional level is proposed. Thus, a population of networks that are automatically classified into different species depending on the performance of their phenotype is evolved, and individuals from each species cooperate forming a group to obtain a complex output. The components that make up the groups are basic ANNs (primitives) and may be reused in other modelling processes as seeds or combined to generate new solutions. The parameter that reflects the difference between ANNs is their affinity vector, the value which is automatically created and modified for each ANN through a competition based clustering process within the evolutionary process. The main objective of this approach is to explore one path to gradually model complex functions similar to those that arise when obtaining environment or internal models within robotic cognitive systems.

[1]  Xin Yao,et al.  Multi-network evolutionary systems and automatic decomposition of complex problems , 2006, Int. J. Gen. Syst..

[2]  César Hervás-Martínez,et al.  Cooperative coevolution of artificial neural network ensembles for pattern classification , 2005, IEEE Transactions on Evolutionary Computation.

[3]  Richard J. Duro,et al.  On Line Darwinist Cognitive Mechanism for an Artificial Organism , 2006 .

[4]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[5]  Richard J. Duro,et al.  Using promoters and functional introns in genetic algorithms for neuroevolutionary learning in non-stationary problems , 2009, Neurocomputing.

[6]  Hussein A. Abbass,et al.  Analysis of CCME: Coevolutionary Dynamics, Automatic Problem Decomposition, and Regularization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Michael Conrad,et al.  Combining evolution with credit apportionment: A new learning algorithm for neural nets , 1994, Neural Networks.

[8]  Risto Miikkulainen,et al.  Forming Neural Networks Through Efficient and Adaptive Coevolution , 1997, Evolutionary Computation.

[9]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[10]  Claudio De Stefano,et al.  On the role of population size and niche radius in fitness sharing , 2004, IEEE Transactions on Evolutionary Computation.

[11]  César Hervás-Martínez,et al.  COVNET: a cooperative coevolutionary model for evolving artificial neural networks , 2003, IEEE Trans. Neural Networks.

[12]  Xin Yao,et al.  Speciation as automatic categorical modularization , 1997, IEEE Trans. Evol. Comput..

[13]  Xin Yao,et al.  Co-evolutionary modular neural networks for automatic problem decomposition , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[15]  Richard J. Duro,et al.  Construction of a memory management system in an on-line learning mechanism , 2006, ESANN.

[16]  David W. Opitz,et al.  Actively Searching for an E(cid:11)ective Neural-Network Ensemble , 1996 .

[17]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[18]  Nicolás García-Pedrajas,et al.  Constructing Ensembles of Classifiers by Means of Weighted Instance Selection , 2009, IEEE Transactions on Neural Networks.

[19]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[20]  Andrés Faiña,et al.  Adaptive Learning Application of the MDB Evolutionary Cognitive Architecture in Physical Agents , 2006, SAB.

[21]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.