A novel generative encoding for exploiting neural network sensor and output geometry

A significant problem for evolving artificial neural networks is that the physical arrangement of sensors and effectors is invisible to the evolutionary algorithm. For example, in this paper, directional sensors and effectors are placed around the circumference of a robot in analogous arrangements. This configuration ensures that there is a useful geometric correspondence between sensors and effectors. However, if sensors are mapped to a single input layer and the effectors to a single output layer (as is typical), evolution has no means to exploit this fortuitous arrangement. To address this problem, this paper presents a novel generative encoding called connective Compositional Pattern Producing Networks (connective CPPNs) that can effectively detect and capitalize on geometric relationships among sensors and effectors. The key insight is that sensors and effectors with consistent geometric relationships can be exploited by a repeating motif in the neural architecture. Thus, by employing an encoding that can discover such motifs as a function of network geometry, it becomes possible to exploit it. In this paper, a method for evolving connective CPPNs called Hypercube-based Neuroevolution of Augmenting Topologies (HyperNEAT) discovers sensible repeating motifs that take advantage of two different placement schemes, demonstrating the utility of such an approach.

[1]  Aristid Lindenmayer,et al.  Adding Continuous Components to L-Systems , 1974, L Systems.

[2]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[3]  David H. Sharp,et al.  A connectionist model of development. , 1991, Journal of theoretical biology.

[4]  Robert G. Reynolds,et al.  Morphogenic Evolutionary Computations: Introduction, Issues and Examples , 1995 .

[5]  Peter J. Angeline,et al.  Morphogenic Evolutionary Computations: Introduction, Issues and Example , 1995, Evolutionary Programming.

[6]  Andrew P. Martin Increasing Genomic Complexity by Gene Duplication and the Origin of Vertebrates , 1999, The American Naturalist.

[7]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[8]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Evolved Embryogenies for a Design Problem , 1999 .

[9]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[10]  Josh Bongard,et al.  Evolving modular genetic regulatory networks , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[11]  Olaf Sporns,et al.  Networks analysis, complexity, and brain function , 2002 .

[12]  O. Sporns Network Analysis , Complexity , and Brain Function , 2002 .

[13]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[14]  M. A. Carreira-Perpiñán,et al.  Cortical Columns , 2002 .

[15]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[16]  D. Federici Using Embryonic Stages to increase the evolvability of development , 2004 .

[17]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[18]  Julian Francis Miller,et al.  Evolving a Self-Repairing, Self-Regulating, French Flag Organism , 2004, GECCO.

[19]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.

[20]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[21]  Kenneth O. Stanley Comparing Artificial Phenotypes with Natural Biological Patterns , 2006 .

[22]  Kenneth O. Stanley Exploiting Regularity Without Development , 2006, AAAI Fall Symposium: Developmental Systems.

[23]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[24]  D. McCandless Fundamental neuroscience , 1997, Metabolic Brain Disease.