Evolving Symmetry for Modular System Design

Symmetry is useful as a constraint in designing complex systems such as distributed controllers for multilegged robots. However, it is often difficult to determine which symmetries are appropriate. It is therefore desirable to design such systems automatically, e.g., by utilizing evolutionary algorithms that produce symmetry through developmental mechanisms. The success of these algorithms depends on how well they explore the space of valid symmetries. This paper presents an approach called evolution of network symmetry and modularity (ENSO) that utilizes group theory to search the space of symmetries effectively. This approach was evaluated by evolving neural network controllers for a quadruped robot in physically realistic simulations. On flat ground, the resulting controllers are as fast as those having hand-designed symmetry, and significantly faster than those without symmetry. On inclined ground, where the appropriate symmetries are difficult to determine manually, ENSO produced significantly faster gaits that also generalize better than those of other approaches. On robots with a more complicated structure including knee joints, ENSO resulted in more regular gaits than the other approaches. These results suggest that ENSO is a promising approach for evolving complex systems with modularity and symmetry.

[1]  Maja J. Matarić,et al.  A Developmental Model for the Evolution of Complete Autonomous Agents , 1996 .

[2]  A. Cangelosi,et al.  Cell division and migration in a 'genotype' for neural networks (Cell division and migration in neural networks) , 1993 .

[3]  Masahiro Fujita,et al.  Evolving robust gaits with AIBO , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[4]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[5]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[6]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[7]  Duncan McFarlane Modular distributed manufacturing systems and the implications for integrated control , 1998 .

[8]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[9]  Julian Francis Miller,et al.  Evolving a Self-Repairing, Self-Regulating, French Flag Organism , 2004, GECCO.

[10]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[11]  Gerald Sommer,et al.  Evolutionary reinforcement learning of artificial neural networks , 2007, Int. J. Hybrid Intell. Syst..

[12]  Risto Miikkulainen,et al.  Evolving symmetric and modular neural networks for distributed control , 2009, GECCO.

[13]  R. Beer,et al.  20 – A developmental model for the evolution of complete autonomous agents , 2003 .

[14]  Peter Stone,et al.  Machine Learning for Fast Quadrupedal Locomotion , 2004, AAAI.

[15]  A. Garcı́a-Bellido Symmetries throughout organic evolution. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Martin Golubitsky,et al.  Central pattern generators for bipedal locomotion , 2006, Journal of mathematical biology.

[17]  Y L Wang,et al.  Zebrafish hox clusters and vertebrate genome evolution. , 1998, Science.

[18]  L. Beineke,et al.  Topics in algebraic graph theory , 2004 .

[19]  Lee Spector,et al.  Evolving Graphs and Networks with Edge Encoding: Preliminary Report , 1996 .

[20]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[21]  Jean-Jacques E. Slotine,et al.  Models for Global Synchronization in CPG-based Locomotion , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[23]  Yaochu Jin,et al.  Vector Field Embryogeny , 2009, PloS one.

[24]  M. Golubitsky,et al.  Patterns of Oscillation in Coupled Cell Systems , 2002 .

[25]  Peter Stone,et al.  Policy gradient reinforcement learning for fast quadrupedal locomotion , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[26]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[27]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[28]  R. Pfeifer,et al.  Repeated structure and dissociation of genotypic and phenotypic complexity in artificial ontogeny , 2001 .

[29]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[30]  S. V. Shastri,et al.  A biologically consistent model of legged locomotion gaits , 1997, Biological Cybernetics.

[31]  Joel Waldfogel,et al.  Introduction , 2010, Inf. Econ. Policy.

[32]  Hiroshi Kimura,et al.  Realization of Dynamic Walking and Running of the Quadruped Using Neural Oscillator , 1999, Auton. Robots.

[33]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[34]  M. Martindale,et al.  The Development of Radial and Biradial Symmetry: The Evolution of Bilaterality' , 1998 .

[35]  A. R. Palmer Symmetry Breaking and the Evolution of Development , 2004, Science.

[36]  Leon Sterling,et al.  Heterogeneous Neural Networks for Adaptive Behavior in Dynamic Environments , 1988, NIPS.

[37]  Martin Golubitsky,et al.  Bifurcation on the Visual Cortex with Weakly Anisotropic Lateral Coupling , 2003, SIAM J. Appl. Dyn. Syst..

[38]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[39]  F. Heylighen The Growth of Structural and Functional Complexity during Evolution , 1999 .

[40]  Egbert J. W. Boers,et al.  Biological metaphors and the design of modular artificial neural networks , 2010 .

[41]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[42]  Jean-Arcady Meyer,et al.  Evolution and Development of Modular Control Architectures for 1D Locomotion in Six-legged Animats , 1998, Connect. Sci..

[43]  S. Lall,et al.  Conservation and divergence in molecular mechanisms of axis formation. , 2001, Annual review of genetics.

[44]  Risto Miikkulainen,et al.  Modular neuroevolution for multilegged locomotion , 2008, GECCO '08.

[45]  Ludovic Righetti,et al.  Pattern generators with sensory feedback for the control of quadruped locomotion , 2008, 2008 IEEE International Conference on Robotics and Automation.

[46]  M. Herzog,et al.  On the number of subgroups in finite solvable groups , 1995 .

[47]  L. Glass,et al.  Combinatorial explosion in model gene networks. , 2000, Chaos.

[48]  Oliver Bastert,et al.  Stabilization procedures and applications , 2001 .

[49]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[50]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[51]  T. Dawson Game Creation using OGRE – Object-Oriented Graphics Rendering Engine , 2010 .

[52]  Chris Godsil,et al.  Symmetry and eigenvectors , 1997 .

[53]  I. Stewart,et al.  Coupled nonlinear oscillators and the symmetries of animal gaits , 1993 .

[54]  Charles Ofria,et al.  Evolving coordinated quadruped gaits with the HyperNEAT generative encoding , 2009, 2009 IEEE Congress on Evolutionary Computation.

[55]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.