Design of Evolvable Biologically Inspired Classifiers

Complex systems are emergent, self-organizing and adaptive systems. They are pervasive in nature and usually hard to analyze or understand. Often they appear intelligent and show favorable properties such as resilience and anticipation. In this paper we describe a classifier model inspired by complex systems theory. Our model is a generalization of neural networks, boolean networks and genetic programming trees called computational networks. Designing computational networks by hand is infeasible when dealing with complex data. For designing our classifiers we developed an evolutionary design algorithm. Four extensions of this algorithm are presented. Each extension is inspired by natural evolution and theories from the evolutionary computing literature. The experiments show that our model can be evolutionary designed to act as a classifier. We show that our evolved classifiers are competitive compared to the classifiers in the Weka classifier collection. These experiments lead to the conclusion that using our evolutionary algorithm to design computational networks is a promising approach for the creation of classifiers. The benefits of the evolutionary extensions are inconclusive, for some datasets there is a significant performance increase while for other datasets the increase is very minimal.

[1]  Marco Dorigo,et al.  Division of Labour in Self-organised Groups , 2008, SAB.

[2]  Francis Heylighen,et al.  The Science of Self-Organization and Adaptivity , 1999 .

[3]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[4]  John Hallam,et al.  From Animals to Animats 10 , 2008 .

[5]  Jim Tørresen,et al.  A Divide-and-Conquer Approach to Evolvable Hardware , 1998, ICES.

[6]  Bruno Lara,et al.  Robot control and the evolution of modular neurodynamics , 2001 .

[7]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[8]  Giovanna Di Marzo Serugendo,et al.  Engineering Emergent Behaviour: A Vision , 2003, MABS.

[9]  Sanyou Zeng,et al.  Evolvable Systems: From Biology to Hardware, 7th International Conference, ICES 2007, Wuhan, China, September 21-23, 2007, Proceedings , 2007, ICES.

[10]  Melanie Mitchell,et al.  The Copycat project: a model of mental fluidity and analogy-making , 1995 .

[11]  John H. Holland,et al.  Emergence. , 1997, Philosophica.

[12]  R.R.S. Van Lon,et al.  Evolving Biologically Inspired Classifiers , 2010 .

[13]  Bruce Edmonds,et al.  Multi-Agent-Based Simulation III , 2003, Lecture Notes in Computer Science.

[14]  John H. Holland,et al.  Hidden Order: How Adaptation Builds Complexity , 1995 .

[15]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[16]  John R. Koza,et al.  Genetic Programming II , 1992 .

[17]  Ladan Tahvildari,et al.  Self-adaptive software: Landscape and research challenges , 2009, TAAS.

[18]  Martijn C. Schut,et al.  On model design for simulation of collective intelligence , 2010, Inf. Sci..

[19]  Tom De Wolf,et al.  Towards a Methodology for Engineering Self-Organising Emergent Systems , 2005, SOAS.

[20]  Wolfgang Banzhaf,et al.  Advances in Artificial Life , 2003, Lecture Notes in Computer Science.

[21]  Graham Kendall,et al.  An Evolutionary Methodology for the Automated Design of Cellular Automaton-based Complex Systems , 2007, J. Cell. Autom..

[22]  Riccardo Poli,et al.  Efficient Evolution of Asymmetric Recurrent Neural Networks Using a PDGP-inspired Two-Dimensional Representation , 1998, EuroGP.

[23]  Francis Heylighen,et al.  Collective Intelligence and its Implementation on the Web: Algorithms to Develop a Collective Mental Map , 1999, Comput. Math. Organ. Theory.

[24]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[25]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[26]  Frank Kirchner,et al.  Robot design for space missions using evolutionary computation , 2009, 2009 IEEE Congress on Evolutionary Computation.

[27]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[28]  M. Minsky The Society of Mind , 1986 .

[29]  Robert I. Damper,et al.  Editorial for the Special Issue on 'Emergent Properties of Complex Systems': Emergence and levels of abstraction , 2000, Int. J. Syst. Sci..

[30]  Christos Ampatzis,et al.  Evolution of Acoustic Communication Between Two Cooperating Robots , 2007, ECAL.

[31]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[32]  Frank Pasemann,et al.  Structure and function of evolved neuro-controllers for autonomous robots , 2004, Connect. Sci..

[33]  Tomasz Arciszewski,et al.  Evolutionary computation and structural design: A survey of the state-of-the-art , 2005 .

[34]  Peter A. Corning,et al.  The re-emergence of "emergence": A venerable concept in search of a theory , 2002, Complex..