Evolution of Neural Structure and Complexity in a Computational Ecology

We analyze evolutionary trends in artificial neural dynamics and network architectures specified by haploid genomes in the Polyworld computational ecology. We discover consistent trends in neural connection densities, synaptic weights and learning rates, entropy, mutual information, and an information-theoretic measure of complexity. In particular, we observe a consistent trend towards greater structural elaboration and adaptability, with a concomitant and statistically significant growth in neural complexity.

[1]  P. Pye-Smith The Descent of Man, and Selection in Relation to Sex , 1871, Nature.

[2]  Stephen Wolfram,et al.  Universality and complexity in cellular automata , 1983 .

[3]  J. Bonner The Evolution of Complexity by Means of Natural Selection , 1988 .

[4]  A. Papoulis Probability and Statistics , 1989 .

[5]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  James P. Crutchfield,et al.  Computation at the Onset of Chaos , 1991 .

[8]  James P. Crutchfield,et al.  Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations , 1993, Complex Syst..

[9]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[10]  S. Gould The evolution of life on the earth. , 1994, Scientific American.

[11]  D. McShea PERSPECTIVE METAZOAN COMPLEXITY AND EVOLUTION: IS THERE A TREND? , 1996, Evolution; international journal of organic evolution.

[12]  N. Packard,et al.  A Comparison of Evolutionary Activity in Artificial Evolving Systems and in the Biosphere , 1998 .

[13]  Johan Bollen,et al.  "Book and Software Reviews-The Complexity of Evolution: Review of" The Evolution of Complexity: The Violet Book of Einstein Meets Magritte" , 1999 .

[14]  Mark A. Bedau,et al.  A Generic Neutral Model for Quantitative Comparison of Genotypic Evolutionary Activity , 1999, ECAL.

[15]  F. Heylighen The Growth of Structural and Functional Complexity during Evolution , 1999 .

[16]  G Tononi,et al.  Theoretical neuroanatomy: relating anatomical and functional connectivity in graphs and cortical connection matrices. , 2000, Cerebral cortex.

[17]  C. Adami,et al.  Evolution of Biological Complexity , 2000, Proc. Natl. Acad. Sci. USA.

[18]  S. Carroll Chance and necessity: the evolution of morphological complexity and diversity , 2001, Nature.

[19]  C. Adami What is complexity? , 2002, BioEssays : news and reviews in molecular, cellular and developmental biology.

[20]  Evandro Agazzi,et al.  What is Complexity , 2002 .

[21]  Lawrence F. Gray,et al.  A Mathematician Looks at Wolfram''s New Kind of Science , 2003 .

[22]  C. Shalizi Optimal Nonlinear Prediction of Random Fields on Networks , 2003, DMCS.

[23]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[24]  Dario Floreano,et al.  Artificial Life X , 2006 .

[25]  Olaf Sporns,et al.  Methods for quantifying the informational structure of sensory and motor data , 2007, Neuroinformatics.