Optimization in "self-modeling" complex adaptive systems

When a dynamical system with multiple point attractors is released from an arbitrary initial condition, it will relax into a configuration that locally resolves the constraints or opposing forces between interdependent state variables. However, when there are many conflicting interdependencies between variables, finding a configuration that globally optimizes these constraints by this method is unlikely or may take many attempts. Here, we show that a simple distributed mechanism can incrementally alter a dynamical system such that it finds lower energy configurations, more reliably and more quickly. Specifically, when Hebbian learning is applied to the connections of a simple dynamical system undergoing repeated relaxation, the system will develop an associative memory that amplifies a subset of its own attractor states. This modifies the dynamics of the system such that its ability to find configurations that minimize total system energy, and globally resolve conflicts between interdependent variables, is enhanced. Moreover, we show that the system is not merely “recalling” low energy states that have been previously visited but “predicting” their location by generalizing over local attractor states that have already been visited. This “self-modeling” framework, i.e., a system that augments its behavior with an associative memory of its own attractors, helps us better understand the conditions under which a simple locally mediated mechanism of self-organization can promote significantly enhanced global resolution of conflicts between the components of a complex adaptive system. We illustrate this process in random and modular network constraint problems equivalent to graph coloring and distributed task allocation problems. © 2010 Wiley Periodicals, Inc. Complexity 16: 17–26, 2011 © 2011 Wiley Periodicals, Inc.

[1]  Arne Traulsen,et al.  Coevolution of strategy and structure in complex networks with dynamical linking. , 2006, Physical review letters.

[2]  Kunihiko Kaneko,et al.  Spontaneous structure formation in a network of chaotic units with variable connection strengths. , 2002, Physical review letters.

[3]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[4]  Steffen Staab,et al.  Neurons, Viscose Fluids, Freshwater Polyp Hydra-and Self-Organizing Information Systems , 2003, IEEE Intell. Syst..

[5]  Merav Parter,et al.  Facilitated Variation: How Evolution Learns from Past Environments To Generalize to New Environments , 2008, PLoS Comput. Biol..

[6]  Gintaras V. Reklaitis,et al.  Nonlinear Optimization Using Generalized Hopfield Networks , 1989, Neural Computation.

[7]  Rob Mills,et al.  How micro-evolution can guide macro-evolution : multi-scale search via evolved modular variation , 2010 .

[8]  F. C. Santos,et al.  Evolutionary games in self-organizing populations , 2008 .

[9]  José F. Fontanari,et al.  Model ecosystem with variable interspecies interactions , 2007 .

[10]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Richard A. Watson,et al.  Symbiosis Enables the Evolution of Rare Complexes in Structured Environments , 2009, ECAL.

[12]  Jeffrey S. Chase,et al.  Automated control in cloud computing: challenges and opportunities , 2009, ACDC '09.

[13]  José F. Fontanari,et al.  Generalization in a Hopfield network , 1990 .

[14]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[15]  A. Coolen On the Relation Between Stability Parameters and Sizes of Domains of Attraction in Attractor Neural Networks , 1991 .

[16]  Jean-Dominique Gascuel,et al.  An Internal Mechanism for Detecting Parasite Attractors in a Hopfield Network , 1994, Neural Computation.

[17]  E. Gardner The space of interactions in neural network models , 1988 .

[18]  James M. Cheverud,et al.  GENETIC VARIATION IN PLEIOTROPY: DIFFERENTIAL EPISTASIS AS A SOURCE OF VARIATION IN THE ALLOMETRIC RELATIONSHIP BETWEEN LONG BONE LENGTHS AND BODY WEIGHT , 2007, Evolution; international journal of organic evolution.

[19]  G. Wagner,et al.  The road to modularity , 2007, Nature Reviews Genetics.

[20]  Dan Dumitrescu,et al.  Overcoming hierarchical difficulty by hill-climbing the building block structure , 2007, GECCO '07.

[21]  Richard A. Watson,et al.  Can Selfish Symbioses Effect Higher-Level Selection? , 2009, ECAL.

[22]  Myung Won Kim,et al.  A conceptual interpretation of spurious memories in the Hopfield-type neural network , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[23]  R. W. Nettleton,et al.  Self-organizing channel assignment for wireless systems , 1997 .

[24]  Jordan B. Pollack,et al.  Modular Interdependency in Complex Dynamical Systems , 2005, Artificial Life.

[25]  Richard A. Watson,et al.  Global Adaptation in Networks of Selfish Components: Emergent Associative Memory at the System Scale , 2011, Artificial Life.

[26]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..

[27]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[28]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[29]  J. J. Hopfield,et al.  ‘Unlearning’ has a stabilizing effect in collective memories , 1983, Nature.