Generating functionals for autonomous latching dynamics in attractor relict networks

Coupling local, slowly adapting variables to an attractor network allows to destabilize all attractors, turning them into attractor ruins. The resulting attractor relict network may show ongoing autonomous latching dynamics. We propose to use two generating functionals for the construction of attractor relict networks, a Hopfield energy functional generating a neural attractor network and a functional based on information-theoretical principles, encoding the information content of the neural firing statistics, which induces latching transition from one transiently stable attractor ruin to the next. We investigate the influence of stress, in terms of conflicting optimization targets, on the resulting dynamics. Objective function stress is absent when the target level for the mean of neural activities is identical for the two generating functionals and the resulting latching dynamics is then found to be regular. Objective function stress is present when the respective target activity levels differ, inducing intermittent bursting latching dynamics.

[1]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[2]  Alessandro Treves,et al.  Frontal latching networks: a possible neural basis for infinite recursion , 2005, Cognitive neuropsychology.

[3]  Claudius Gros,et al.  Semantic learning in autonomously active recurrent neural networks , 2009, Log. J. IGPL.

[4]  Claudius Gros,et al.  Complex and Adaptive Dynamical Systems: A Primer , 2008 .

[5]  Ralf Der,et al.  Predictive information and explorative behavior of autonomous robots , 2008 .

[6]  Peter H. Richter.  Information and Self-organization: A Macroscopic Approach to Complex Systems, Hermann Haken. Springer, New York (1988), $59.50 (cloth), 196 pp , 1991 .

[7]  Mardi J. Horowitz,et al.  States of Mind , 1979, Critical Issues in Psychiatry.

[8]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[9]  Claudius Gros,et al.  Intrinsic Adaptation in Autonomous Recurrent Neural Networks , 2011, Neural Computation.

[10]  Michael Sierk.  Complexity may teach us a simple lesson , 2003, Nature.

[11]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[12]  Suzanna Becker,et al.  Mutual information maximization: models of cortical self-organization. , 1996, Network.

[13]  Claudius Gros,et al.  Neural networks with transient state dynamics , 2007, 0705.0078.

[14]  L. White,et al.  Lateral thinking , 1997, Nature.

[15]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[17]  C. Gros,et al.  Self-organized stochastic tipping in slow-fast dynamical systems , 2012, 1207.2928.

[18]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[19]  Ralf Der,et al.  Guided Self-organisation for Autonomous Robot Development , 2007, ECAL.

[20]  Alessandro Treves,et al.  The complexity of latching transitions in large scale cortical networks , 2006, Natural Computing.

[21]  Alessandro Treves,et al.  Free association transitions in models of cortical latching dynamics , 2008 .

[22]  Horn,et al.  Neural networks with dynamical thresholds. , 1989, Physical review. A, General physics.

[23]  Jochen Triesch,et al.  A Gradient Rule for the Plasticity of a Neuron's Intrinsic Excitability , 2005, ICANN.

[24]  M. A. Muñoz,et al.  Self-organization without conservation: true or just apparent scale-invariance? , 2009, 0905.1799.

[25]  Athena Akrami,et al.  Lateral thinking, from the Hopfield model to cortical dynamics , 2012, Brain Research.

[26]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[27]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[28]  C. Gros,et al.  Complex and Adaptive Dynamical Systems , 2008, 0807.4838.

[29]  Claudius Gros,et al.  Self-organized chaos through polyhomeostatic optimization. , 2010, Physical review letters.

[30]  Ralf Der,et al.  Information-driven self-organization: the dynamical system approach to autonomous robot behavior , 2011, Theory in Biosciences.

[31]  Claudius Gros,et al.  Cognitive Computation with Autonomously Active Neural Networks: An Emerging Field , 2009, Cognitive Computation.

[32]  Brendon O. Watson,et al.  Internal Dynamics Determine the Cortical Response to Thalamic Stimulation , 2005, Neuron.

[33]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[34]  M. Prokopenko.  Guided self‐organization , 2009, HFSP journal.

[35]  D. Marković,et al.  Power laws and Self-Organized Criticality in Theory and Nature , 2013, 1310.5527.

[36]  Dario L. Ringach,et al.  States of mind , 2003, Nature.