Timescale and Stability in Adaptive Behaviour

Recently, in both the neuroscience and adaptive behaviour communities, there has been growing interest in the interplay of multiple timescales within neural systems. In particular, the phenomenon of neuromodulation has received a great deal of interest within neuroscience and a growing amount of attention within adaptive behaviour research. This interest has been driven by hypotheses and evidence that have linked neuromodulatory chemicals to a wide range of important adaptive processes such as regulation, reconfiguration, and plasticity. Here, we first demonstrate that manipulating timescales can qualitatively alter the dynamics of a simple system of coupled model neurons. We go on to explore this effect in larger systems within the framework employed by Gardner, Ashby and May in their seminal studies of stability in complex networks. On the basis of linear stability analysis, we conclude that, despite evidence that timescale is important for stability, the presence of multiple timescales within a single system has, in general, no appreciable effect on the May-Wigner stability/connectance relationship. Finally we address some of the shortcomings of linear stability analysis and conclude that more sophisticated analytical approaches are required in order to explore the impact of multiple timescales on the temporally extended dynamics of adaptive systems.

[1]  E. Wigner Gruppentheorie und ihre Anwendung auf die Quantenmechanik der Atomspektren , 1931 .

[2]  S. Hooper Neural Circuits: Functional Reconfiguration , 2001 .

[3]  Wolfgang Banzhaf,et al.  Advances in Artificial Life , 2003, Lecture Notes in Computer Science.

[4]  G. Edelman,et al.  Complexity and coherency: integrating information in the brain , 1998, Trends in Cognitive Sciences.

[5]  E. Guth,et al.  Gruppentheorie und ihre Anwendung auf die Quantenmechanik der Atomspektren , 1932 .

[6]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[7]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[8]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[9]  Mingzhou Ding,et al.  Will a large complex system with time delays be stable? , 2004, Physical review letters.

[10]  Tomaso Poggio,et al.  Exploring brain functions : models in neuroscience : report of the Dahlem Workshop on Exploring Brain Functions : Models in Neuroscience, Berlin, 1991 September 29-October 4 , 1993 .

[11]  Carlos Gershenson,et al.  Classification of Random Boolean Networks , 2002, ArXiv.

[12]  P. Katz Beyond neurotransmission : neuromodulation and its importance for information processing , 1999 .

[13]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[14]  Andrew Philippides,et al.  The Shifting Network: Volume Signalling in Real and Robot Nervous Systems , 2001, ECAL.

[15]  MARK R. GARDNER,et al.  Connectance of Large Dynamic (Cybernetic) Systems: Critical Values for Stability , 1970, Nature.

[16]  Hywel T. P. Williams,et al.  Homeostatic plasticity in recurrent neural networks , 2004 .

[17]  P. Husbands,et al.  Fast and loose: biologically inspired couplings , 2002 .

[18]  Seth Bullock,et al.  Toward a dynamical systems analysis of neuromodulation , 2004 .

[19]  K. McCann The diversity–stability debate , 2000, Nature.

[20]  Sanyou Zeng,et al.  Evolvable Systems: From Biology to Hardware, 7th International Conference, ICES 2007, Wuhan, China, September 21-23, 2007, Proceedings , 2007, ICES.

[21]  Andrew Philippides,et al.  Neuronal Plasticity and Temporal Adaptivity: GasNet Robot Control Networks , 2002, Adapt. Behav..

[22]  ROBERT M. MAY,et al.  Will a Large Complex System be Stable? , 1972, Nature.

[23]  M. Stephanov,et al.  Random Matrices , 2005, hep-ph/0509286.

[24]  Jordan B. Pollack,et al.  Modular Interdependency in Complex Dynamical Systems , 2005, Artificial Life.

[25]  Kenneth L. Artis Design for a Brain , 1961 .

[26]  Inman Harvey,et al.  Through the Labyrinth Evolution Finds a Way: A Silicon Ridge , 1996, ICES.

[27]  G. Turrigiano Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[28]  Sitabhra Sinha,et al.  Evidence of universality for the May-Wigner stability theorem for random networks with local dynamics. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  P. Husbands,et al.  Not measuring evolvability: initial investigation of an evolutionary robotics search space , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[30]  Kenny Smith,et al.  Natural Selection and Cultural Selection in the Evolution of Communication , 2002, Adapt. Behav..