Toward a dynamical systems analysis of neuromodulation

This work presents some first steps toward a more thorough understanding of the control systems employed in evolutionary robotics. In order to choose an appropriate architecture or to construct an effective novel control system we need insights into what makes control systems successful, robust, evolvable, etc. Here we present analysis intended to shed light on this type of question as it applies to a novel class of artificial neural networks that include a neuromodulatory mechanism: GasNets. We begin by instantiating a particular GasNet subcircuit responsible for tuneable pattern generation and thought to underpin the attractive property of “temporal adaptivity”. Rather than work within the GasNet formalism, we develop an extension of the well-known FitzHugh-Nagumo equations. The continuous nature of our model allows us to conduct a thorough dynamical systems analysis and to draw parallels between this subcircuit and beating/bursting phenomena reported in the neuroscience literature. We then proceed to explore the effects of different types of parameter modulation on the system dynamics. We conclude that while there are key differences between the gain modulation used in the GasNet and alternative schemes (including threshold modulation of more traditional synaptic input), both approaches are able to produce tuneable pattern generation. While it appears, at least in this study, that the GasNet’s gain modulation may not be crucial to pattern generation , we go on to suggest some possible advantages it could confer.

[1]  R. Beer Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[2]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[3]  G. Turrigiano Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[4]  S. Gueron,et al.  Mapping the dynamics of a bursting neuron. , 1993, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Tomaso Poggio,et al.  Exploring brain functions : models in neuroscience : report of the Dahlem Workshop on Exploring Brain Functions : Models in Neuroscience, Berlin, 1991 September 29-October 4 , 1993 .

[6]  Sadri Hassani,et al.  Nonlinear Dynamics and Chaos , 2000 .

[7]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[8]  G. Ermentrout,et al.  Analysis of neural excitability and oscillations , 1989 .

[9]  Andrew Philippides,et al.  The Shifting Network: Volume Signalling in Real and Robot Nervous Systems , 2001, ECAL.

[10]  Andrew Philippides,et al.  Neuronal Plasticity and Temporal Adaptivity: GasNet Robot Control Networks , 2002, Adapt. Behav..

[11]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[12]  Jean-Marc Fellous,et al.  Computational Models of Neuromodulation , 1998, Neural Computation.

[13]  Olaf Sporns,et al.  An Embodied Model of Learning, Plasticity, and Reward , 2002, Adapt. Behav..

[14]  J P Changeux,et al.  Chemical signaling in the brain. , 1993, Scientific American.

[15]  Frances M. Dyro,et al.  The EEG handbook , 1989 .

[16]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[17]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[18]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[19]  J. NAGUMOt,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 2006 .

[20]  Inman Harvey,et al.  Evolving fixed-weight networks for learning robots , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[21]  Randall D. Beer,et al.  Center-Crossing Recurrent Neural Networks for the Evolution of Rhythmic Behavior , 2002, Neural Computation.

[22]  P. Katz Beyond neurotransmission : neuromodulation and its importance for information processing , 1999 .

[23]  P. Husbands,et al.  Not measuring evolvability: initial investigation of an evolutionary robotics search space , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[24]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[25]  Jordan B. Pollack,et al.  Connectionism: past, present, and future , 1989, Artificial Intelligence Review.