Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons

The network of neurons with linear threshold (LT) transfer functions is a prominent model to emulate the behavior of cortical neurons. The analysis of dynamic properties for LT networks has attracted growing interest, such as multistability and boundedness. However, not much is known about how the connection strength and external inputs are related to oscillatory behaviors. Periodic oscillation is an important characteristic that relates to nondivergence, which shows that the network is still bounded although unstable modes exist. By concentrating on a general parameterized two-cell network, theoretical results for geometrical properties and existence of periodic orbits are presented. Although it is restricted to two-dimensional systems, the analysis can provide a useful contribution to analyze cyclic dynamics of some specific LT networks of high dimension. As an application, it is extended to an important class of biologically motivated networks of large scale: the winner-take-all model using local excitation and global inhibition.

[1]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[2]  Xiaohui Xie,et al.  Selectively Grouping Neurons in Recurrent Networks of Lateral Inhibition , 2002, Neural Computation.

[3]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Chih-fen Chang,et al.  Qualitative Theory of Differential Equations , 1992 .

[5]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[6]  H. Sebastian Seung,et al.  Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks , 2003, Neural Computation.

[7]  Bard Ermentrout,et al.  Complex dynamics in winner-take-all neural nets with slow inhibition , 1992, Neural Networks.

[8]  K. Hadeler,et al.  Stationary states of the Hartline-Ratliff model , 1987, Biological Cybernetics.

[9]  H. Sebastian Seung,et al.  Continuous attractors and oculomotor control , 1998, Neural Networks.

[10]  J. Hopfield Neurons withgraded response havecollective computational properties likethoseoftwo-state neurons , 1984 .

[11]  K. Hadeler,et al.  Qualitative behaviour of some simple networks , 1996 .

[12]  Richard Hans Robert Hahnloser,et al.  correction: Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[13]  Richard H. R. Hahnloser,et al.  On the piecewise analysis of networks of linear threshold neurons , 1998, Neural Networks.

[14]  L. Perko Differential Equations and Dynamical Systems , 1991 .

[15]  Heiko Wersing,et al.  Dynamical Stability Conditions for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions , 2001, Neural Computation.

[16]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[17]  Heiko Wersing,et al.  A Competitive-Layer Model for Feature Binding and Sensory Segmentation , 2001, Neural Computation.

[18]  Zhang Yi,et al.  Multistability Analysis for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions , 2003, Neural Computation.

[19]  S. Grossberg,et al.  Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks , 1975, Biological Cybernetics.

[20]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .