Synchronous and asynchronous systems of threshold elements

The role of synchronism in systems of threshold elements (such as neural networks) is examined. Some important differences between synchronous and asynchronous systems are outlined. In particular, important restrictions on limit cycles are found in asynchronous systems along with multi-frequency oscillations which do not appear in synchronous systems. The possible role of deterministic chaos in these systems is discussed.

[1]  R. E. Warmack,et al.  An Algorithm for the Optimal Solution of Linear Inequalities and its Application to Pattern Recognition , 1973, IEEE Transactions on Computers.

[2]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Rolf Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[4]  Shigehiro Ushiki,et al.  Chaos in numerical analysis of ordinary differential equations , 1981 .

[5]  Shun-ichi Amari,et al.  Characteristics of randomly connected threshold-element networks and network systems , 1971 .

[6]  S. Levialdi,et al.  Basics of cellular logic with some applications in medical image processing , 1979, Proceedings of the IEEE.

[7]  Donald L. Snyder,et al.  Random point processes , 1975 .

[8]  R. Swendsen.  Monte Carlo Renormalization , 1982 .

[9]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.

[10]  James P. Crutchfield,et al.  Noise phenomena in Josephson junctions , 1980 .

[11]  N. F. Pedersen,et al.  Chaos and noise rise in Josephson junctions , 1981 .

[12]  Shun-ichi Amari,et al.  A method of statistical neurodynamics , 1974, Kybernetik.

[13]  Hermann Haken,et al.  Chaos and Order in Nature , 1981 .

[14]  Leon N. Cooper,et al.  A possible organization of animal memory and learning , 1973 .

[15]  Ilya Prigogine,et al.  From Being To Becoming , 1980 .

[16]  M. Feigenbaum.  Quantitative universality for a class of nonlinear transformations , 1978 .

[17]  Arthur W. Burks,et al.  Essays on cellular automata , 1970 .

[18]  A. V. Holden,et al.  The induction of periodic and chaotic activity in a molluscan neurone , 2004, Biological Cybernetics.

[19]  S. Kirkpatrick,et al.  Infinite-ranged models of spin-glasses , 1978 .

[20]  E. Oja,et al.  A theory for the acquisition and loss of neuron specificity in visual cortex , 1979, Biological Cybernetics.