Spin-glass phase in a neutral network with asymmetric couplings

The author studies the phase diagram of a neural network model which has learnt with the ADALINE algorithm, starting from tabula non rasa conditions. The resulting synaptic efficacies are not symmetric under an exchange of the pre- and post-synaptic neuron. In contrast to several other models which have been discussed in the literature, he finds a spin-glass phase in the asymmetrically coupled network. The main difference compared with the other models consists of long-ranged Gaussian correlations in the ensemble of couplings.

[1]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model. , 1987, Physical review. A, General physics.

[2]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[3]  H. Janssen,et al.  The freezing transition in disordered non-equilibrium systems , 1986 .

[4]  Opper,et al.  Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.

[5]  Glauber Dynamics of Neural Network Models , 1988 .

[6]  D. Thouless,et al.  Stability of the Sherrington-Kirkpatrick solution of a spin glass model , 1978 .

[7]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[8]  H. Janssen,et al.  Renormalized field theory of critical dynamics , 1976 .

[9]  L. Peliti,et al.  Field-theory renormalization and critical dynamics aboveTc: Helium, antiferromagnets, and liquid-gas systems , 1978 .

[10]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Isabelle Guyon,et al.  A biologically constrained learning mechanism in networks of formal neurons , 1986 .

[12]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[13]  G. Toulouse.  On the mean field theory of mixed spin glass-ferromagnetic phases , 1980 .

[14]  E. Gardner,et al.  An Exactly Solvable Asymmetric Neural Network Model , 1987 .

[15]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[16]  S Dehaene,et al.  Spin glass model of learning by selection. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Ising spins and Glauber dynamics. , 1988, Physical review. A, General physics.