Fourth order interactions in neural networks

Abstract We present analytical and numerical results for a truncated version of the RS model for neural networks and also for the generalization of the Hopfield model that considers multineuron interactions. Static properties are analyzed in the replica mean-field approach and dynamical aspects are studied through numerical simulations using the multispin coding algorithm. The load capacity, the sizes of the basins of attraction and the mean convergence time are presented in order to compare the performance of both models as associative memories and to get insight into the shape of their energy landscape.

[1]  Jose Roberto Iglesias,et al.  An alternative model for neural networks , 1990 .

[2]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[3]  J. L. van Hemmen,et al.  Classical Spin-Glass Model , 1982 .

[4]  M. Usher,et al.  Capacities of multiconnected memory models , 1988 .

[5]  G. A. Kohring,et al.  Neural networks with many-neuron interactions , 1990 .

[6]  Kanter.  Convergence time in infinite-range neural networks with parallel dynamics at zero temperature. , 1989, Physical review. A, General physics.

[7]  E. Gardner.  Multiconnected neural network models , 1987 .

[8]  Curado,et al.  Diluted-neural-network model with higher-order interactions. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[9]  T J P Penna,et al.  Simulations with a large number of neurons , 1989 .

[10]  G. Kohring,et al.  COMMENT: Convergence time and finite size effects in neural networks , 1990 .

[11]  P. M. C. de Oliveira,et al.  Computing Boolean Statistical Models , 1991 .

[12]  Jeferson Jacob Arenzon,et al.  A multineuron interaction model for neural networks , 1992 .

[13]  Abbott,et al.  Storage capacity of generalized networks. , 1987, Physical review. A, General physics.

[14]  P. M. C. de Oliveira,et al.  CONVERGENCE TIME ON THE RS MODEL FOR NEURAL NETWORKS , 1991 .

[15]  B. Forrest.  Content-addressability and learning in neural networks , 1988 .

[16]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[17]  Chandan Dasgupta,et al.  Hierarchical neural networks for the storage of correlated memories , 1991 .