Multitasking associative networks.

We introduce a bipartite, diluted and frustrated, network as a sparse restricted Boltzmann machine and we show its thermodynamical equivalence to an associative working memory able to retrieve several patterns in parallel without falling into spurious states typical of classical neural networks. We focus on systems processing in parallel a finite (up to logarithmic growth in the volume) amount of patterns, mirroring the low-level storage of standard Amit-Gutfreund-Sompolinsky theory. Results obtained through statistical mechanics, the signal-to-noise technique, and Monte Carlo simulations are overall in perfect agreement and carry interesting biological insights. Indeed, these associative networks pave new perspectives in the understanding of multitasking features expressed by complex systems, e.g., neural and immune networks.

[1]  B. Wemmenhove,et al.  Finite connectivity attractor neural networks , 2003 .

[2]  Anthony C. C. Coolen,et al.  Selective pattern recall in neural networks by chemical modulation , 1990 .

[3]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[4]  M. Tsodyks,et al.  Capacity of networks with correlated attractors , 1994 .

[5]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[6]  E. G. Jones.  Cerebral Cortex , 1987, Cerebral Cortex.

[7]  Adriano Barra,et al.  On the equivalence of Hopfield networks and Boltzmann Machines , 2011, Neural Networks.

[8]  Sompolinsky,et al.  Willshaw model: Associative memory with sparse coding and low firing rates. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[9]  Michael J. Berry,et al.  Spin glass models for a network of real neurons , 2009, 0912.5409.

[10]  D J Amit,et al.  Multiple-object working memory--a model for behavioral performance. , 2003, Cerebral cortex.

[11]  A. Barra,et al.  Equilibrium statistical mechanics on correlated random graphs , 2010, 1009.1345.

[12]  Daniel J. Amit,et al.  Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors , 1999, Neural Computation.

[13]  A. Barra,et al.  The Replica Symmetric Approximation of the Analogical Neural Network , 2009, 0911.3096.

[14]  M. Mézard,et al.  Spin Glass Theory and Beyond , 1987 .

[15]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[16]  Kai Hwang,et al.  Computer architecture and parallel processing , 1984, McGraw-Hill Series in computer organization and architecture.

[17]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[18]  Anthony C. C. Coolen,et al.  Modelling chemical modulation of neural processes , 1993 .

[19]  I. K. Wood,et al.  Neuroscience: Exploring the brain , 1996 .