Immune networks: multi-tasking capabilities at medium load

Associative network models featuring multi-tasking properties have been introduced recently and studied in the low-load regime, where the number P of simultaneously retrievable patterns scales with the number N of nodes as P ∼ logN. In addition to their relevance in artificial intelligence, these models are increasingly important in immunology, where stored patterns represent strategies to fight pathogens and nodes represent lymphocyte clones. They allow us to understand the crucial ability of the immune system to respond simultaneously to multiple distinct antigen invasions. Here we develop further the statistical mechanical analysis of such systems, by studying the mediumload regime, P ∼ N δ with δ ∈ (0, 1]. We derive three main results. First, we reveal the nontrivial architecture of these networks: they exhibit a high degree of modularity and clustering, which is linked to their retrieval abilities. Second, by solving the model we demonstrate for δ< 1 the existence of large regions in the phase diagram where the network can retrieve all stored patterns simultaneously. Finally, in the high-load regime δ = 1 we find that the system behaves as a spin-glass, suggesting that finite-connectivity frameworks are required to achieve effective retrieval.

[1]  M. Brede,et al.  Architecture of idiotypic networks: percolation and scaling behavior. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  G. Weisbuch,et al.  Immunology for physicists , 1997 .

[3]  A. Barra,et al.  Organization and evolution of synthetic idiotypic networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Adriano Barra,et al.  On the equivalence of Hopfield networks and Boltzmann Machines , 2011, Neural Networks.

[5]  A. Si,et al.  Entropy,Large Deviations,and Statistical Mechanics , 2011 .

[6]  G W Hoffmann,et al.  A neural network model based on the analogy with the immune system. , 1986, Journal of theoretical biology.

[7]  G. Weisbuch,et al.  A shape space approach to the dynamics of the immune system. , 1990, Journal of theoretical biology.

[8]  M. Newman Spread of epidemic disease on networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  I. Castillo,et al.  Parallel dynamics of disordered Ising spin systems on finitely connected random graphs , 2004, cond-mat/0403172.

[10]  I. Cohen,et al.  The HSP60 immune system network. , 2011, Trends in immunology.

[11]  Elena Agliari,et al.  A statistical mechanics approach to autopoietic immune networks , 2010, 1001.3857.

[12]  L. Wilkinson Immunity , 1891, The Lancet.

[13]  A. Chakraborty,et al.  Thymic selection of T-cell receptors as an extreme value problem. , 2009, Physical review letters.

[14]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[15]  E. Gardner,et al.  An Exactly Solvable Asymmetric Neural Network Model , 1987 .

[16]  Hugues Bersini,et al.  Hints for Adaptive Problem Solving Gleaned from Immune Networks , 1990, PPSN.

[17]  Arup K Chakraborty,et al.  Statistical mechanical concepts in immunology. , 2010, Annual review of physical chemistry.

[18]  J. Rogers Chaos , 1876 .

[19]  W. Bialek,et al.  Maximum entropy models for antibody diversity , 2009, Proceedings of the National Academy of Sciences.

[20]  H. W. Veen,et al.  Handbook of Biological Physics , 1996 .

[21]  Markus Brede,et al.  Patterns in randomly evolving networks: idiotypic networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[23]  R. Medzhitov Recognition of microorganisms and activation of the immune response , 2007, Nature.

[24]  J. P. L. Hatchett,et al.  Analytic solution of attractor neural networks on scale-free graphs , 2004 .

[25]  F T Vertosick,et al.  Immune network theory: a role for parallel distributed processing? , 1989, Immunology.

[26]  G. Parisi A simple model for the immune network. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Ulrich Behn,et al.  Randomly evolving idiotypic networks: structural properties and architecture. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  C. Goodnow,et al.  Control systems and decision making for antibody production , 2010, Nature Immunology.

[29]  Eshel Ben-Jacob,et al.  Analyses of antigen dependency networks unveil immune system reorganization between birth and adulthood. , 2011, Chaos.

[30]  A. Barra The Mean Field Ising Model trough Interpolating Techniques , 2007, 0712.1344.

[31]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[32]  (1 + 8)-dimensional attractor neural networks , 2000 .

[33]  R. Schwartz,et al.  Natural regulatory T cells and self-tolerance , 2005, Nature Immunology.

[34]  A. Coolen,et al.  Slowly evolving connectivity in recurrent neural networks: I. The extreme dilution regime , 2004, cond-mat/0403615.

[35]  Elena Agliari,et al.  Multitasking associative networks. , 2011, Physical review letters.

[36]  R. Ellis,et al.  Entropy, large deviations, and statistical mechanics , 1985 .

[37]  Antoine Allard,et al.  Heterogeneous bond percolation on multitype networks with an application to epidemic dynamics. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Peter Sollich,et al.  Theory of Neural Information Processing Systems , 2005 .

[39]  Elena Agliari,et al.  Parallel processing in immune networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Kanter,et al.  Properties of sparsely connected excitatory neural networks. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[41]  A. Barra,et al.  A thermodynamic perspective of immune capabilities. , 2011, Journal of theoretical biology.

[42]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[43]  A. Barra,et al.  The Replica Symmetric Approximation of the Analogical Neural Network , 2009, 0911.3096.

[44]  C. Goodnow,et al.  Cellular and genetic mechanisms of self tolerance and autoimmunity , 2005, Nature.

[45]  Eshel Ben-Jacob,et al.  Organization of the autoantibody repertoire in healthy newborns and adults revealed by system level informatics of antigen microarray data , 2009, Proceedings of the National Academy of Sciences.

[46]  R. Medzhitov Approaching the asymptote: 20 years later. , 2009, Immunity.

[47]  C. Goodnow Transgenic mice and analysis of B-cell tolerance. , 1992, Annual review of immunology.

[48]  A Large Scale Dynamical System Immune Network Model with Finite Connectivity(Oscillation, Chaos and Network Dynamics in Nonlinear Science) , 2006 .

[49]  Alexander Kusnecov,et al.  The Cytokine Network and Immune Functions. , 2001 .

[50]  A S Perelson,et al.  Immune network behavior--I. From stationary states to limit cycle oscillations. , 1993, Bulletin of mathematical biology.

[51]  Sompolinsky,et al.  Information storage in neural networks with low levels of activity. , 1987, Physical review. A, General physics.

[52]  Eshel Ben-Jacob,et al.  Network Theory Analysis of Antibody-Antigen Reactivity Data: The Immune Trees at Birth and Adulthood , 2011, PloS one.

[53]  Mehran Kardar,et al.  How the thymus designs antigen-specific and self-tolerant T cell receptor sequences , 2008, Proceedings of the National Academy of Sciences.

[54]  A. Denman Cellular and Molecular Immunology , 1992 .

[55]  Michael W Deem,et al.  Sequence space localization in the immune system response to vaccination and disease. , 2003, Physical review letters.

[56]  Yoram Louzoun,et al.  A Systems Immunology Approach to the Host-Tumor Interaction: Large-Scale Patterns of Natural Autoantibodies Distinguish Healthy and Tumor-Bearing Mice , 2009, PloS one.

[57]  B. Wemmenhove,et al.  Finite connectivity attractor neural networks , 2003 .

[58]  A. Barra,et al.  Stochastic dynamics for idiotypic immune networks , 2010 .