Immune networks: multitasking capabilities near saturation

Pattern-diluted associative networks were introduced recently as models for the immune system, with nodes representing T-lymphocytes and stored patterns representing signalling protocols between T- and B-lymphocytes. It was shown earlier that in the regime of extreme pattern dilution, a system with $N_T$ T-lymphocytes can manage a number $N_B!=!\order(N_T^\delta)$ of B-lymphocytes simultaneously, with $\delta!<!1$. Here we study this model in the extensive load regime $N_B!=!\alpha N_T$, with also a high degree of pattern dilution, in agreement with immunological findings. We use graph theory and statistical mechanical analysis based on replica methods to show that in the finite-connectivity regime, where each T-lymphocyte interacts with a finite number of B-lymphocytes as $N_T\to\infty$, the T-lymphocytes can coordinate effective immune responses to an extensive number of distinct antigen invasions in parallel. As $\alpha$ increases, the system eventually undergoes a second order transition to a phase with clonal cross-talk interference, where the system's performance degrades gracefully. Mathematically, the model is equivalent to a spin system on a finitely connected graph with many short loops, so one would expect the available analytical methods, which all assume locally tree-like graphs, to fail. Yet it turns out to be solvable. Our results are supported by numerical simulations.

[1]  R. Ellis,et al.  Entropy, large deviations, and statistical mechanics , 1985 .

[2]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[3]  E. Gardner,et al.  An Exactly Solvable Asymmetric Neural Network Model , 1987 .

[4]  Sompolinsky,et al.  Information storage in neural networks with low levels of activity. , 1987, Physical review. A, General physics.

[5]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[6]  Kanter,et al.  Properties of sparsely connected excitatory neural networks. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[7]  G. Parisi A simple model for the immune network. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[8]  A. Denman Cellular and Molecular Immunology , 1992 .

[9]  C. Goodnow Transgenic mice and analysis of B-cell tolerance. , 1992, Annual review of immunology.

[10]  A S Perelson,et al.  Immune network behavior--I. From stationary states to limit cycle oscillations. , 1993, Bulletin of mathematical biology.

[11]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[12]  H. W. Veen,et al.  Handbook of Biological Physics , 1996 .

[13]  G. Weisbuch,et al.  Immunology for physicists , 1997 .

[14]  J. Thèze,et al.  The cytokine network and immune functions , 1999 .

[15]  (1 + 8)-dimensional attractor neural networks , 2000 .

[16]  M. Mézard,et al.  The Bethe lattice spin glass revisited , 2000, cond-mat/0009418.

[17]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[18]  M. Newman Spread of epidemic disease on networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  B. Wemmenhove,et al.  Finite connectivity attractor neural networks , 2003 .

[20]  A. Coolen,et al.  Slowly evolving connectivity in recurrent neural networks: I. The extreme dilution regime , 2004, cond-mat/0403615.

[21]  J. P. L. Hatchett,et al.  Analytic solution of attractor neural networks on scale-free graphs , 2004 .

[22]  R. Schwartz,et al.  Natural regulatory T cells and self-tolerance , 2005, Nature Immunology.

[23]  N. S. Skantzos,et al.  Finitely connected vector spin systems with random matrix interactions , 2005, cond-mat/0504690.

[24]  C. Goodnow,et al.  Cellular and genetic mechanisms of self tolerance and autoimmunity , 2005, Nature.

[25]  Peter Sollich,et al.  Theory of Neural Information Processing Systems , 2005 .

[26]  A. Coolen,et al.  Dynamical replica analysis of disordered Ising spin systems on finitely connected random graphs. , 2005, Physical review letters.

[27]  A Large Scale Dynamical System Immune Network Model with Finite Connectivity(Oscillation, Chaos and Network Dynamics in Nonlinear Science) , 2006 .

[28]  E. D'Azevedo,et al.  Fast diagonalization of evolving matrices: application to spin-fermion models , 2007 .

[29]  Mehran Kardar,et al.  How the thymus designs antigen-specific and self-tolerant T cell receptor sequences , 2008, Proceedings of the National Academy of Sciences.

[30]  J. Spencer,et al.  Explosive Percolation in Random Networks , 2009, Science.

[31]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[32]  A. Chakraborty,et al.  Thymic selection of T-cell receptors as an extreme value problem. , 2009, Physical review letters.

[33]  C. Goodnow,et al.  Control systems and decision making for antibody production , 2010, Nature Immunology.

[34]  A. Barra,et al.  Stochastic dynamics for idiotypic immune networks , 2010 .

[35]  W. Bialek,et al.  Maximum entropy models for antibody diversity , 2009, Proceedings of the National Academy of Sciences.

[36]  A. Barra,et al.  The Replica Symmetric Approximation of the Analogical Neural Network , 2009, 0911.3096.

[37]  Elena Agliari,et al.  A statistical mechanics approach to autopoietic immune networks , 2010, 1001.3857.

[38]  Arup K Chakraborty,et al.  Statistical mechanical concepts in immunology. , 2010, Annual review of physical chemistry.

[39]  A. Barra,et al.  A Hebbian approach to complex-network generation , 2010, 1009.1343.

[40]  A. Barra,et al.  A thermodynamic perspective of immune capabilities. , 2011, Journal of theoretical biology.

[41]  A. Barra,et al.  Equilibrium statistical mechanics on correlated random graphs , 2010, 1009.1345.

[42]  Adriano Barra,et al.  On the equivalence of Hopfield networks and Boltzmann Machines , 2011, Neural Networks.

[43]  Ulrich Behn,et al.  Randomly evolving idiotypic networks: structural properties and architecture. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  A. Barra,et al.  Organization and evolution of synthetic idiotypic networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Elena Agliari,et al.  Multitasking associative networks. , 2011, Physical review letters.

[46]  Elena Agliari,et al.  Parallel processing in immune networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Elena Agliari,et al.  Immune networks: multi-tasking capabilities at medium load , 2013, 1302.7259.