Attack and defence in cellular decision-making: lessons from machine learning.

Machine learning algorithms can be fooled by small well-designed adversarial perturbations. This is reminiscent of cellular decision-making where ligands (called antagonists) prevent correct signalling, like in early immune recognition. We draw a formal analogy between neural networks used in machine learning and models of cellular decision-making (adaptive proofreading). We apply attacks from machine learning to simple decision-making models, and show explicitly the correspondence to antagonism by weakly bound ligands. Such antagonism is absent in more nonlinear models, which inspired us to implement a biomimetic defence in neural networks filtering out adversarial perturbations. We then apply a gradient-descent approach from machine learning to different cellular decision-making models, and we reveal the existence of two regimes characterized by the presence or absence of a critical point for the gradient. This critical point causes the strongest antagonists to lie close to the decision boundary. This is validated in the loss landscapes of robust neural networks and cellular decision-making models, and observed experimentally for immune cells. For both regimes, we explain how associated defence mechanisms shape the geometry of the loss landscape, and why different adversarial attacks are effective in different regimes. Our work connects evolved cellular decision-making to machine learning, and motivates the design of a general theory of adversarial perturbations, both for in vivo and in silico systems.

[1]  Emil R. Unanue,et al.  Altered Peptide Ligands Make Their Entry , 2011, The Journal of Immunology.

[2]  Ronald N Germain,et al.  T cell-positive selection uses self-ligand binding strength to optimize repertoire recognition of foreign antigens. , 2013, Immunity.

[3]  Ö. Türeci,et al.  Personalized vaccines for cancer immunotherapy , 2018, Science.

[4]  P. Klenerman,et al.  Cytotoxic T Lymphocyte Lysis Inhibited by Viable HIV Mutants , 1995, Science.

[5]  John J. Hopfield,et al.  Unsupervised learning by competing hidden units , 2018, Proceedings of the National Academy of Sciences.

[6]  John J. Hopfield,et al.  Dense Associative Memory for Pattern Recognition , 2016, NIPS.

[7]  Andrew L. Beam,et al.  Adversarial Attacks Against Medical Deep Learning Systems , 2018, ArXiv.

[8]  J. Hopfield Kinetic proofreading: a new mechanism for reducing errors in biosynthetic processes requiring high specificity. , 1974, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Thierry Mora,et al.  Physical Limit to Concentration Sensing Amid Spurious Ligands. , 2015, Physical review letters.

[10]  Omer Dushek,et al.  Architecture of a minimal signaling pathway explains the T-cell response to a 1 million-fold variation in antigen affinity and dose , 2016, Proceedings of the National Academy of Sciences.

[11]  Arup K Chakraborty,et al.  Quorum sensing allows T cells to discriminate between self and nonself , 2013, Proceedings of the National Academy of Sciences.

[12]  Paul François,et al.  Phenotypic spandrel: absolute discrimination and ligand antagonism , 2015, bioRxiv.

[13]  J. Wolchok,et al.  Genetic basis for clinical response to CTLA-4 blockade in melanoma. , 2014, The New England journal of medicine.

[14]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[15]  Mingyan Liu,et al.  Spatially Transformed Adversarial Examples , 2018, ICLR.

[16]  Andres Laan,et al.  Sensory cheating: adversarial body patterns can fool a convolutional visual system during signaling , 2018 .

[17]  Ananthram Swami,et al.  Practical Black-Box Attacks against Machine Learning , 2016, AsiaCCS.

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  T. McKeithan,et al.  Kinetic proofreading in T-cell receptor signal transduction. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Claude Emond,et al.  Non-monotonic dose-response relationships and endocrine disruptors: a qualitative method of assessment , 2015, Environmental Health.

[22]  S. Alam,et al.  T-cell receptor binding kinetics in T-cell development and activation , 2001, Expert Reviews in Molecular Medicine.

[23]  Ronald N Germain,et al.  Modeling T Cell Antigen Discrimination Based on Feedback Control of Digital ERK Responses , 2005, PLoS biology.

[24]  Jayajit Das,et al.  Activation or tolerance of natural killer cells is modulated by ligand quality in a nonmonotonic manner. , 2010, Biophysical journal.

[25]  Atul Prakash,et al.  Robust Physical-World Attacks on Deep Learning Visual Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Logan Engstrom,et al.  Synthesizing Robust Adversarial Examples , 2017, ICML.

[27]  Seyed-Mohsen Moosavi-Dezfooli,et al.  Universal Adversarial Perturbations , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Paul François,et al.  Chemodetection in fluctuating environments: Receptor coupling, buffering, and antagonism , 2015, Proceedings of the National Academy of Sciences.

[29]  Thierry Mora,et al.  Receptor crosstalk improves concentration sensing of multiple ligands , 2018, bioRxiv.

[30]  T. Schumacher,et al.  Neoantigens in cancer immunotherapy , 2015, Science.

[31]  John J. Hopfield,et al.  Dense Associative Memory Is Robust to Adversarial Inputs , 2017, Neural Computation.

[32]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[33]  Aleksander Madry,et al.  Robustness May Be at Odds with Accuracy , 2018, ICLR.

[34]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[35]  R. Germain,et al.  The dynamics of T cell receptor signaling: complex orchestration and the key roles of tempo and cooperation. , 1999, Annual review of immunology.

[36]  David Berthelot,et al.  Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer , 2018, ICLR.

[37]  Arup K. Chakraborty,et al.  Fast on-rates allow short dwell time ligands to activate T cells , 2010, Proceedings of the National Academy of Sciences.

[38]  A. Levine,et al.  A neoantigen fitness model predicts tumour response to checkpoint blockade immunotherapy , 2017, Nature.

[39]  Jascha Sohl-Dickstein,et al.  Adversarial Examples that Fool both Human and Computer Vision , 2018, ArXiv.

[40]  J. Ninio Kinetic amplification of enzyme discrimination. , 1975, Biochimie.

[41]  Jinyuan Yan,et al.  Bow-tie signaling in c-di-GMP: Machine learning in a simple biochemical network , 2017, PLoS Comput. Biol..

[42]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[43]  Paul François,et al.  Untangling the Hairball: Fitness-Based Asymptotic Reduction of Biological Networks. , 2017, Biophysical journal.

[44]  Arup K Chakraborty,et al.  Insights into the initiation of TCR signaling , 2014, Nature Immunology.

[45]  Jascha Sohl-Dickstein,et al.  Adversarial Examples that Fool both Computer Vision and Time-Limited Humans , 2018, NeurIPS.

[46]  Grégoire Altan-Bonnet,et al.  T Cells Integrate Local and Global Cues to Discriminate between Structurally Similar Antigens. , 2015, Cell reports.

[47]  Alexandre V. Morozov,et al.  Decoding Complex Chemical Mixtures with a Physical Model of a Sensor Array , 2011, PLoS Comput. Biol..

[48]  D. Fremont,et al.  High- and low-potency ligands with similar affinities for the TCR: the importance of kinetics in TCR signaling. , 1998, Immunity.

[49]  J. Zico Kolter,et al.  Provable defenses against adversarial examples via the convex outer adversarial polytope , 2017, ICML.

[50]  Lewis D. Griffin,et al.  A Boundary Tilting Persepective on the Phenomenon of Adversarial Examples , 2016, ArXiv.

[51]  H. Metzger,et al.  An unusual mechanism for ligand antagonism. , 1998, Science.

[52]  Patrick D. McDaniel,et al.  On the (Statistical) Detection of Adversarial Examples , 2017, ArXiv.

[53]  Paul François,et al.  Principles of adaptive sorting revealed by in silico evolution. , 2013, Physical review letters.

[54]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[55]  Ajmal Mian,et al.  Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey , 2018, IEEE Access.

[56]  Kouichi Sakurai,et al.  One Pixel Attack for Fooling Deep Neural Networks , 2017, IEEE Transactions on Evolutionary Computation.

[57]  Eric D. Siggia,et al.  Decisions on the fly in cellular sensory systems , 2013, Proceedings of the National Academy of Sciences.

[58]  Seyed-Mohsen Moosavi-Dezfooli,et al.  Robustness via Curvature Regularization, and Vice Versa , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  C. Janeway,et al.  Cross-antagonism of a T cell clone expressing two distinct T cell receptors. , 1999, Immunity.

[60]  Alan L. Yuille,et al.  Feature Denoising for Improving Adversarial Robustness , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Sarah Rowland-Jones,et al.  Cytotoxic T-cell activity antagonized by naturally occurring HIV-1 Gag variants , 1994, Nature.

[62]  Gautam Reddy,et al.  Antagonism in olfactory receptor neurons and its implications for the perception of odor mixtures , 2017 .

[63]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[64]  Paul François,et al.  The Case for Absolute Ligand Discrimination: Modeling Information Processing and Decision by Immune T Cells , 2015, bioRxiv.

[65]  S. Kent,et al.  Antagonism of vaccine-induced HIV-1-specific CD4+ T cells by primary HIV-1 infection: potential mechanism of vaccine failure. , 1997, Journal of immunology.

[66]  Ofer Feinerman,et al.  Quantitative challenges in understanding ligand discrimination by αβ T cells , 2008 .

[67]  Paul François,et al.  Phenotypic model for early T-cell activation displaying sensitivity, specificity, and antagonism , 2013, Proceedings of the National Academy of Sciences.

[68]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[69]  Samy Bengio,et al.  Adversarial Machine Learning at Scale , 2016, ICLR.