Attentive cross-modal paratope prediction

Antibodies are a critical part of the immune system, having the function of recognizing and mediating the neutralization of undesirable molecules (antigens) for future destruction. Being able to predict which amino acids belong to the paratope, the region on the antibody that binds to the antigen, can facilitate antibody engineering and predictions of antibody-antigen structures. The suitability of deep neural networks has recently been confirmed for this task, with Parapred outperforming all prior models. In this work, we first significantly outperform the computational efficiency of Parapred by leveraging à trous convolutions and self-attention. Second, we implement cross-modal attention by allowing the antibody residues to attend over antigen residues. This leads to new state-of-the-art results in paratope prediction, along with novel opportunities to interpret the outcome of the prediction.

[1]  Jiye Shi,et al.  SAbDab: the structural antibody database , 2013, Nucleic Acids Res..

[2]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  Pietro Liò,et al.  Parapred: antibody paratope prediction using convolutional and recurrent neural networks , 2018, Bioinform..

[7]  A. Lesk,et al.  Standard conformations for the canonical structures of immunoglobulins. , 1997, Journal of molecular biology.

[8]  Paolo Marcatili,et al.  Prediction of site-specific interactions in antibody-antigen complexes: the proABC method and server , 2013, Bioinform..

[9]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[10]  P. Lio’,et al.  Paratope Prediction using Convolutional and Recurrent Neural Networks , 2017, bioRxiv.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Alex Graves,et al.  Neural Machine Translation in Linear Time , 2016, ArXiv.

[13]  Jens Meiler,et al.  Generation and evaluation of dimension-reduced amino acid parameter representations by artificial neural networks , 2001 .

[14]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[15]  C. Deane,et al.  Antibody i-Patch prediction of the antibody binding site improves rigid local antibody-antigen docking. , 2013, Protein engineering, design & selection : PEDS.