Application of interpretable artificial neural networks to early monoclonal antibodies development.

The development of a new protein drug typically starts with the design, expression and biophysical characterization of many different protein constructs. The initially high number of constructs is radically reduced to a few candidates that exhibit the desired biological and physicochemical properties. This process of protein expression and characterization to find the most promising molecules is both expensive and time-consuming. Consequently, many companies adopt and implement philosophies, e.g. platforms for protein expression and formulation, computational approaches, machine learning, to save resources and facilitate protein drug development. Inspired by this, we propose the use of interpretable artificial neuronal networks (ANNs) to predict biophysical properties of therapeutic monoclonal antibodies i.e. melting temperature Tm, aggregation onset temperature Tagg, interaction parameter kD as a function of pH and salt concentration from the amino acid composition. Our ANNs were trained with typical early-stage screening datasets achieving high prediction accuracy. By only using the amino acid composition, we could keep the ANNs simple which allows for high general applicability, robustness and interpretability. Finally, we propose a novel "knowledge transfer" approach, which can be readily applied due to the simple algorithm design, to understand how our ANNs come to their conclusions.

[1]  J Bourquin,et al.  Application of artificial neural networks (ANN) in the development of solid dosage forms. , 1997, Pharmaceutical development and technology.

[2]  S. Akilesh,et al.  FcRn: the neonatal Fc receptor comes of age , 2007, Nature Reviews Immunology.

[3]  Pamela J. Björkman,et al.  An intracellular traffic jam: Fc receptor-mediated transport of immunoglobulin G. , 2010, Current opinion in structural biology.

[4]  T. Laue,et al.  Proximity energies: a framework for understanding concentrated solutions , 2012, Journal of molecular recognition : JMR.

[5]  Robert D. Johnson,et al.  Application of Neural Computing in Pharmaceutical Product Development , 1991, Pharmaceutical Research.

[6]  Yan Su,et al.  Deep learning for in vitro prediction of pharmaceutical formulations , 2018, Acta pharmaceutica Sinica. B.

[7]  J. Friedman,et al.  A Statistical View of Some Chemometrics Regression Tools , 1993 .

[8]  James Green,et al.  ProtDCal: A program to compute general-purpose-numerical descriptors for sequences and 3D-structures of proteins , 2015, BMC Bioinformatics.

[9]  Vidyashankara G. Iyer,et al.  High throughput prediction of the long-term stability of pharmaceutical macromolecules from short-term multi-instrument spectroscopic data. , 2014, Journal of pharmaceutical sciences.

[10]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[11]  Steven Lantz,et al.  Examination of thermal unfolding and aggregation profiles of a series of developable therapeutic monoclonal antibodies. , 2015, Molecular pharmaceutics.

[12]  Matthew Hutson,et al.  Has artificial intelligence become alchemy? , 2018, Science.

[13]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[14]  Dan W. Patterson,et al.  Artificial Neural Networks: Theory and Applications , 1998 .

[15]  Kozo Takayama,et al.  Artificial Neural Network as a Novel Method to Optimize Pharmaceutical Formulations , 2004, Pharmaceutical Research.

[16]  Peter York,et al.  The effect of experimental design on the modeling of a tablet coating formulation using artificial neural networks. , 2002, European journal of pharmaceutical sciences : official journal of the European Federation for Pharmaceutical Sciences.

[17]  T. Laue,et al.  Comparative study of analytical techniques for determining protein charge. , 2015, Journal of pharmaceutical sciences.

[18]  H. Kettenberger,et al.  Developability assessment during the selection of novel therapeutic antibodies. , 2015, Journal of pharmaceutical sciences.

[19]  Dong-Sheng Cao,et al.  An Integrated Transfer Learning and Multitask Learning Approach for Pharmacokinetic Parameter Prediction , 2018, Molecular pharmaceutics.

[20]  Wei Liu,et al.  High‐throughput measurement, correlation analysis, and machine‐learning predictions for pH and thermal stabilities of Pfizer‐generated antibodies , 2011, Protein science : a publication of the Protein Society.

[21]  Kauko Leiviskä,et al.  Effect of neural network topology and training end point in modelling the fluidized bed granulation process , 1994 .

[22]  Malgorzata B. Tracka,et al.  Utility of High Throughput Screening Techniques to Predict Stability of Monoclonal Antibody Formulations During Early Stage Development. , 2017, Journal of pharmaceutical sciences.

[23]  H Schmidli,et al.  Advantages of Artificial Neural Networks (ANNs) as alternative modelling technique for data sets showing non-linear relationships using data from a galenical study on a solid dosage form. , 1998, European journal of pharmaceutical sciences : official journal of the European Federation for Pharmaceutical Sciences.

[24]  Igor V. Tetko,et al.  Data modelling with neural networks: Advantages and limitations , 1997, J. Comput. Aided Mol. Des..

[25]  A. D. Nielsen,et al.  Viscosity of high concentration protein formulations of monoclonal antibodies of the IgG1 and IgG4 subclass - prediction of viscosity through protein-protein interaction measurements. , 2013, European journal of pharmaceutical sciences : official journal of the European Federation for Pharmaceutical Sciences.

[26]  Naomi E Chayen,et al.  Two Independent Histidines, One in Human Prolactin and One in Its Receptor, Are Critical for pH-dependent Receptor Recognition and Activation* , 2010, The Journal of Biological Chemistry.

[27]  Liqiang Lisa Zhou,et al.  Impact of short range hydrophobic interactions and long range electrostatic forces on the aggregation kinetics of a monoclonal antibody and a dual-variable domain immunoglobulin at low and high concentrations. , 2011, International journal of pharmaceutics.

[28]  D. Dimitrov Therapeutic antibodies, vaccines and antibodyomes , 2010, mAbs.

[29]  S. Ram,et al.  The effect of pH dependence of antibody-antigen interactions on subcellular trafficking dynamics , 2013, mAbs.

[30]  C. Russell Middaugh,et al.  High-Throughput Biophysical Analysis of Protein Therapeutics to Examine Interrelationships Between Aggregate Formation and Conformational Stability , 2013, The AAPS Journal.

[31]  Franco Turini,et al.  A Survey of Methods for Explaining Black Box Models , 2018, ACM Comput. Surv..

[32]  Robert Gurny,et al.  High throughput screening of protein formulation stability: practical considerations. , 2007, European journal of pharmaceutics and biopharmaceutics : official journal of Arbeitsgemeinschaft fur Pharmazeutische Verfahrenstechnik e.V.

[33]  K. Maeda,et al.  pH-dependent receptor/ligand dissociation as a determining factor for intracellular sorting of ligands for epidermal growth factor receptors in rat hepatocytes. , 2002, Journal of controlled release : official journal of the Controlled Release Society.

[34]  A. Shukla,et al.  Prediction of Drug Content and Hardness of Intact Tablets Using Artificial Neural Network and Near-Infrared Spectroscopy , 2001, Drug development and industrial pharmacy.

[35]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[36]  Harald Kolmar,et al.  A generic approach to engineer antibody pH-switches using combinatorial histidine scanning libraries and yeast display , 2014, mAbs.

[37]  R. Carbonell,et al.  Design of pH Sensitive Binding Proteins from the Hyperthermophilic Sso7d Scaffold , 2012, PloS one.

[38]  G. Box Science and Statistics , 1976 .

[39]  M Tusar,et al.  Viscosity prediction of lipophilic semisolid emulsion systems by neural network modelling. , 2000, International journal of pharmaceutics.

[40]  K. Leiviskä,et al.  The advantages by the use of neural networks in modelling the fluidized bed granulation process , 1994 .

[41]  J. Israelachvili Intermolecular and surface forces , 1985 .

[42]  Deborah S. Goldberg,et al.  Formulation development of therapeutic monoclonal antibodies using high-throughput fluorescence and static light scattering techniques: role of conformational and colloidal stability. , 2011, Journal of pharmaceutical sciences.

[43]  Marjan Tušar,et al.  Lipophilic semisolid emulsion systems: viscoelastic behaviour and prediction of physical stability by neural network modelling , 1998 .

[44]  C. F. van der Walle,et al.  Therapeutic antibodies: market considerations, disease targets and bioprocessing. , 2013, International journal of pharmaceutics.

[45]  Lars Linden,et al.  Salt-induced aggregation of a monoclonal human immunoglobulin G1. , 2013, Journal of pharmaceutical sciences.

[46]  Robert D. Johnson,et al.  Application of Neural Computing in Pharmaceutical Product Development: Computer Aided Formulation Design , 1994 .

[47]  M. Morbidelli,et al.  A multiscale view of therapeutic protein aggregation: A colloid science perspective , 2015, Biotechnology journal.

[48]  D. Manallack,et al.  Analysis of linear and nonlinear QSAR data using neural networks. , 1994, Journal of medicinal chemistry.

[49]  Aditi Sharma,et al.  Gauging colloidal and thermal stability in human IgG1-sugar solutions through diffusivity measurements. , 2014, The journal of physical chemistry. B.

[50]  Ann Lehman JMP for basic univariate and multivariate statistics : a step-by-step guide , 2005 .

[51]  S. Agatonovic-Kustrin,et al.  Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research. , 2000, Journal of pharmaceutical and biomedical analysis.

[52]  Christopher T. Rhodes,et al.  Artificial Neural Networks: Implications for Pharmaceutical Sciences , 1995 .

[53]  David J. Livingstone,et al.  Artificial neural networks: Application and chance effects for QSAR data analysis , 1992 .

[54]  Rachel M. Devay,et al.  Increasing Serum Half-life and Extending Cholesterol Lowering in Vivo by Engineering Antibody with pH-sensitive Binding to PCSK9* , 2012, The Journal of Biological Chemistry.

[55]  D. Dimitrov,et al.  Expression, purification, and characterization of engineered antibody CH2 and VH domains. , 2012, Methods in molecular biology.

[56]  Kunihiro Hattori,et al.  Antibody recycling by engineered pH-dependent antigen binding improves the duration of antigen neutralization , 2010, Nature Biotechnology.

[57]  Linda O Narhi,et al.  High throughput thermostability screening of monoclonal antibody formulations. , 2010, Journal of pharmaceutical sciences.

[58]  W. Vogt Oxidation of methionyl residues in proteins: tools, targets, and reversal. , 1995, Free radical biology & medicine.

[59]  Zuben E. Sauna,et al.  Recent advances in (therapeutic protein) drug development , 2017, F1000Research.

[60]  A. Ghaffari,et al.  Performance comparison of neural network training algorithms in modeling of bimodal drug delivery. , 2006, International journal of pharmaceutics.

[61]  D. Manallack,et al.  Statistics using neural networks: chance effects. , 1993, Journal of medicinal chemistry.