Interpretable biomanufacturing process risk and sensitivity analyses for quality‐by‐design and stability control

While biomanufacturing plays a significant role in supporting the economy and ensuring public health, it faces critical challenges, including complexity, high variability, lengthy lead time, and very limited process data, especially for personalized new cell and gene biotherapeutics. Driven by these challenges, we propose an interpretable semantic bioprocess probabilistic knowledge graph and develop a game theory based risk and sensitivity analyses for production process to facilitate quality‐by‐design and stability control. Specifically, by exploring the causal relationships and interactions of critical process parameters and product quality attributes, we create a Bayesian network based probabilistic knowledge graph characterizing the complex causal interdependencies of all factors. Then, we introduce a Shapley value based sensitivity analysis, which can correctly quantify the variation contribution from each input factor on the outputs (i.e., productivity, product quality). Since the bioprocess model coefficients are learned from limited process observations, we derive the Bayesian posterior distribution to quantify model uncertainty and further develop the Shapley value based sensitivity analysis to evaluate the impact of estimation uncertainty from each set of model coefficients. Therefore, the proposed bioprocess risk and sensitivity analyses can identify the bottlenecks, guide the reliable process specifications and the most informative data collection, and improve production stability.

[1]  L. Shapley A Value for n-person Games , 1988 .

[2]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[3]  Jon C. Helton,et al.  Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal , 1993 .

[4]  Pauline M. Doran,et al.  Bioprocess Engineering Principles , 1995 .

[5]  Harvey M. Wagner,et al.  Global Sensitivity Analysis , 1995, Oper. Res..

[6]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[7]  Enrique F. Castillo,et al.  Sensitivity analysis in discrete Bayesian networks , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[8]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[9]  A. Owen,et al.  A Bayesian framework for combining heterogeneous data sources for gene function prediction (in Saccharomyces cerevisiae) , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Guidance for Industry PAT — A Framework for Innovative Pharmaceutical Development , Manufacturing , and Quality Assurance , 2004 .

[11]  Yuhong Zhou,et al.  A decisional-support tool to model the impact of regulatory compliance activities in the biomanufacturing industry , 2004, Comput. Chem. Eng..

[12]  Yunfeng Li,et al.  Prediction of Key State Variables using Support Vector Machines in Bioprocesses , 2006 .

[13]  Matthew C Coleman,et al.  Retrospective optimization of time‐dependent fermentation control strategies using time‐independent historical data , 2006, Biotechnology and bioengineering.

[14]  Silja Renooij,et al.  Sensitivity Analysis of Probabilistic Networks , 2007 .

[15]  G. Walsh Pharmaceutical Biotechnology: Concepts and Applications , 2007 .

[16]  L. Papageorgiou,et al.  Multiobjective Long‐Term Planning of Biopharmaceutical Manufacturing Facilities , 2007, Biotechnology progress.

[17]  J. Engelbrecht,et al.  Acetone to MIBK process optimization through multidisciplinary chemometrics and in-line NIR spectroscopy , 2008 .

[18]  Xiaobo Zhou,et al.  Global Sensitivity Analysis , 2017, Encyclopedia of GIS.

[19]  Daniel Gómez,et al.  Polynomial calculation of the Shapley value based on sampling , 2009, Comput. Oper. Res..

[20]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[21]  L. Stragevitch,et al.  Prediction of properties of diesel/biodiesel blends by infrared spectroscopy and multivariate calibration , 2010 .

[22]  A S Rathore,et al.  Process analytical technology (PAT) for biopharmaceutical products , 2010, Analytical and bioanalytical chemistry.

[23]  Z Zi,et al.  Sensitivity analysis approaches applied to systems biology models. , 2011, IET systems biology.

[24]  Yao Zhao,et al.  Planning for demand failure: A dynamic lot size model for clinical trial supply chains , 2011, Eur. J. Oper. Res..

[25]  C. Herwig,et al.  Efficient feeding profile optimization for recombinant protein production using physiological information , 2012, Bioprocess and Biosystems Engineering.

[26]  Chouaib Chakour,et al.  New Adaptive Moving Window PCA for Process Monitoring , 2012 .

[27]  Heikki Huttunen,et al.  Bioprocess data mining using regularized regression and random forests , 2013, BMC Systems Biology.

[28]  Marie-Lise Moullec,et al.  Toward System Architecture Generation and Performances Assessment Under Uncertainty Using Bayesian Networks , 2013 .

[29]  Minqiang Li,et al.  A security risk analysis model for information systems: Causal relationships of risk factors and vulnerability propagation analysis , 2014, Inf. Sci..

[30]  Jun Yang,et al.  Generalized moment-independent importance measures based on Minkowski distance , 2014, Eur. J. Oper. Res..

[31]  Cassandra Telenko,et al.  Probabilistic Graphical Modeling of Use Stage Energy Consumption: A Lightweight Vehicle Example , 2014 .

[32]  Eric S. Langer,et al.  Single‐use technologies in biopharmaceutical manufacturing: A 10‐year review of trends and the future , 2014 .

[33]  Art B. Owen,et al.  Sobol' Indices and Shapley Value , 2014, SIAM/ASA J. Uncertain. Quantification.

[34]  Ulf Schrader,et al.  From Science to Operations Questions , Choices and Strategies for Success in Biopharma , 2014 .

[35]  Zuo-Jun Max Shen,et al.  An automated planning engine for biopharmaceutical production , 2014, Eur. J. Oper. Res..

[36]  Solomon Tesfamariam,et al.  Evaluating risk of water mains failure using a Bayesian belief network model , 2015, Eur. J. Oper. Res..

[37]  Niranjan S. Kulkarni A modular approach for modeling active pharmaceutical ingredient manufacturing plant: A case study , 2015, 2015 Winter Simulation Conference (WSC).

[38]  Philip M. Kaminsky,et al.  Analytical models for biopharmaceutical operations and supply chain management: a survey of research literature , 2015 .

[39]  Richard D. Braatz,et al.  Elastic net with Monte Carlo sampling for data-based modeling in biopharmaceutical manufacturing facilities , 2015, Comput. Chem. Eng..

[40]  Barry L. Nelson,et al.  Shapley Effects for Global Sensitivity Analysis: Theory and Computation , 2016, SIAM/ASA J. Uncertain. Quantification.

[41]  Ananth Krishnamurthy,et al.  Optimal condition-based harvesting policies for biomanufacturing operations with failure risks , 2016 .

[42]  Emanuele Borgonovo,et al.  Sensitivity analysis: A review of recent advances , 2016, Eur. J. Oper. Res..

[43]  René Holm,et al.  Q8(R2): Pharmaceutical Development , 2017 .

[44]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[45]  Venkat Venkatasubramanian,et al.  Neural Network to Understand Process Capability and Process Intermediates Acceptance Criteria in Monoclonal Antibody Production Process , 2017, Journal of Pharmaceutical Innovation.

[46]  Kok Siong Ang,et al.  Kinetic Modeling of Mammalian Cell Culture Bioprocessing: The Quest to Advance Biomanufacturing , 2018, Biotechnology journal.

[47]  Richard D. Braatz,et al.  Sparse canonical variate analysis approach for process monitoring , 2018, Journal of Process Control.

[48]  Xun Xu,et al.  A Knowledge Management System to Support Design for Additive Manufacturing Using Bayesian Networks , 2018 .

[49]  Massimo Morbidelli,et al.  Sequential Multivariate Cell Culture Modeling at Multiple Scales Supports Systematic Shaping of a Monoclonal Antibody Toward a Quality Target. , 2018, Biotechnology journal.

[50]  Ananth Krishnamurthy,et al.  Performance Guarantees and Optimal Purification Decisions for Engineered Proteins , 2017, Oper. Res..

[51]  Christoph Herwig,et al.  Comparison of data science workflows for root cause analysis of bioprocesses , 2018, Bioprocess and Biosystems Engineering.

[52]  Manoj Kumar Tiwari,et al.  Bayesian network modelling for supply chain risk propagation , 2018, Int. J. Prod. Res..

[53]  Christoph Herwig,et al.  Data science tools and applications on the way to Pharma 4.0. , 2019, Drug discovery today.

[54]  Sarfaraz K. Niazi Pharmaceutical Development , 2019, Handbook of Pharmaceutical Manufacturing Formulations.

[55]  Ronald Rader,et al.  Single‐Use Technologies in Biopharmaceutical Manufacturing , 2019 .

[56]  Ananth Krishnamurthy,et al.  Managing Trade-offs in Protein Manufacturing: How Much to Waste? , 2020, Manuf. Serv. Oper. Manag..