Good modeling practice for PAT applications: Propagation of input uncertainty and sensitivity analysis

The uncertainty and sensitivity analysis are evaluated for their usefulness as part of the model‐building within Process Analytical Technology applications. A mechanistic model describing a batch cultivation of Streptomyces coelicolor for antibiotic production was used as case study. The input uncertainty resulting from assumptions of the model was propagated using the Monte Carlo procedure to estimate the output uncertainty. The results showed that significant uncertainty exists in the model outputs. Moreover the uncertainty in the biomass, glucose, ammonium and base‐consumption were found low compared to the large uncertainty observed in the antibiotic and off‐gas CO2 predictions. The output uncertainty was observed to be lower during the exponential growth phase, while higher in the stationary and death phases ‐ meaning the model describes some periods better than others. To understand which input parameters are responsible for the output uncertainty, three sensitivity methods (Standardized Regression Coefficients, Morris and differential analysis) were evaluated and compared. The results from these methods were mostly in agreement with each other and revealed that only few parameters (about 10) out of a total 56 were mainly responsible for the output uncertainty. Among these significant parameters, one finds parameters related to fermentation characteristics such as biomass metabolism, chemical equilibria and mass‐transfer. Overall the uncertainty and sensitivity analysis are found promising for helping to build reliable mechanistic models and to interpret the model outputs properly. These tools make part of good modeling practice, which can contribute to successful PAT applications for increased process understanding, operation and control purposes. © 2009 American Institute of Chemical Engineers Biotechnol. Prog., 2009

[1]  R. Iman,et al.  A distribution-free approach to inducing rank correlation among input variables , 1982 .

[2]  A. Holmberg On the practical identifiability of microbial growth models incorporating Michaelis-Menten type nonlinearities , 1982 .

[3]  A A Esener,et al.  Theory and applications of unstructured growth models: Kinetic and energetic aspects , 1983, Biotechnology and bioengineering.

[4]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[5]  Matthias Reuss,et al.  Optimal Experimental Design for Parameter Estimation in Unstructured Growth Models , 1994 .

[6]  J. D. Morrison,et al.  Evaluating prediction uncertainty in simulation models , 1999 .

[7]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[8]  C. Hewitt,et al.  Physiological responses to mixing in large scale bioreactors. , 2001, Journal of biotechnology.

[9]  Jon C. Helton,et al.  Latin Hypercube Sampling and the Propagation of Uncertainty in Analyses of Complex Systems , 2002 .

[10]  Peter Reichert,et al.  Practical identifiability of ASM2d parameters--systematic selection and tuning of parameter subsets. , 2002, Water research.

[11]  L. Vining,et al.  Nutritional control of actinorhodin production byStreptomyces coelicolor A3(2): suppressive effects of nitrogen and phosphate , 2004, Applied Microbiology and Biotechnology.

[12]  Stefano Tarantola,et al.  Sensitivity analysis practices: Strategies for model-based inference , 2006, Reliab. Eng. Syst. Saf..

[13]  Bas Teusink,et al.  Modelling strategies for the industrial exploitation of lactic acid bacteria , 2006, Nature Reviews Microbiology.

[14]  Eyal Dassau,et al.  Combining Six-Sigma with Integrated Design and Control for Yield Enhancement in Bioprocessing , 2006 .

[15]  Matti Leisola,et al.  Modeling and simulation of Streptomyces peucetius var. caesius N47 cultivation and ɛ-rhodomycinone production with kinetic equations and neural networks , 2006 .

[16]  Henry Y. Wang,et al.  Bioprocess monitoring and computer control: Key roots of the current PAT initiative , 2006, Biotechnology and bioengineering.

[17]  A. Saltelli,et al.  The role of sensitivity analysis in ecological modelling , 2007 .

[18]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[19]  Ingrid Maes,et al.  The need for a broader perspective if process analytical technology implementation is to be successful in the pharmaceutical sector , 2007, Journal of Pharmaceutical Innovation.

[20]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[21]  Tanmay Basak,et al.  Modeling of enzyme production kinetics , 2007, Applied Microbiology and Biotechnology.

[22]  Gürkan Sin,et al.  Matrix notation for efficient development of first‐principles models within PAT applications: Integrated modeling of antibiotic production with Streptomyces coelicolor , 2008, Biotechnology and bioengineering.

[23]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.