Multi-Objective Optimization of Experiments Using Curvature and Fisher Information Matrix

The bottleneck in creating dynamic models of biological networks and processes often lies in estimating unknown kinetic model parameters from experimental data. In this regard, experimental conditions have a strong influence on parameter identifiability and should therefore be optimized to give the maximum information for parameter estimation. Existing model-based design of experiment (MBDOE) methods commonly rely on the Fisher information matrix (FIM) for defining a metric of data informativeness. When the model behavior is highly nonlinear, FIM-based criteria may lead to suboptimal designs, as the FIM only accounts for the linear variation in the model outputs with respect to the parameters. In this work, we developed a multi-objective optimization (MOO) MBDOE, for which the model nonlinearity was taken into consideration through the use of curvature. The proposed MOO MBDOE involved maximizing data informativeness using a FIM-based metric and at the same time minimizing the model curvature. We demonstrated the advantages of the MOO MBDOE over existing FIM-based and other curvature-based MBDOEs in an application to the kinetic modeling of fed-batch fermentation of baker’s yeast.

[1]  Sandro Macchietto,et al.  Curvature-Based Methods for Designing Optimally Informative Experiments in Multiresponse Nonlinear Dynamic Situations , 2005 .

[2]  Peng Qiu,et al.  Optimal experiment selection for parameter estimation in biological differential equation models , 2012, BMC Bioinformatics.

[3]  Peng Qiu,et al.  Bridging Mechanistic and Phenomenological Models of Complex Biological Systems , 2015, PLoS Comput. Biol..

[4]  J. Banga,et al.  Reaction network realizations of rational biochemical systems and their structural properties , 2015, Journal of Mathematical Chemistry.

[5]  Kerstin Preuschoff,et al.  Optimizing Experimental Design for Comparing Models of Brain Function , 2011, PLoS Comput. Biol..

[6]  Gade Pandu Rangaiah,et al.  Multiobjective Framework for Model-based Design of Experiments to Improve Parameter Precision and Minimize Parameter Correlation , 2013 .

[7]  Sandro Macchietto,et al.  Novel anticorrelation criteria for design of experiments: Algorithm and application , 2008 .

[8]  J. Banga,et al.  Computational procedures for optimal experimental design in biological systems. , 2008, IET systems biology.

[9]  W. G. Cochran Experiments for Nonlinear Functions , 1973 .

[10]  Gene H. Golub,et al.  Rank-One Approximation to High Order Tensors , 2001, SIAM J. Matrix Anal. Appl..

[11]  K Bernaerts,et al.  Simultaneous versus sequential optimal experiment design for the identification of multi-parameter microbial growth kinetics as a function of temperature. , 2010, Journal of theoretical biology.

[12]  Sandro Macchietto,et al.  Model-based design of experiments for parameter precision: State of the art , 2008 .

[13]  Rudiyanto Gunawan,et al.  Ensemble Kinetic Modeling of Metabolic Networks from Dynamic Metabolic Profiles , 2012, Metabolites.

[14]  Peter A. J. Hilbers,et al.  A Bayesian approach to targeted experiment design , 2012, Bioinform..

[15]  Nicole Radde,et al.  Trajectory-oriented Bayesian experiment design versus Fisher A-optimal design: an in depth comparison study , 2012, Bioinform..

[16]  B. Bogacka,et al.  Comparison of Two Design Optimality Criteria Applied to a Nonlinear Model , 2004, Journal of biopharmaceutical statistics.

[17]  Mark K Transtrum,et al.  Model reduction by manifold boundaries. , 2014, Physical review letters.

[18]  Andrej Pázman,et al.  Nonlinear Regression , 2019, Handbook of Regression Analysis With Applications in R.

[19]  Gregery T. Buzzard,et al.  Efficient Optimization of Stimuli for Model-Based Design of Experiments to Resolve Dynamical Uncertainty , 2015, PLoS Comput. Biol..

[20]  Julio R. Banga,et al.  An evolutionary method for complex-process optimization , 2010, Comput. Oper. Res..

[21]  Paul D. W. Kirk,et al.  Model Selection in Systems Biology Depends on Experimental Design , 2014, PLoS Comput. Biol..

[22]  Eldad Haber,et al.  Experimental Design for Biological Systems , 2012, SIAM J. Control. Optim..

[23]  Thomas F. Edgar,et al.  PCA Combined Model-Based Design of Experiments (DOE) Criteria for Differential and Algebraic System Parameter Estimation , 2008 .

[24]  D. G. Watts,et al.  Relative Curvature Measures of Nonlinearity , 1980 .

[25]  Julio R. Banga,et al.  Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems , 2006, BMC Bioinformatics.

[26]  Ann E Rundell,et al.  Model‐based design of experiments for cellular processes , 2013, Wiley interdisciplinary reviews. Systems biology and medicine.

[27]  Ursula Klingmüller,et al.  Simulation Methods for Optimal Experimental Design in Systems Biology , 2003, Simul..

[28]  Yang Liu,et al.  REDEMPTION: reduced dimension ensemble modeling and parameter estimation , 2015, Bioinform..

[29]  Sandro Macchietto,et al.  Statistical tools for optimal dynamic model building , 2000 .

[30]  A. Emery,et al.  Optimal experiment design , 1998 .

[31]  Eric Walter,et al.  Qualitative and quantitative experiment design for phenomenological models - A survey , 1990, Autom..

[32]  J. Timmer,et al.  Systems biology: experimental design , 2009, The FEBS journal.

[33]  Julio R. Banga,et al.  Scatter search for chemical and bio-process optimization , 2007, J. Glob. Optim..

[34]  Gade Pandu Rangaiah,et al.  Multi-objective optimization : techniques and applications in chemical engineering , 2017 .

[35]  Sandro Macchietto,et al.  Validation of a Model for Biodiesel Production through Model-Based Experiment Design , 2007 .

[36]  Eberhard O. Voit,et al.  Biochemical Systems Theory: A Review , 2013 .

[37]  Andrew White,et al.  The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems , 2016, PLoS Comput. Biol..

[38]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[39]  Drew Endy,et al.  Stimulus Design for Model Selection and Validation in Cell Signaling , 2008, PLoS Comput. Biol..

[40]  Robert J. Flassig,et al.  Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks , 2012, Bioinform..

[41]  Juergen Hahn,et al.  Optimal Experimental Design for Parameter Estimation of an IL-6 Signaling Model , 2017 .

[42]  Michael P. H. Stumpf,et al.  Maximizing the Information Content of Experiments in Systems Biology , 2013, PLoS Comput. Biol..

[43]  Michel Tod,et al.  Impact of Pharmacokinetic–Pharmacodynamic Model Linearization on the Accuracy of Population Information Matrix and Optimal Design , 2001, Journal of Pharmacokinetics and Pharmacodynamics.

[44]  D. G. Watts,et al.  A Quadratic Design Criterion for Precise Estimation in Nonlinear Regression Models , 1985 .

[45]  Rudiyanto Gunawan,et al.  Iterative approach to model identification of biological networks , 2005, BMC Bioinformatics.

[46]  Rudiyanto Gunawan,et al.  Parameter identifiability of power-law biochemical system models. , 2010, Journal of biotechnology.

[47]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[48]  Hua Wu,et al.  Parametric sensitivity in chemical systems , 1999 .

[49]  Ann E Rundell,et al.  A Global Parallel Model Based Design of Experiments Method to Minimize Model Output Uncertainty , 2011, Bulletin of Mathematical Biology.

[50]  I. Chou,et al.  Recent developments in parameter estimation and structure identification of biochemical and genomic systems. , 2009, Mathematical biosciences.

[51]  J. Banga,et al.  Structural Properties of Dynamic Systems Biology Models: Identifiability, Reachability, and Initial Conditions , 2017 .

[52]  Joachim M. Buhmann,et al.  Near-optimal experimental design for model selection in systems biology , 2013, Bioinform..