Convergence in parameters and predictions using computational experimental design

Typically, biological models fitted to experimental data suffer from significant parameter uncertainty, which can lead to inaccurate or uncertain predictions. One school of thought holds that accurate estimation of the true parameters of a biological system is inherently problematic. Recent work, however, suggests that optimal experimental design techniques can select sets of experiments whose members probe complementary aspects of a biochemical network that together can account for its full behaviour. Here, we implemented an experimental design approach for selecting sets of experiments that constrain parameter uncertainty. We demonstrated with a model of the epidermal growth factor–nerve growth factor pathway that, after synthetically performing a handful of optimal experiments, the uncertainty in all 48 parameters converged below 10 per cent. Furthermore, the fitted parameters converged to their true values with a small error consistent with the residual uncertainty. When untested experimental conditions were simulated with the fitted models, the predicted species concentrations converged to their true values with errors that were consistent with the residual uncertainty. This paper suggests that accurate parameter estimation is achievable with complementary experiments specifically designed for the task, and that the resulting parametrized models are capable of accurate predictions.

[1]  D. Lauffenburger,et al.  Input–output behavior of ErbB signaling pathways as revealed by a mass action model trained against dynamic data , 2009, Molecular systems biology.

[2]  J. Sethna,et al.  Comment on "Sloppy models, parameter uncertainty, and the role of experimental design". , 2011, Molecular bioSystems.

[3]  K. S. Brown,et al.  Optimal experimental design in an epidermal growth factor receptor signalling and down-regulation model. , 2007, IET systems biology.

[4]  Anand R Asthagiri,et al.  Resistance to signal activation governs design features of the MAP kinase signaling module , 2004, Biotechnology and bioengineering.

[5]  Eric Walter,et al.  Identification of Parametric Models: from Experimental Data , 1997 .

[6]  David R. Gilbert,et al.  Computational modelling of cancerous mutations in the EGFR/ERK signalling pathway , 2009, BMC Systems Biology.

[7]  Melanie I. Stefan,et al.  BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models , 2010, BMC Systems Biology.

[8]  Ursula Klingmüller,et al.  Simulation Methods for Optimal Experimental Design in Systems Biology , 2003, Simul..

[9]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[10]  Peter K. Sorger,et al.  Logic-Based Models for the Analysis of Cell Signaling Networks† , 2010, Biochemistry.

[11]  G. Verghese,et al.  Mass fluctuation kinetics: capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations. , 2007, The Journal of chemical physics.

[12]  K. H. Lee,et al.  The statistical mechanics of complex signaling networks: nerve growth factor signaling , 2004, Physical biology.

[13]  Robert J. Flassig,et al.  Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks , 2012, Bioinform..

[14]  Tianhui Hu,et al.  Convergence between Wnt-β-catenin and EGFR signaling in cancer , 2010, Molecular Cancer.

[15]  Kwang-Hyun Cho,et al.  Optimal sampling time selection for parameter estimation in dynamic pathway modeling. , 2004, Bio Systems.

[16]  Bruce Tidor,et al.  Reply to Comment on "Sloppy models, parameter uncertainty, and the role of experimental design" , 2011, Molecular bioSystems.

[17]  Priscilla E. M. Purnick,et al.  The second wave of synthetic biology: from modules to systems , 2009, Nature Reviews Molecular Cell Biology.

[18]  Ahmad S. Khalil,et al.  Synthetic biology: applications come of age , 2010, Nature Reviews Genetics.

[19]  E. Gilles,et al.  Computational modeling of the dynamics of the MAP kinase cascade activated by surface and internalized EGF receptors , 2002, Nature Biotechnology.

[20]  Shinya Kuroda,et al.  Prediction and validation of the distinct dynamics of transient and sustained ERK activation , 2005, Nature Cell Biology.

[21]  Michael P. H. Stumpf,et al.  Maximizing the Information Content of Experiments in Systems Biology , 2013, PLoS Comput. Biol..

[22]  Masaru Tomita,et al.  Sustained MAPK activation is dependent on continual NGF receptor regeneration , 2004, Development, growth & differentiation.

[23]  A. Gormand,et al.  Computational modelling reveals feedback redundancy within the epidermal growth factor receptor/extracellular-signal regulated kinase signalling pathway. , 2008, IET systems biology.

[24]  D. Fell,et al.  Differential feedback regulation of the MAPK cascade underlies the quantitative differences in EGF and NGF signalling in PC12 cells , 2000, FEBS letters.

[25]  Christopher A. Voigt,et al.  Programming cells: towards an automated 'Genetic Compiler'. , 2010, Current opinion in biotechnology.

[26]  Bruce Tidor,et al.  Sloppy models, parameter uncertainty, and the role of experimental design. , 2010, Molecular bioSystems.

[27]  Sebastian J Maerkl,et al.  Integration column: Microfluidic high-throughput screening. , 2009, Integrative biology : quantitative biosciences from nano to macro.

[28]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[29]  R. Heinrich,et al.  Control of MAPK signalling: from complexity to what really matters , 2005, Oncogene.

[30]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[31]  Michael P H Stumpf,et al.  Sensitivity, robustness, and identifiability in stochastic chemical kinetics models , 2011, Proceedings of the National Academy of Sciences.

[32]  A. Yoshimura,et al.  Model analysis of difference between EGF pathway and FGF pathway. , 2004, Biochemical and biophysical research communications.

[33]  D. Endy Foundations for engineering biology , 2005, Nature.

[34]  X. Huan,et al.  GRADIENT-BASED STOCHASTIC OPTIMIZATION METHODS IN BAYESIAN EXPERIMENTAL DESIGN , 2012, 1212.2228.

[35]  Vincent Danos,et al.  Rule-Based Modelling of Cellular Signalling , 2007, CONCUR.

[36]  Qingming Luo,et al.  Mass spectrometry in systems biology: an overview. , 2008, Mass spectrometry reviews.

[37]  M. Hung,et al.  Nuclear EGFR signalling network in cancers: linking EGFR pathway to cell cycle progression, nitric oxide pathway and patient survival , 2006, British Journal of Cancer.

[38]  A. Bauer-Mehren,et al.  Pathway databases and tools for their exploitation: benefits, current limitations and challenges , 2009, Molecular systems biology.

[39]  Jeff Hasty,et al.  Overpowering the component problem , 2009, Nature Biotechnology.

[40]  Yosef Yarden,et al.  Feedback regulation of EGFR signalling: decision making by early and delayed loops , 2011, Nature Reviews Molecular Cell Biology.

[41]  W. S. Hlavacek,et al.  How to deal with large models? , 2009, Molecular systems biology.

[42]  Sandro Macchietto,et al.  Designing robust optimal dynamic experiments , 2002 .

[43]  D. Lauffenburger,et al.  Computational modeling of the EGF-receptor system: a paradigm for systems biology. , 2003, Trends in cell biology.

[44]  S. Skvortsov,et al.  Quantitative proteomics and phosphoproteomics reveal novel insights into complexity and dynamics of the EGFR signaling network , 2008, Proteomics.

[45]  M. Elowitz,et al.  Synthetic Biology: Integrated Gene Circuits , 2011, Science.