Efficient Characterization of Parametric Uncertainty of Complex (Bio)chemical Networks

Parametric uncertainty is a particularly challenging and relevant aspect of systems analysis in domains such as systems biology where, both for inference and for assessing prediction uncertainties, it is essential to characterize the system behavior globally in the parameter space. However, current methods based on local approximations or on Monte-Carlo sampling cope only insufficiently with high-dimensional parameter spaces associated with complex network models. Here, we propose an alternative deterministic methodology that relies on sparse polynomial approximations. We propose a deterministic computational interpolation scheme which identifies most significant expansion coefficients adaptively. We present its performance in kinetic model equations from computational systems biology with several hundred parameters and state variables, leading to numerical approximations of the parametric solution on the entire parameter space. The scheme is based on adaptive Smolyak interpolation of the parametric solution at judiciously and adaptively chosen points in parameter space. As Monte-Carlo sampling, it is “non-intrusive” and well-suited for massively parallel implementation, but affords higher convergence rates. This opens up new avenues for large-scale dynamic network analysis by enabling scaling for many applications, including parameter estimation, uncertainty quantification, and systems design.

[1]  Christoph Schwab,et al.  Sparse, adaptive Smolyak quadratures for Bayesian inverse problems , 2013 .

[2]  Henryk Wozniakowski,et al.  Explicit Cost Bounds of Algorithms for Multivariate Tensor Product Problems , 1995, J. Complex..

[3]  William W. Chen,et al.  Classic and contemporary approaches to modeling biochemical reactions. , 2010, Genes & development.

[4]  Pedro Gonnet,et al.  A specialized ODE integrator for the efficient computation of parameter sensitivities , 2012, BMC Systems Biology.

[5]  E. Querfurth,et al.  In vivo investigations of glucose transport in Saccharomyces cerevisiae , 2000, Biotechnology and bioengineering.

[6]  Darren J. Wilkinson,et al.  Bayesian methods in bioinformatics and computational systems biology , 2006, Briefings Bioinform..

[7]  C. Schwab,et al.  Sparse Adaptive Approximation of High Dimensional Parametric Initial Value Problems , 2013 .

[8]  J. Sethna,et al.  Parameter Space Compression Underlies Emergent Theories and Predictive Models , 2013, Science.

[9]  Jonathan R. Karr,et al.  A Whole-Cell Computational Model Predicts Phenotype from Genotype , 2012, Cell.

[10]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[11]  Mikael Sunnåker,et al.  Zooming of states and parameters using a lumping approach including back-translation , 2010, BMC Systems Biology.

[12]  M. Girolami,et al.  Inferring signaling pathway topologies from multiple perturbation measurements of specific biochemical species. , 2010, Science signaling.

[13]  Christoph Schwab,et al.  Binned Multilevel Monte Carlo for Bayesian Inverse Problems with Large Data , 2016 .

[14]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[15]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[16]  M. Girolami,et al.  Inferring Signaling Pathway Topologies from Multiple Perturbation Measurements of Specific Biochemical Species , 2010, Science Signaling.

[17]  Albert Cohen,et al.  Breaking the curse of dimensionality in sparse polynomial approximation of parametric PDEs , 2015 .

[18]  E. Klipp,et al.  Biochemical networks with uncertain parameters. , 2005, Systems biology.

[19]  L. Råde,et al.  Mathematics handbook for science and engineering , 1995 .

[20]  C. Schwab,et al.  Sparsity in Bayesian inversion of parametric operator equations , 2014 .

[21]  Barbara M. Bakker,et al.  Can yeast glycolysis be understood in terms of in vitro kinetics of the constituent enzymes? Testing biochemistry. , 2000, European journal of biochemistry.

[22]  Marc Hafner,et al.  Efficient characterization of high-dimensional parameter spaces for systems biology , 2011, BMC Systems Biology.

[23]  Christoph Schwab,et al.  Analytic regularity and nonlinear approximation of a class of parametric semilinear elliptic PDEs , 2013 .

[24]  U. Sauer,et al.  Systems biology of microbial metabolism. , 2010, Current opinion in microbiology.

[25]  Mark K Transtrum,et al.  Geometry of nonlinear least squares with applications to sloppy models and optimization. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Albert Cohen,et al.  High-Dimensional Adaptive Sparse Polynomial Interpolation and Applications to Parametric PDEs , 2013, Foundations of Computational Mathematics.

[27]  Jörg Raisch,et al.  Subnetwork analysis reveals dynamic features of complex (bio)chemical networks , 2007, Proceedings of the National Academy of Sciences.

[28]  Eva Balsa-Canto,et al.  Global optimization in systems biology: stochastic methods and their applications. , 2012, Advances in experimental medicine and biology.

[29]  D. Lauffenburger,et al.  Input–output behavior of ErbB signaling pathways as revealed by a mass action model trained against dynamic data , 2009, Molecular systems biology.

[30]  B. Kholodenko,et al.  Quantification of Short Term Signaling by the Epidermal Growth Factor Receptor* , 1999, The Journal of Biological Chemistry.

[31]  A. M. Stuart,et al.  Sparse deterministic approximation of Bayesian inverse problems , 2011, 1103.4522.

[32]  D. Gillespie,et al.  Deterministic limit of stochastic chemical kinetics. , 2009, The journal of physical chemistry. B.

[33]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[34]  Filip Rolland,et al.  Glucose-sensing and -signalling mechanisms in yeast. , 2002, FEMS yeast research.

[35]  Dan S. Tawfik,et al.  The moderately efficient enzyme: evolutionary and physicochemical trends shaping enzyme parameters. , 2011, Biochemistry.

[36]  Christoph Schwab,et al.  Sparse Approximation Algorithms for High Dimensional Parametric Initial Value Problems , 2012, HPSC.

[37]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[38]  Melanie I. Stefan,et al.  BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models , 2010, BMC Systems Biology.