Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT, MAP kinase, and NF-κB signaling pathway models

BackgroundWhen creating mechanistic mathematical models for biological signaling processes it is tempting to include as many known biochemical interactions into one large model as possible. For the JAK-STAT, MAP kinase, and NF-κ B pathways a lot of biological insight is available, and as a consequence, large mathematical models have emerged. For large models the question arises whether unknown model parameters can uniquely be determined by parameter estimation from measured data. Systematic approaches to answering this question are indispensable since the uniqueness of model parameter values is essential for predictive mechanistic modeling.ResultsWe propose an eigenvalue based method for efficiently testing identifiability of large ordinary differential models and compare this approach to three existing ones. The methods are benchmarked by applying them to models of the signaling pathways mentioned above. In all cases the eigenvalue method proposed here and the orthogonal method find the largest set of identifiable parameters, thus clearly outperforming the other approaches. The identifiability analysis shows that the pathway models are not identifiable, even under the strong assumption that all system state variables are measurable. We demonstrate how the results of the identifiability analysis can be used for model simplification.ConclusionWhile it has undoubtedly contributed to recent advances in systems biology, mechanistic modeling by itself does not guarantee unambiguous descriptions of biological processes. We show that some recent signal transduction pathway models have reached a level of detail that is not warranted. Rigorous identifiability tests reveal that even if highly idealized experiments could be carried out to measure all state variables of these signaling pathways, some unknown parameters could still not be estimated. The identifiability tests therefore show that the level of detail of the investigated models is too high in principle, not just because too little experimental information is available. We demonstrate how the proposed method can be combined with biological insight, however, to simplify these models.

[1]  J A Jacquez,et al.  Parameter estimation: local identifiability of parameters. , 1990, The American journal of physiology.

[2]  K. Glover,et al.  Identifiability of linear and nonlinear dynamical systems , 1976 .

[3]  Xiaohua Xia,et al.  IDENTIFIABILITY OF HIV/AIDS MODELS , 2005 .

[4]  Eric Walter,et al.  Identifiability of parametric models , 1987 .

[5]  Satoru Shiono,et al.  Control mechanism of JAK/STAT signal transduction pathway , 2003, FEBS letters.

[6]  Eric Walter,et al.  Identification of Parametric Models: from Experimental Data , 1997 .

[7]  Eric Walter,et al.  Guaranteed Numerical Computation as an Alternative to Computer Algebra for Testing Models for Identifiability , 2003, Numerical Software with Result Verification.

[8]  Jens Timmer,et al.  Data-based identifiability analysis of non-linear dynamical models , 2007, Bioinform..

[9]  Sandro Macchietto,et al.  Designing robust optimal dynamic experiments , 2002 .

[10]  Bernard Hanzon,et al.  Identifiability of homogeneous systems using the state isomorphism approach , 2005, Autom..

[11]  Marek Kimmel,et al.  Mathematical model of NF-kappaB regulatory module. , 2004, Journal of theoretical biology.

[12]  Dennis G. Zill,et al.  Advanced Engineering Mathematics , 2021, Technometrics.

[13]  Sandro Macchietto,et al.  Statistical tools for optimal dynamic model building , 2000 .

[14]  Hong Wang,et al.  Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-kappaB signalling pathway. , 2006, Molecular bioSystems.

[15]  K R Godfrey,et al.  Structural identifiability of the parameters of a nonlinear batch reactor model. , 1992, Mathematical biosciences.

[16]  Klaus Schittkowski,et al.  Experimental Design Tools for Ordinary and Algebraic Differential Equations , 2007 .

[17]  Shengtai Li,et al.  Design of new Daspk for Sensitivity Analysis , 1999 .

[18]  Claudio Cobelli,et al.  Global identifiability of nonlinear models of biological systems , 2001, IEEE Transactions on Biomedical Engineering.

[19]  J. Jacquez,et al.  Numerical parameter identifiability and estimability: Integrating identifiability, estimability, and optimal sampling design , 1985 .

[20]  Marek Kimmel,et al.  Mathematical model of NF- κB regulatory module , 2004 .

[21]  Ralf Takors,et al.  Sensitivity analysis for the reduction of complex metabolism models , 2004 .

[22]  David W. Bacon,et al.  Modeling Ethylene/Butene Copolymerization with Multi‐site Catalysts: Parameter Estimability and Experimental Design , 2003 .

[23]  K. Sneppen,et al.  Minimal model of spiky oscillations in NF-κB signaling , 2006 .

[24]  Haihong Zhu,et al.  Parameter Identifiability and Estimation of HIV/AIDS Dynamic Models , 2008, Bulletin of mathematical biology.

[25]  E. Gilles,et al.  Computational modeling of the dynamics of the MAP kinase cascade activated by surface and internalized EGF receptors , 2002, Nature Biotechnology.

[26]  H. Rabitz,et al.  State isomorphism approach to global identifiability of nonlinear systems , 1989 .

[27]  H. Künsch,et al.  Practical identifiability analysis of large environmental simulation models , 2001 .

[28]  Xiaohua Xia,et al.  Identifiability of nonlinear systems with application to HIV/AIDS models , 2003, IEEE Trans. Autom. Control..

[29]  Lennart Ljung,et al.  On global identifiability for arbitrary model parametrizations , 1994, Autom..

[30]  Daniel E. Zak,et al.  Importance of input perturbations and stochastic gene expression in the reverse engineering of genetic regulatory networks: insights from an identifiability analysis of an in silico network. , 2003, Genome research.

[31]  James V. Beck,et al.  Parameter Estimation in Engineering and Science , 1977 .

[32]  J. Timmer,et al.  Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Kim Sneppen,et al.  Minimal model of spiky oscillations in NF-kappaB signaling. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[34]  D. Gross,et al.  Heterogeneity of epidermal growth factor binding kinetics on individual cells. , 1997, Biophysical journal.

[35]  Rudiyanto Gunawan,et al.  Iterative approach to model identification of biological networks , 2005, BMC Bioinformatics.

[36]  G. Strang Introduction to Linear Algebra , 1993 .

[37]  J. Boonstra,et al.  Three classes of epidermal growth factor receptors on HeLa cells. , 1991, The Journal of biological chemistry.

[38]  Juergen Hahn,et al.  Parameter Set Selection via Clustering of Parameters into Pairwise Indistinguishable Groups of Parameters , 2009 .

[39]  H. Pohjanpalo System identifiability based on the power series expansion of the solution , 1978 .

[40]  Maria Rodriguez-Fernandez,et al.  A hybrid approach for efficient and robust parameter estimation in biochemical pathways. , 2006, Bio Systems.

[41]  Eric Walter,et al.  QUALITATIVE AND QUANTITATIVE IDENTIFIABILITY ANALYSIS OF NONLINEAR CHEMICAL KINETIC MODELS , 1989 .

[42]  P. Heinrich,et al.  Principles of interleukin (IL)-6-type cytokine signalling and its regulation. , 2003, The Biochemical journal.

[43]  Hulin Wu,et al.  Deterministic And Stochastic Models Of Aids Epidemics And Hiv Infections With Intervention , 2005 .

[44]  F. W. Kellaway,et al.  Advanced Engineering Mathematics , 1969, The Mathematical Gazette.