On the Origins and Rarity of Locally but Not Globally Identifiable Parameters in Biological Modeling

Structural identifiability determines the possibility of estimating the parameters of a model by observing its output in an ideal experiment. If a parameter is structurally locally identifiable, but not globally (SLING), its true value cannot be uniquely inferred because several equivalent solutions exist. In biological modeling it is sometimes assumed that local identifiability entails global identifiability, which is convenient because local identifiability tests are typically less computationally demanding than global tests. However, this assumption has never been investigated beyond demonstrating the existence of counter-examples. To clarify this matter, in this paper we began by asking how often a structurally locally identifiable parameter is not globally identifiable in systems biology. To answer this question empirically we assembled a collection of 102 mathematical models from the literature, with a total of 763 parameters. We analysed their identifiability, determining that approximately 5% of the parameters are SLING. Next we investigated how the SLING parameters arise, tracing their origin to particular features of the model equations. Finally, we investigated the possibility of obtaining false estimates. Some of the solutions that are mathematically equivalent to the true one involved parameters and/or initial conditions with negative values, which are not biologically meaningful. In other cases the true solution and the equivalent one were in the same range. These results provide insight about a previously unexplored hypothesis, and suggest that in most (albeit not all) systems biology applications it suffices to test for structural local identifiability.

[1]  A. F. Villaverde,et al.  Benchmarking tools for a priori identifiability analysis , 2022, Bioinform..

[2]  Heather A. Harrington,et al.  Differential Elimination for Dynamical Models via Projections with Applications to Structural Identifiability , 2021, SIAM J. Appl. Algebra Geom..

[3]  C. Remien,et al.  Structural identifiability of the generalized Lotka–Volterra model for microbiome studies , 2021, Royal Society Open Science.

[4]  Gleb Pogudin,et al.  Web-based Structural Identifiability Analyzer , 2021, CMSB.

[5]  J. Hasenauer,et al.  A protocol for dynamic model calibration , 2021, Briefings Bioinform..

[6]  Jens Timmer,et al.  On structural and practical identifiability , 2021, 2102.05100.

[7]  J. Banga,et al.  Structural identifiability and observability of compartmental models of the COVID-19 pandemic , 2020, Annual Reviews in Control.

[8]  Vito Latora,et al.  Lack of practical identifiability may hamper reliable predictions in COVID-19 epidemic models , 2020, Science advances.

[9]  Andrew J. Whalen,et al.  Identifiability of infection model parameters early in an epidemic , 2020, medRxiv.

[10]  Y. Wardi,et al.  Optimizing the Timing and Composition of Therapeutic Phage Cocktails: A Control-Theoretic Approach , 2020, Bulletin of Mathematical Biology.

[11]  Eran Halperin,et al.  Compositional Lotka-Volterra describes microbial dynamics in the simplex , 2020, PLoS Comput. Biol..

[12]  M. Kuddus,et al.  Modelling the Transmission Dynamics of COVID-19 in Six High-Burden Countries , 2020, medRxiv.

[13]  Gabriel Obed Fosu,et al.  Construction of Compartmental Models for COVID-19 with Quarantine, Lockdown and Vaccine Interventions , 2020 .

[14]  Wenjie Zheng,et al.  Total Variation Regularization for Compartmental Epidemic Models with Time-varying Dynamics , 2020, ArXiv.

[15]  Reza Sameni,et al.  Mathematical Modeling of Epidemic Diseases; A Case Study of the COVID-19 Coronavirus , 2020, 2003.11371.

[16]  Michael Y. Li,et al.  Why is it difficult to accurately predict the COVID-19 epidemic? , 2020, Infectious Disease Modelling.

[17]  G. Gaeta A simple SIR model with a large set of asymptomatic infectives , 2020, Mathematics in Engineering.

[18]  G. F. Calvo,et al.  CAR T cell therapy in B-cell acute lymphoblastic leukaemia: Insights from mathematical models , 2020, medRxiv.

[19]  Ying Liu,et al.  Research about the optimal strategies for prevention and control of varicella outbreak in a school in a central city of China: based on an SEIR dynamic model , 2020, Epidemiology and Infection.

[20]  Geert Lombaert,et al.  Observability of nonlinear systems with unmeasured inputs , 2019, Mechanical Systems and Signal Processing.

[21]  James D. Brunner,et al.  Metabolite-mediated modelling of microbial community dynamics captures emergent behaviour more effectively than species–species modelling , 2019, Journal of the Royal Society Interface.

[22]  Maria Pia Saccomani,et al.  Calculating all multiple parameter solutions of ODE models to avoid biological misinterpretations. , 2019, Mathematical biosciences and engineering : MBE.

[23]  Julio R. Banga,et al.  SUPPLEMENTARY FILE: Full observability and estimation of unknown inputs, states, and parameters of nonlinear biological models , 2019 .

[24]  S. Jang,et al.  Modeling Pancreatic Cancer Dynamics with Immunotherapy , 2019, Bulletin of Mathematical Biology.

[25]  Gerardo Chowell,et al.  Assessing parameter identifiability in compartmental dynamic models using a computational approach: application to infectious disease transmission models , 2019, Theoretical Biology and Medical Modelling.

[26]  Chee-Keng Yap,et al.  SIAN: software for structural identifiability analysis of ODE models , 2018, Bioinform..

[27]  S. Bonhoeffer,et al.  Cancer-induced immunosuppression can enable effectiveness of immunotherapy through bistability generation: A mathematical and computational examination , 2018, bioRxiv.

[28]  Necibe Tuncer,et al.  Structural and practical identifiability analysis of outbreak models. , 2018, Mathematical biosciences.

[29]  Gleb Pogudin,et al.  Global Identifiability of Differential Models , 2018, Communications on Pure and Applied Mathematics.

[30]  Marisa C Eisenberg,et al.  A confidence building exercise in data and identifiability: Modeling cancer chemotherapy as a case study. , 2017, Journal of theoretical biology.

[31]  Carsten Conradi,et al.  Dynamics of Posttranslational Modification Systems: Recent Progress and Future Directions. , 2017, Biophysical journal.

[32]  U. Alon,et al.  Dynamical compensation in physiological circuits , 2016 .

[33]  Jens Timmer,et al.  Enzymatic study on AtCCD4 and AtCCD7 and their potential to form acyclic regulatory metabolites , 2016, Journal of experimental botany.

[34]  Brad M. Ochocki,et al.  Model distinguishability and inference robustness in mechanisms of cholera transmission and loss of immunity. , 2016, Journal of theoretical biology.

[35]  Jens Timmer,et al.  Higher-order Lie symmetries in identifiability and predictability analysis of dynamic models. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Joseph J. DiStefano,et al.  Dynamic Systems Biology Modeling and Simulation , 2015 .

[37]  Nicolette Meshkat,et al.  On Finding and Using Identifiable Parameter Combinations in Nonlinear Dynamic Systems Biology Models and COMBOS: A Novel Web Implementation , 2014, PloS one.

[38]  Thomas S. Ligon,et al.  Single-cell mRNA transfection studies: delivery, kinetics and statistics by numbers. , 2014, Nanomedicine : nanotechnology, biology, and medicine.

[39]  Thomas R. B. Grandjean,et al.  Structural identifiability analyses of candidate models for in vitro Pitavastatin hepatic uptake , 2014, Comput. Methods Programs Biomed..

[40]  Suzanne L Robertson,et al.  Identifiability and estimation of multiple transmission pathways in cholera and waterborne disease. , 2013, Journal of theoretical biology.

[41]  Johan Karlsson,et al.  Minimal output sets for identifiability. , 2012, Mathematical biosciences.

[42]  D. Earn,et al.  Cholera Epidemic in Haiti, 2010: Using a Transmission Model to Explain Spatial Spread of Disease and Identify Optimal Control Interventions , 2011, Annals of Internal Medicine.

[43]  Andreas Kowarsch,et al.  Dynamic mathematical modeling of IL13-induced signaling in Hodgkin and primary mediastinal B-cell lymphoma allows prediction of therapeutic targets. , 2011, Cancer research.

[44]  Xiaohua Xia,et al.  On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics , 2011, SIAM Rev..

[45]  Pu Li,et al.  Just-in-time activation of a glycolysis inspired metabolic network - solution with a dynamic optimization approach , 2010 .

[46]  Hiroyuki Kubota,et al.  Decoupling of Receptor and Downstream Signals in the Akt Pathway by Its Low-Pass Filter Characteristics , 2010, Science Signaling.

[47]  Maria Pia Saccomani,et al.  Examples of testing global identifiability of biological and biomedical models with the DAISY software , 2010, Comput. Biol. Medicine.

[48]  L. G. de Pillis,et al.  OPTIMAL CONTROL OF MIXED IMMUNOTHERAPY AND CHEMOTHERAPY OF TUMORS , 2008 .

[49]  R C Boston,et al.  Kinetics of ruminal lipolysis of triacylglycerol and biohydrogenation of long-chain fatty acids: new insights from old data. , 2008, Journal of dairy science.

[50]  Maria Pia Saccomani,et al.  DAISY: A new software tool to test global identifiability of biological and physiological systems , 2007, Comput. Methods Programs Biomed..

[51]  Marek Kimmel,et al.  Mathematical model of NF- κB regulatory module , 2004 .

[52]  X. H. Xu,et al.  The kinetic model and simulation of blood coagulation--the kinetic influence of activated protein C. , 2004, Medical engineering & physics.

[53]  H. Hethcote,et al.  Effects of quarantine in six endemic models for infectious diseases. , 2002, Mathematical biosciences.

[54]  L. D'Angio,et al.  A new differential algebra algorithm to test identifiability of nonlinear systems with given initial conditions , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[55]  J. Carneiro,et al.  A mathematical analysis of TCR serial triggering and down‐regulation , 2000, European journal of immunology.

[56]  M. Nowak,et al.  Specific therapy regimes could lead to long-term immunological control of HIV. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Alan S. Perelson,et al.  Mathematical Analysis of HIV-1 Dynamics in Vivo , 1999, SIAM Rev..

[58]  P. Daoutidis,et al.  Control of nonlinear differential algebraic equation systems , 1999 .

[59]  Annette Oxenius,et al.  Formation of TCR dimers/trimers as a crucial step for T cell activation , 1998, European journal of immunology.

[60]  Eric Walter,et al.  Identification of Parametric Models: from Experimental Data , 1997 .

[61]  M J Chappell,et al.  Structural identifiability of models characterizing saturable binding: comparison of pseudo-steady-state and non-pseudo-steady-state model formulations. , 1996, Mathematical biosciences.

[62]  F. Milner,et al.  A mathematical model of epidemics with screening and variable infectivity , 1995 .

[63]  Lennart Ljung,et al.  On global identifiability for arbitrary model parametrizations , 1994, Autom..

[64]  C Cobelli,et al.  Hepatic glucose production during the labeled IVGTT: estimation by deconvolution with a new minimal model. , 1993, The American journal of physiology.

[65]  K R Godfrey,et al.  Structural identifiability of the parameters of a nonlinear batch reactor model. , 1992, Mathematical biosciences.

[66]  K R Godfrey,et al.  Global identifiability of the parameters of nonlinear systems with specified inputs: a comparison of methods. , 1990, Mathematical biosciences.

[67]  K R Godfrey,et al.  Effect of dose, molecular size, affinity, and protein binding on tumor uptake of antibody or ligand: a biomathematical model. , 1989, Cancer research.

[68]  H. Rabitz,et al.  Similarity transformation approach to identifiability analysis of nonlinear compartmental models. , 1989, Mathematical biosciences.

[69]  Herschel Rabitz,et al.  Identifiability and distinguishability of first-order reaction systems , 1988 .

[70]  Yves Lecourtier,et al.  A method to prove that nonlinear models can be unidentifiable , 1987, 26th IEEE Conference on Decision and Control.

[71]  S. Demignot,et al.  Effect of prosthetic sugar groups on the pharmacokinetics of glucose-oxidase. , 1987, Drug design and delivery.

[72]  J. Wagner,et al.  A nonlinear physiologic pharmacokinetic model: I. Steady-state , 1985, Journal of Pharmacokinetics and Biopharmaceutics.

[73]  J. P. Norton,et al.  An investigation of the sources of nonuniqueness in deterministic identifiability , 1982 .

[74]  T. Rothenberg Identification in Parametric Models , 1971 .

[75]  V. Bolie,et al.  Coefficients of normal blood glucose regulation. , 1961, Journal of applied physiology.

[76]  Ghislaine Joly-Blanchard,et al.  Identifiability and estimation of pharmacokinetic parameters for the ligands of the macrophage mannose receptor , 2005 .

[77]  Claudio Cobelli,et al.  Global identifiability of nonlinear models of biological systems , 2001, IEEE Transactions on Biomedical Engineering.

[78]  S. Vajda,et al.  IDENTIFIABILITY OF POLYNOMIAL SYSTEMS: STRUCTURAL AND NUMERICAL ASPECTS , 1987 .

[79]  A. Raksanyi Utilisation du calcul formel pour l'étude des systèmes d'équations polynomiales (applications en modélisation) , 1986 .

[80]  B. Goodwin Oscillatory behavior in enzymatic control processes. , 1965, Advances in enzyme regulation.

[81]  Modeling in Systems Biology 1.1 Introduction , 2022 .