On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics

Ordinary differential equations (ODE) are a powerful tool for modeling dynamic processes with wide applications in a variety of scientific fields. Over the last 2 decades, ODEs have also emerged as a prevailing tool in various biomedical research fields, especially in infectious disease modeling. In practice, it is important and necessary to determine unknown parameters in ODE models based on experimental data. Identifiability analysis is the first step in determing unknown parameters in ODE models and such analysis techniques for nonlinear ODE models are still under development. In this article, we review identifiability analysis methodologies for nonlinear ODE models developed in the past one to two decades, including structural identifiability analysis, practical identifiability analysis and sensitivity-based identifiability analysis. Some advanced topics and ongoing research are also briefly reviewed. Finally, some examples from modeling viral dynamics of HIV, influenza and hepatitis viruses are given to illustrate how to apply these identifiability analysis methods in practice.

[1]  D. Lauffenburger,et al.  Receptors: Models for Binding, Trafficking, and Signaling , 1993 .

[2]  Ghislaine Joly-Blanchard,et al.  An easy to check criterion for (un)indentifiability of uncontrolled systems and its applications , 2000, IEEE Trans. Autom. Control..

[3]  B. Frieden Science from Fisher Information , 2004 .

[4]  R. Vidal,et al.  Observability and identifiability of jump linear systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[5]  Eduardo Sontag On the Observability of Polynomial Systems, I: Finite-Time Problems , 1979 .

[6]  Mrdjan J. Jankovic,et al.  On Identifiability of Linear Time-Delay Systems , 2002 .

[7]  Julio R. Banga,et al.  Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems , 2006, BMC Bioinformatics.

[8]  Ghislaine Joly-Blanchard,et al.  Some effective approaches to check the identifiability of uncontrolled nonlinear systems , 2001 .

[9]  H. Knudsen,et al.  Comments on "controllability, observability and structural identifiability of multi input and multi output biological compartmental systems". , 1977, IEEE transactions on bio-medical engineering.

[10]  Hulin Wu,et al.  Parameter Estimation for Differential Equation Models Using a Framework of Measurement Error in Regression Models , 2008, Journal of the American Statistical Association.

[11]  A. Perelson,et al.  Kinetics of Influenza A Virus Infection in Humans , 2006, Journal of Virology.

[12]  David H. Anderson Compartmental Modeling and Tracer Kinetics , 1983 .

[13]  J. Ritt Partial differential algebra , 1950 .

[14]  J. Munkres Analysis On Manifolds , 1991 .

[15]  Y. Wong,et al.  Differentiable Manifolds , 2009 .

[16]  A. Isidori Nonlinear Control Systems , 1985 .

[17]  L. Ljung Convergence analysis of parametric identification methods , 1978 .

[18]  Ernst Hairer,et al.  Computing breaking points in implicit delay differential equations , 2008, Adv. Comput. Math..

[19]  R. Bellman,et al.  On structural identifiability , 1970 .

[20]  Carine Jauberthie,et al.  Identifiability of a nonlinear delayed-differential aerospace model , 2006, IEEE Transactions on Automatic Control.

[21]  H T Banks,et al.  A parameter sensitivity methodology in the context of HIV delay equation models , 2005, Journal of mathematical biology.

[22]  Claudio Cobelli,et al.  Identifiability of compartmental systems and related structural properties , 1979 .

[23]  Srinivas Aluru Handbook of Computational Molecular Biology (Chapman & All/Crc Computer and Information Science Series) , 2005 .

[24]  A. Perelson Modelling viral and immune system dynamics , 2002, Nature Reviews Immunology.

[25]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[26]  Yves Lecourtier,et al.  Identifiability and distinguishability testing via computer algebra , 1985 .

[27]  Hong Wang,et al.  Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-kappaB signalling pathway. , 2006, Molecular bioSystems.

[28]  Maria Pia Saccomani,et al.  Parameter identifiability of nonlinear systems: the role of initial conditions , 2003, Autom..

[29]  K R Godfrey,et al.  Structural identifiability of the parameters of a nonlinear batch reactor model. , 1992, Mathematical biosciences.

[30]  Klaus Schittkowski,et al.  Experimental Design Tools for Ordinary and Algebraic Differential Equations , 2007 .

[31]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[32]  Bud Mishra,et al.  Algorithmic Algebra , 1993, Texts and Monographs in Computer Science.

[33]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[34]  Lang Li,et al.  Estimation and Inference for a Spline‐Enhanced Population Pharmacokinetic Model , 2002, Biometrics.

[35]  E. Kolchin Differential Algebra and Algebraic Groups , 2012 .

[36]  J. Coffin,et al.  HIV population dynamics in vivo: implications for genetic variation, pathogenesis, and therapy , 1995, Science.

[37]  Claudio Cobelli,et al.  Global identifiability of nonlinear models of biological systems , 2001, IEEE Transactions on Biomedical Engineering.

[38]  J. Jacquez,et al.  Numerical parameter identifiability and estimability: Integrating identifiability, estimability, and optimal sampling design , 1985 .

[39]  Ryan Zurakowski,et al.  A model predictive control based scheduling method for HIV therapy. , 2006, Journal of theoretical biology.

[40]  F. Ollivier Le probleme de l'identifiabilite structurelle globale : approche theorique, methodes effectives et bornes de complexite , 1990 .

[41]  Bernt Wennberg,et al.  State elimination and identifiability of the delay parameter for nonlinear time-delay systems , 2008, Autom..

[42]  J. Jacquez Compartmental analysis in biology and medicine , 1985 .

[43]  S. Glad Solvability of differential algebraic equations and inequalities: An algorithm , 1997, 1997 European Control Conference (ECC).

[44]  Elizabeth L. Mansfield,et al.  Applications of the Differential Algebra Package diffgrob2 to Classical Symmetries of Differential Equations , 1997, J. Symb. Comput..

[45]  H. Whitney The Self-Intersections of a Smooth n-Manifold in 2n-Space , 1944 .

[46]  I. Jolliffe Discarding Variables in a Principal Component Analysis. Ii: Real Data , 1973 .

[47]  Xiaohua Xia,et al.  IDENTIFIABILITY OF HIV/AIDS MODELS , 2005 .

[48]  Eric Walter,et al.  Identifiability of parametric models , 1987 .

[49]  H. Rabitz,et al.  Similarity transformation approach to identifiability analysis of nonlinear compartmental models. , 1989, Mathematical biosciences.

[50]  Alan S. Perelson,et al.  Decay characteristics of HIV-1-infected compartments during combination therapy , 1997, Nature.

[51]  T. Bley,et al.  Compartmental modeling and tracer kinetics. Lecture notes in biomathematics, Vol. 50, Berlin, Heidelberg, New York, Tokyo: Springer‐Verlag, 1983. 302 S. 44 DM, 17.50 $ , 1985 .

[52]  T. Vincent,et al.  Nonlinear and Optimal Control Systems , 1997 .

[53]  A. Perelson,et al.  Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection , 1995, Nature.

[54]  Yves Lecourtier,et al.  Unidentifiable compartmental models: what to do? , 1981 .

[55]  Carlo Novara,et al.  Parametric and nonparametric curve fitting , 2006, Autom..

[56]  Claudio Cobelli,et al.  Controllability, Observability and Structural Identifiability of Multi Input and Multi Output Biological Compartmental Systems , 1976, IEEE Transactions on Biomedical Engineering.

[57]  Ruben A. Filter,et al.  Dynamic HIV/AIDS parameter estimation with application to a vaccine readiness study in Southern Africa , 2005, IEEE Transactions on Biomedical Engineering.

[58]  James D. Murray Mathematical Biology: I. An Introduction , 2007 .

[59]  Edward J. Davison Connectability and structural controllability of composite systems , 1977, Autom..

[60]  Patrick W Nelson,et al.  Mathematical analysis of delay differential equation models of HIV-1 infection. , 2002, Mathematical biosciences.

[61]  Evelyne Hubert,et al.  Essential Components of an Algebraic Differential Equation , 1999, J. Symb. Comput..

[62]  Vladimir P. Gerdt,et al.  Improved Kolchin–Ritt Algorithm , 2003, Programming and Computer Software.

[63]  Eric Walter,et al.  QUALITATIVE AND QUANTITATIVE IDENTIFIABILITY ANALYSIS OF NONLINEAR CHEMICAL KINETIC MODELS , 1989 .

[64]  Eugene P. Dougherty,et al.  Further developments and applications of the Green’s function method of sensitivity analysis in chemical kinetics , 1979 .

[65]  H. O. Foulkes Abstract Algebra , 1967, Nature.

[66]  M. Faddy,et al.  Compartmental Analysis in Biology and Medicine, 2nd edition. , 1987 .

[67]  L M Wahl,et al.  Optimal drug treatment regimens for HIV depend on adherence. , 2007, Journal of theoretical biology.

[68]  Xiaohua Xia,et al.  Parameter identifiability of Nonlinear systems with time-delay , 2006, IEEE Transactions on Automatic Control.

[69]  H. Rabitz,et al.  State isomorphism approach to global identifiability of nonlinear systems , 1989 .

[70]  Carlos Castillo-Chavez,et al.  Mathematical approaches for emerging and reemerging infectious diseases , 2002 .

[71]  Marino Zennaro,et al.  Numerical solution of delay differential equations by uniform corrections to an implicit Runge-Kutta method , 1985 .

[72]  F. Takens Detecting strange attractors in turbulence , 1981 .

[73]  D Commenges,et al.  Practical Identifiability of HIV Dynamics Models , 2007, Bulletin of mathematical biology.

[74]  M. Nowak,et al.  Virus dynamics: Mathematical principles of immunology and virology , 2001 .

[75]  Ernst Hairer,et al.  Implementing Radau IIA Methods for Stiff Delay Differential Equations , 2001, Computing.

[76]  A. Holmberg On the practical identifiability of microbial growth models incorporating Michaelis-Menten type nonlinearities , 1982 .

[77]  Sjoerd Verduyn Lunel Parameter identifiability of differential delay equations , 2001 .

[78]  Hulin Wu,et al.  Modeling and Estimation of Kinetic Parameters and Replicative Fitness of HIV-1 from Flow-Cytometry-Based Growth Competition Experiments , 2008, Bulletin of mathematical biology.

[79]  Ralf Takors,et al.  Sensitivity analysis for the reduction of complex metabolism models , 2004 .

[80]  R. Carter Lie Groups , 1970, Nature.

[81]  L. Shampine,et al.  Solving DDEs in MATLAB , 2001 .

[82]  Xiaohua Xia,et al.  Identifiability of nonlinear systems with application to HIV/AIDS models , 2003, IEEE Trans. Autom. Control..

[83]  Riccardo Scattolini,et al.  On the identifiability of the time delay with least-squares methods , 1996, Autom..

[84]  Uri M. Ascher,et al.  The numerical solution of delay-differential-algebraic equations of retarded and neutral type , 1995 .

[85]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[86]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[87]  Lennart Ljung,et al.  On global identifiability for arbitrary model parametrizations , 1994, Autom..

[88]  T. Turányi Sensitivity analysis of complex kinetic systems. Tools and applications , 1990 .

[89]  Luc Jaulin,et al.  Applied Interval Analysis , 2001, Springer London.

[90]  Eduardo D. Sontag,et al.  Spaces of Observables in Nonlinear Control , 1995 .

[91]  C Cobelli,et al.  A computer program for the analysis of controllability, observability and structural identifiability of biological compartmental systems. , 1977, Computer programs in biomedicine.

[92]  William S. Levine,et al.  The Control Handbook , 2005 .

[93]  B. Adams,et al.  Dynamic multidrug therapies for hiv: optimal and sti control approaches. , 2004, Mathematical biosciences and engineering : MBE.

[94]  Gilles Clermont,et al.  A Dynamical Model of Human Immune Response to Influenza a Virus Infection , 2006 .

[95]  Daniel E. Zak,et al.  Importance of input perturbations and stochastic gene expression in the reverse engineering of genetic regulatory networks: insights from an identifiability analysis of an in silico network. , 2003, Genome research.

[96]  H. Pohjanpalo System identifiability based on the power series expansion of the solution , 1978 .

[97]  Maria Rodriguez-Fernandez,et al.  A hybrid approach for efficient and robust parameter estimation in biochemical pathways. , 2006, Bio Systems.

[98]  Claudio Cobelli,et al.  Generalized Sensitivity Functions in Physiological System Identification , 1999, Annals of Biomedical Engineering.

[99]  Hulin Wu,et al.  Efficient Local Estimation for Time-Varying Coefficients in Deterministic Dynamic Models With Applications to HIV-1 Dynamics , 2008 .

[100]  T. Tarn,et al.  New results for identifiability of nonlinear systems , 1987 .

[101]  Maria Pia Saccomani,et al.  DAISY: A new software tool to test global identifiability of biological and physiological systems , 2007, Comput. Methods Programs Biomed..

[102]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[103]  Rudiyanto Gunawan,et al.  Iterative approach to model identification of biological networks , 2005, BMC Bioinformatics.

[104]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[105]  David W. Bacon,et al.  Modeling Ethylene/Butene Copolymerization with Multi‐site Catalysts: Parameter Estimability and Experimental Design , 2003 .

[106]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.

[107]  Alan S. Perelson,et al.  Mathematical Analysis of HIV-1 Dynamics in Vivo , 1999, SIAM Rev..

[108]  Xiaohua Xia,et al.  Identifiability Problems of Time-delay HIV Models , 2008 .

[109]  Haihong Zhu,et al.  Parameter Identifiability and Estimation of HIV/AIDS Dynamic Models , 2008, Bulletin of mathematical biology.

[110]  S. Ruan,et al.  A delay-differential equation model of HIV infection of CD4(+) T-cells. , 2000, Mathematical biosciences.

[111]  X. Xia ESTIMATION OF HIV/AIDS PARAMETERS , 2002 .

[112]  M. Anguelova Observability and identifiability of nonlinear systems with applications in biology , 2007 .

[113]  K. Glover,et al.  Identifiability of linear and nonlinear dynamical systems , 1976 .

[114]  Hulin Wu,et al.  Hierarchical Bayesian Methods for Estimation of Parameters in a Longitudinal HIV Dynamic System , 2006, Biometrics.

[115]  Eric Walter,et al.  Guaranteed Numerical Computation as an Alternative to Computer Algebra for Testing Models for Identifiability , 2003, Numerical Software with Result Verification.

[116]  Srinivas Aluru,et al.  Handbook Of Computational Molecular Biology , 2010 .

[117]  Y Plusquellec,et al.  Local identifiability for two and three-compartment pharmacokinetic models with time-lags. , 1998, Medical engineering & physics.

[118]  Hulin Wu,et al.  Differential Equation Modeling of HIV Viral Fitness Experiments: Model Identification, Model Selection, and Multimodel Inference , 2009, Biometrics.

[119]  George Stephanopoulos,et al.  Dynamic sensitivity analysis of chemical reaction systems: A variational method , 1982 .

[120]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[121]  D. Cacuci,et al.  SENSITIVITY and UNCERTAINTY ANALYSIS , 2003 .

[122]  Eduardo Sontag On the Observability of Polynomial Systems. , 1977 .

[123]  Xiaohua Xia,et al.  When to initiate HIV therapy: a control theoretic approach , 2003, IEEE Transactions on Biomedical Engineering.

[124]  Hulin Wu,et al.  Estimation of time-varying parameters in deterministic dynamic models , 2008 .

[125]  Alexandre Megretski,et al.  Input Classes for Identification of Bilinear Systems , 2006 .

[126]  Hulin Wu,et al.  Deterministic And Stochastic Models Of Aids Epidemics And Hiv Infections With Intervention , 2005 .

[127]  Ian T. Jolliffe,et al.  Discarding Variables in a Principal Component Analysis. I: Artificial Data , 1972 .

[128]  M. Fliess,et al.  Nonlinear observability, identifiability, and persistent trajectories , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[129]  R. Gilmore,et al.  Lie Groups, Lie Algebras, and Some of Their Applications , 1974 .

[130]  Lennart Ljung,et al.  System identification (2nd ed.): theory for the user , 1999 .

[131]  E D Sontag For Differential Equations with r Parameters, 2r+1 Experiments Are Enough for Identification , 2003, J. Nonlinear Sci..

[132]  Thomas L. Vincent,et al.  Modern Control Systems Analysis and Design , 1993 .

[133]  Martin Mönnigmann,et al.  Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT, MAP kinase, and NF-κB signaling pathway models , 2009, BMC Systems Biology.