A Bayesian Collocation Integral Method for Parameter Estimation in Ordinary Differential Equations

Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on basis functions or Gaussian processes to approximate the ODE solution and its derivatives. Due to the sensitivity of the ODE solution to its derivatives, these methods can be hindered by estimation error, especially when only sparse time-course observations are available. We present a Bayesian collocation framework that operates on the integrated form of the ODEs and also avoids the expensive use of numerical solvers. Our methodology has the capability to handle general nonlinear ODE systems. We demonstrate the accuracy of the proposed method through a simulation study, where the estimated parameters and recovered system trajectories are compared with other recent methods. A real data example is also provided.

[1]  Meng Li,et al.  Optimal plug-in Gaussian processes for modelling derivatives , 2022, 2210.11626.

[2]  Samuel W. K. Wong,et al.  Inference of dynamic systems from noisy and sparse data via manifold-constrained Gaussian processes , 2020, Proceedings of the National Academy of Sciences.

[3]  Shijia Wang,et al.  Adaptive Semiparametric Bayesian Differential Equations Via Sequential Monte Carlo , 2020, J. Comput. Graph. Stat..

[4]  Mevin B. Hooten,et al.  Hamiltonian Monte Carlo , 2019, Bringing Bayesian Models to Life.

[5]  Kasper Kristensen,et al.  No-U-turn sampling for fast Bayesian inference in ADMB and TMB: Introducing the adnuts and tmbstan R packages , 2018, PloS one.

[6]  Nico S. Gorbach,et al.  Fast Gaussian Process Based Gradient Matching for Parameter Identification in Systems of Nonlinear ODEs , 2018, AISTATS.

[7]  Giles Hooker,et al.  CollocInfer: Collocation Inference in Differential Equation Models , 2016 .

[8]  Ali Shojaie,et al.  Network Reconstruction From High-Dimensional Ordinary Differential Equations , 2016, Journal of the American Statistical Association.

[9]  Itai Dattner,et al.  Optimal rate of direct estimators in systems of ordinary differential equations linear in functions of the parameters , 2013 .

[10]  Dirk Husmeier,et al.  ODE parameter inference using adaptive gradient matching with Gaussian processes , 2013, AISTATS.

[11]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[12]  Radford M. Neal MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[13]  Karline Soetaert,et al.  Solving Differential Equations in R: Package deSolve , 2010 .

[14]  Hongyu Zhao,et al.  Asymptotic efficiency and finite-sample properties of the generalized profiling estimation of parameters in ordinary differential equations , 2009, 0903.3400.

[15]  Neil D. Lawrence,et al.  Accelerating Bayesian Inference over Nonlinear Differential Equations with Gaussian Processes , 2008, NIPS.

[16]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[17]  Scott M. Berry,et al.  Bayesian Smoothing and Regression Splines for Measurement Error Problems , 2002 .

[18]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[19]  J. Varah A Spline Least Squares Method for Numerical Parameter Estimation in Differential Equations , 1982 .

[20]  R. May,et al.  Stability and Complexity in Model Ecosystems , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  A. Galston Fundamentals of Ecology , 1972, The Yale Journal of Biology and Medicine.

[22]  Gene H. Golub,et al.  Calculation of Gauss quadrature rules , 1967, Milestones in Matrix Computation.

[23]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[24]  D. Campbell,et al.  Bayesian collocation tempering and generalized profiling for estimation of parameters from differential equation models , 2007 .

[25]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[26]  Alfred J. Lotka,et al.  The growth of mixed populations: Two species competing for a common food supply , 1978 .

[27]  C. D. Boor,et al.  On Calculating with B-Splines II. Integration , 1976 .

[28]  A. Stroud,et al.  Gaussian quadrature formulas , 1966 .