A practical approach to parameter estimation applied to model predicting heart rate regulation

Mathematical models have long been used for prediction of dynamics in biological systems. Recently, several efforts have been made to render these models patient specific. One way to do so is to employ techniques to estimate parameters that enable model based prediction of observed quantities. Knowledge of variation in parameters within and between groups of subjects have potential to provide insight into biological function. Often it is not possible to estimate all parameters in a given model, in particular if the model is complex and the data is sparse. However, it may be possible to estimate a subset of model parameters reducing the complexity of the problem. In this study, we compare three methods that allow identification of parameter subsets that can be estimated given a model and a set of data. These methods will be used to estimate patient specific parameters in a model predicting baroreceptor feedback regulation of heart rate during head-up tilt. The three methods include: structured analysis of the correlation matrix, analysis via singular value decomposition followed by QR factorization, and identification of the subspace closest to the one spanned by eigenvectors of the model Hessian. Results showed that all three methods facilitate identification of a parameter subset. The “best” subset was obtained using the structured correlation method, though this method was also the most computationally intensive. Subsets obtained using the other two methods were easier to compute, but analysis revealed that the final subsets contained correlated parameters. In conclusion, to avoid lengthy computations, these three methods may be combined for efficient identification of parameter subsets.

[1]  T. Koopmans,et al.  The Identification of Structural Characteristics , 1950 .

[2]  R. Schoenfeld,et al.  Invariants in Experimental Data on Linear Kinetics and the Formulation of Models , 1956 .

[3]  Franklin M. Fisher,et al.  Generalization of the Rank and Order Conditions for Identifiability , 1959 .

[4]  R. Bellman,et al.  On structural identifiability , 1970 .

[5]  Karl Johan Åström,et al.  BOOK REVIEW SYSTEM IDENTIFICATION , 1994, Econometric Theory.

[6]  C. Radhakrishna Rao,et al.  Unified theory of linear estimation , 1971 .

[7]  T. G. Coleman,et al.  Circulation: overall regulation. , 1972, Annual review of physiology.

[8]  G. Stewart,et al.  Rank degeneracy and least squares problems , 1976 .

[9]  Virginia Klema,et al.  Rosetak Document 4: Rank Degeneracies and Least Square Problems , 1977 .

[10]  C. Cobelli,et al.  Parameter and structural identifiability concepts and ambiguities: a critical review and analysis. , 1980, The American journal of physiology.

[11]  David H. Anderson Structural properties of compartmental models , 1982 .

[12]  Keith Godfrey,et al.  Compartmental Models and Their Application , 1983 .

[13]  Ewart R. Carson,et al.  The mathematical modeling of metabolic and endocrine systems : model formulation, identification, and validation , 1983 .

[14]  Gene H. Golub,et al.  Matrix computations , 1983 .

[15]  D. Ferguson,et al.  Relative contribution of aortic and carotid baroreflexes to heart rate control in man during steady state and dynamic increases in arterial pressure. , 1985, The Journal of clinical investigation.

[16]  J. Jacquez Compartmental analysis in biology and medicine , 1985 .

[17]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[18]  M. Faddy,et al.  Compartmental Analysis in Biology and Medicine, 2nd edition. , 1987 .

[19]  Miguel Velez-Reyes,et al.  Decomposed algorithms for parameter estimation , 1992 .

[20]  Mansour Eslami,et al.  Theory of Sensitivity in Dynamic Systems: An Introduction , 1994 .

[21]  Christopher T. H. Baker,et al.  Pitfalls in Parameter Estimation for Delay Differential Equations , 1997, SIAM J. Sci. Comput..

[22]  Carl Tim Kelley,et al.  Iterative methods for optimization , 1999, Frontiers in applied mathematics.

[23]  G. Verghese,et al.  Subset selection for improved parameter estimation in on-line identification of a synchronous generator , 1999 .

[24]  Timo Teräsvirta,et al.  A SIMPLE VARIABLE SELECTION TECHNIQUE FOR NONLINEAR MODELS , 2001 .

[25]  Jing Wan,et al.  A One-dimensional Finite Element Method for Simulation-based Medical Planning for Cardiovascular Disease , 2002, Computer methods in biomechanics and biomedical engineering.

[26]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[27]  N. Secher,et al.  New insights into differential baroreflex control of heart rate in humans. , 2003, American journal of physiology. Heart and circulatory physiology.

[28]  P. Valigi,et al.  A Kalman filtering approach to estimation of maximum ventricle elastance , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  H. Tran,et al.  Blood pressure and blood flow variation during postural change from sitting to standing: model development and validation. , 2005, Journal of applied physiology.

[30]  Hong Wang,et al.  Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-kappaB signalling pathway. , 2006, Molecular bioSystems.

[31]  P. James McLellan,et al.  Parameter estimation in continuous-time dynamic models using principal differential analysis , 2006, Comput. Chem. Eng..

[32]  Johnny T Ottesen,et al.  Modeling baroreflex regulation of heart rate during orthostatic stress. , 2006, American journal of physiology. Regulatory, integrative and comparative physiology.

[33]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[34]  Julio R. Banga,et al.  Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems , 2006, BMC Bioinformatics.

[35]  Jin Hee Lee,et al.  AKT phosphorylation is essential for insulin-induced relaxation of rat vascular smooth muscle cells. , 2006, American journal of physiology. Cell physiology.

[36]  Christopher R Myers,et al.  Extracting Falsifiable Predictions from Sloppy Models , 2007, Annals of the New York Academy of Sciences.

[37]  Gilles Clermont,et al.  From Inverse Problems in Mathematical Physiology to Quantitative Differential Diagnoses , 2007, PLoS Comput. Biol..

[38]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[39]  Harvey Thomas Banks,et al.  Viscoelastic Mapping of the Arterial Ovine System using a Kelvin Model , 2007 .

[40]  Xiao Hu,et al.  Estimation of Hidden State Variables of the Intracranial System Using Constrained Nonlinear Kalman Filters , 2007, IEEE Transactions on Biomedical Engineering.

[41]  M. Khoo,et al.  Modeling of Autonomic Control in Sleep-Disordered Breathing , 2008, Cardiovascular engineering.

[42]  Giancarlo Pennati,et al.  Computational Patient-Specific Models Based on 3-D Ultrasound Data to Quantify Uterine Arterial Flow During Pregnancy , 2008, IEEE Transactions on Medical Imaging.

[43]  Hulin Wu,et al.  Modeling and Estimation of Kinetic Parameters and Replicative Fitness of HIV-1 from Flow-Cytometry-Based Growth Competition Experiments , 2008, Bulletin of mathematical biology.

[44]  Vera Novak,et al.  Sensitivity Analysis and Model Assessment: Mathematical Models for Arterial Blood Flow and Blood Pressure , 2008, Cardiovascular engineering.

[45]  Gilles Clermont,et al.  An ensemble of models of the acute inflammatory response to bacterial lipopolysaccharide in rats: results from parameter space reduction. , 2008, Journal of theoretical biology.

[46]  Haihong Zhu,et al.  Parameter Identifiability and Estimation of HIV/AIDS Dynamic Models , 2008, Bulletin of mathematical biology.

[47]  Johnny T Ottesen,et al.  Modeling Heart Rate Regulation—Part I: Sit-to-stand Versus Head-up Tilt , 2008, Cardiovascular engineering.

[48]  Paul Gustafson,et al.  What Are the Limits of Posterior Distributions Arising From Nonidentified Models, and Why Should We Care? , 2009 .

[49]  Jonas S. Almeida,et al.  Identification of neutral biochemical network models from time series data , 2009, BMC Syst. Biol..

[50]  Giuseppe Baselli,et al.  Modelling and disentangling physiological mechanisms: linear and nonlinear identification techniques for analysis of cardiovascular regulation , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[51]  H. Banks,et al.  Viscoelastic Models for Passive Arterial Wall Dynamics , 2009 .

[52]  Ursula Klingmüller,et al.  Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood , 2009, Bioinform..

[53]  Charles A. Taylor,et al.  Patient-specific modeling of cardiovascular mechanics. , 2009, Annual review of biomedical engineering.

[54]  Gerardo Chowell,et al.  Mathematical and statistical estimation approaches in epidemiology , 2009 .

[55]  Vartan Kurtcuoglu,et al.  Patient-specific three-dimensional simulation of LDL accumulation in a human left coronary artery in its healthy and atherosclerotic states. , 2009, American journal of physiology. Heart and circulatory physiology.

[56]  Harvey Thomas Banks,et al.  An Inverse Problem Statistical Methodology Summary , 2007 .

[57]  C. T. Kelley,et al.  Estimation and identification of parameters in a lumped cerebrovascular model. , 2008, Mathematical biosciences and engineering : MBE.

[58]  H. T. Banks,et al.  A sensitivity matrix based methodology for inverse problem formulation , 2020, 2004.06831.

[59]  P. James McLellan,et al.  Parameter Estimation in a Simplified MWD Model for HDPE Produced by a Ziegler‐Natta Catalyst , 2009 .

[60]  Efstratios N. Pistikopoulos,et al.  Global Sensitivity Analysis Challenges in Biological Systems Modeling , 2009 .

[61]  Scott Russell Pope,et al.  Parameter Identification in Lumped Compartment Cardiorespiratory Models , 2009 .

[62]  Men-Tzung Lo,et al.  Nonlinear phase interaction between nonstationary signals: a comparison study of methods based on Hilbert-Huang and Fourier transforms. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[63]  Mette S. Olufsen,et al.  Analysis of Viscoelastic Wall Properties in Ovine Arteries , 2009, IEEE Transactions on Biomedical Engineering.

[64]  Hulin Wu,et al.  ESTIMATION OF CONSTANT AND TIME-VARYING DYNAMIC PARAMETERS OF HIV INFECTION IN A NONLINEAR DIFFERENTIAL EQUATION MODEL. , 2010, The annals of applied statistics.

[65]  Charles A. Taylor,et al.  Patient-Specific Modeling of Blood Flow and Pressure in Human Coronary Arteries , 2010, Annals of Biomedical Engineering.

[66]  F. Lazeyras,et al.  Validation of a patient-specific one-dimensional model of the systemic arterial tree. , 2011, American journal of physiology. Heart and circulatory physiology.

[67]  Mette S. Olufsen,et al.  Functionality of the baroreceptor nerves in heart rate regulation , 2011, Comput. Methods Programs Biomed..

[68]  Xiaohua Xia,et al.  On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics , 2011, SIAM Rev..

[69]  Ilse C. F. Ipsen,et al.  Rank-Deficient Nonlinear Least Squares Problems and Subset Selection , 2011, SIAM J. Numer. Anal..

[70]  Timothy J. Gundert,et al.  Optical Coherence Tomography for Patient-specific 3D Artery Reconstruction and Evaluation of Wall Shear Stress in a Left Circumflex Coronary Artery , 2011 .

[71]  Denis Dochain,et al.  Dynamical modelling and estimation in wastewater treatment processes. , 2015 .