The quadratic dimensional reduction method for parameter identification

Abstract This paper presents the Quadratic Dimensional Reduction Method (QDRM) for parameter identification. The QDRM involves a quadratic adaptation to the existing, linear Dimensional Reduction Method (DRM). Gradient descent methods can halt prematurely when curvature of the objective surface is low near the optimal parameter choices. The QDRM identifies curved hyper-surfaces that capture the domain where premature gradient descent convergence occurs. Parameter identification is then restricted to those surfaces allowing continued convergence. The performance of the novel QDRM and existing DRM is compared across two models. A theoretical model was used with exaggerated curvature in the objective surfaces in order to test the optimality of the QDRM. Second, a thermal model representing a typical first order ‘real-world’ case was solved using the DRM and QDRM. The QDRM out-performed the DRM in all cases tested with improved performance most prominent in problems subject to minimal noise as well as in problems whose objective surface exhibits more pronounced curvature. Thus, the QDRM extends the set of problems over which the DRM framework is applicable and effective.

[1]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[2]  Falk Schreiber,et al.  A unified framework for estimating parameters of kinetic biological models , 2015, BMC Bioinformatics.

[3]  Robert Leary,et al.  Application of a mathematical model to prevent in vivo amplification of antibiotic-resistant bacterial populations during therapy. , 2003, The Journal of clinical investigation.

[4]  Henrik Madsen,et al.  Introduction to General and Generalized Linear Models , 2010 .

[5]  Knut Möller,et al.  Hierarchical Parameter Identification in Models of Respiratory Mechanics , 2011, IEEE Transactions on Biomedical Engineering.

[6]  Paul D Docherty,et al.  The dimensional reduction method for identification of parameters that trade-off due to similar model roles. , 2017, Mathematical biosciences.

[7]  Claudio Cobelli,et al.  Global identifiability of nonlinear models of biological systems , 2001, IEEE Transactions on Biomedical Engineering.

[8]  William C. Davidon,et al.  Variable Metric Method for Minimization , 1959, SIAM J. Optim..

[9]  Yonathan Bard,et al.  Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation Problems , 1970 .

[10]  Thomas L. Saaty,et al.  Parametric Objective Function (Part 1) , 1954, Oper. Res..

[11]  Jörn Kretschmer,et al.  The Novel Dimensional Reduction Method and Tikhonov Regularisation in Parameter Identification of Non-Linear Ill-Posed Problems , 2017 .

[12]  Ursula Klingmüller,et al.  Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood , 2009, Bioinform..

[13]  R. Bellman,et al.  On structural identifiability , 1970 .

[14]  Thomas Desaive,et al.  A graphical method for practical and informative identifiability analyses of physiological models: A case study of insulin kinetics and sensitivity , 2011, Biomedical engineering online.

[15]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[16]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .