Improved gradient descent algorithms for time-delay rational state-space systems: intelligent search method and momentum method

This study proposes two improved gradient descent parameter estimation algorithms for rational state-space models with time-delay. These two algorithms, based on intelligent search method and momentum method, can simultaneously estimate the time-delay and parameters without the matrix eigenvalue calculation in each iteration. Compared with the traditional gradient descent algorithm, the improved algorithms come with two advantages: having quicker convergence rates and less computational efforts, particularly meaningful for those large scale systems. A simulated example is selected to illustrate the efficiency of the proposed algorithms.

[1]  Wei Li,et al.  Control Algorithms of Magnetic Suspension Systems Based on the Improved Double Exponential Reaching Law of Sliding Mode Control , 2018, International Journal of Control, Automation and Systems.

[2]  Erfu Yang,et al.  Modeling a nonlinear process using the exponential autoregressive time series model , 2019 .

[3]  F. Alsaadi,et al.  Recursive parameter identification of the dynamical models for bilinear state space systems , 2017 .

[4]  T. Hayat,et al.  Hierarchical Parameter Estimation for the Frequency Response Based on the Dynamical Window Data , 2018, International Journal of Control, Automation and Systems.

[5]  Yu Zhang,et al.  Reconfigurable equilibrium circuit with additional power supply , 2020 .

[6]  Feng Ding,et al.  Decomposition- and Gradient-Based Iterative Identification Algorithms for Multivariable Systems Using the Multi-innovation Theory , 2019, Circuits Syst. Signal Process..

[7]  Bo Fu,et al.  Research on Automatic Generation Control with Wind Power Participation Based on Predictive Optimal 2-Degree-of-Freedom PID Strategy for Multi-area Interconnected Power System , 2018, Energies.

[8]  Bo Fu,et al.  Quadratic stabilization of switched uncertain linear systems: a convex combination approach , 2019, IEEE/CAA Journal of Automatica Sinica.

[9]  Dongqing Wang,et al.  Model recovery for Hammerstein systems using the auxiliary model based orthogonal matching pursuit method , 2018 .

[10]  J. Chu,et al.  Gradient-based and least-squares-based iterative algorithms for Hammerstein systems using the hierarchical identification principle , 2013 .

[11]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Axel Kowald,et al.  Systems Biology in Practice: Concepts, Implementation and Application , 2005 .

[13]  Xiao Zhang,et al.  Hierarchical parameter and state estimation for bilinear systems , 2020, Int. J. Syst. Sci..

[14]  Mehmet Akar,et al.  Fastest random walk on a path , 2019, Int. J. Syst. Sci..

[15]  Yanjun Liu,et al.  Model recovery for Hammerstein systems using the hierarchical orthogonal matching pursuit method , 2019, J. Comput. Appl. Math..

[16]  Wei Xing Zheng,et al.  A Recursive Identification Algorithm for Wiener Nonlinear Systems with Linear State-Space Subsystem , 2018, Circuits Syst. Signal Process..

[17]  YangQuan Chen,et al.  Robust passivity and feedback passification of a class of uncertain fractional-order linear systems , 2019, Int. J. Syst. Sci..

[18]  Dingli Yu,et al.  An enhanced linear Kalman filter (EnLKF) algorithm for parameter estimation of nonlinear rational models , 2017, Int. J. Syst. Sci..

[19]  Feng Ding,et al.  State estimation for bilinear systems through minimizing the covariance matrix of the state estimation errors , 2019, International Journal of Adaptive Control and Signal Processing.

[20]  Xiangli Li,et al.  State space model identification of multirate processes with time-delay using the expectation maximization , 2019, J. Frankl. Inst..

[21]  Jing Chen,et al.  Biased compensation recursive least squares-based threshold algorithm for time-delay rational models via redundant rule , 2018 .

[22]  F. Ding.  Hierarchical multi-innovation stochastic gradient algorithm for Hammerstein nonlinear system modeling , 2013 .

[23]  Min Gan,et al.  Generalized exponential autoregressive models for nonlinear time series: Stationarity, estimation and applications , 2018, Inf. Sci..

[24]  F. Ding,et al.  Least-squares-based iterative and gradient-based iterative estimation algorithms for bilinear systems , 2017 .

[25]  Ahmed Alsaedi,et al.  Gradient estimation algorithms for the parameter identification of bilinear systems using the auxiliary model , 2020, J. Comput. Appl. Math..

[26]  Hui Liu,et al.  Novel Method for Identifying Fault Location of Mixed Lines , 2018, Energies.

[27]  Ling Xu,et al.  Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration , 2015 .

[28]  Feng Ding,et al.  Identification methods for Hammerstein nonlinear systems , 2011, Digit. Signal Process..

[29]  Renbin Xiao,et al.  Control and Backbone Identification for the Resilient Recovery of a Supply Network Utilizing Outer Synchronization , 2019 .

[30]  Feng Ding,et al.  Expectation maximization estimation for a class of input nonlinear state space systems by using the Kalman smoother , 2018, Signal Process..

[31]  Jing Chen,et al.  Maximum likelihood based identification methods for rational models , 2019, Int. J. Syst. Sci..

[32]  Ling Xu,et al.  Recursive parameter estimation methods and convergence analysis for a special class of nonlinear systems , 2019, International Journal of Robust and Nonlinear Control.

[33]  Ling Xu.  The parameter estimation algorithms based on the dynamical response measurement data , 2017 .

[34]  Zipeng Zhang,et al.  Energy Disaggregation of Appliances Consumptions Using HAM Approach , 2019, IEEE Access.

[35]  C. L. Philip Chen,et al.  A Regularized Variable Projection Algorithm for Separable Nonlinear Least-Squares Problems , 2019, IEEE Transactions on Automatic Control.

[36]  D. Kamenski,et al.  Parameter estimation in differential equations by application of rational functions , 1993 .

[37]  F. Ding,et al.  Recasted models-based hierarchical extended stochastic gradient method for MIMO nonlinear systems , 2017 .

[38]  Tao Liu,et al.  U-model based predictive control for nonlinear processes with input delay , 2019, Journal of Process Control.

[39]  Liang Tang,et al.  Joint design and torque feedback experiment of rehabilitation robot , 2020 .

[40]  Michel Verhaegen,et al.  Subspace Identification of Local Systems in One-Dimensional Homogeneous Networks , 2018, IEEE Transactions on Automatic Control.

[41]  Yongji Wang,et al.  Review of rational (total) nonlinear dynamic system modelling, identification, and control , 2015, Int. J. Syst. Sci..

[42]  S. Billings,et al.  Rational model identification using an extended least-squares algorithm , 1991 .

[43]  Wei Xing Zheng,et al.  A globally consistent nonlinear least squares estimator for identification of nonlinear rational systems , 2017, Autom..

[44]  Jianlong Qiu,et al.  A Novel EM Identification Method for Hammerstein Systems With Missing Output Data , 2020, IEEE Transactions on Industrial Informatics.

[45]  Wan Xiangkui,et al.  A T-wave alternans assessment method based on least squares curve fitting technique , 2016 .

[46]  Xiangkui Wan,et al.  Two-stage Gradient-based Iterative Estimation Methods for Controlled Autoregressive Systems Using the Measurement Data , 2020, International Journal of Control, Automation and Systems.

[47]  Long Chen,et al.  Term Selection for a Class of Separable Nonlinear Models , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Fuqiang Liu,et al.  Receding horizon consensus of general linear multi-agent systems with input constraints: An inverse optimality approach , 2016, Autom..

[49]  Feng Ding,et al.  A multi-innovation state and parameter estimation algorithm for a state space system with d-step state-delay , 2017, Signal Process..

[50]  Quanmin Zhu.  An implicit least squares algorithm for nonlinear rational model parameter estimation , 2005 .

[51]  Ling Xu,et al.  The damping iterative parameter identification method for dynamical systems based on the sine signal measurement , 2016, Signal Process..