Hierarchical Stochastic Gradient Algorithm and its Performance Analysis for a Class of Bilinear-in-Parameter Systems

This paper considers the parameter identification for a special class of nonlinear systems, i.e., bilinear-in-parameter systems. Based on the hierarchical identification principle, a hierarchical stochastic gradient (HSG) estimation algorithm is presented. The basic idea is to decompose a bilinear-in-parameter system into two subsystems and to derive the HSG identification algorithm for estimating the system parameters by replacing the unknown variables in the information vectors with their estimates obtained at the previous time. The convergence analysis of the proposed algorithm indicates that the parameter estimation errors converge to zero under persistent excitation conditions. The simulation results show that the proposed algorithm is effective.

[1]  Yan Ji,et al.  Unified Synchronization Criteria for Hybrid Switching-Impulsive Dynamical Networks , 2015, Circuits Syst. Signal Process..

[2]  Wei Zhang,et al.  Improved least squares identification algorithm for multivariable Hammerstein systems , 2015, J. Frankl. Inst..

[3]  Guangjun Liu,et al.  Identification of Hammerstein systems using key-term separation principle, auxiliary model and improved particle swarm optimisation algorithm , 2013, IET Signal Process..

[4]  Lennart Ljung,et al.  Revisiting Hammerstein system identification through the Two-Stage Algorithm for bilinear parameter estimation , 2009, Autom..

[5]  Junxia Ma,et al.  An iterative numerical algorithm for modeling a class of Wiener nonlinear systems , 2013, Appl. Math. Lett..

[6]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[7]  Ling Xu,et al.  A proportional differential control method for a time-delay system using the Taylor expansion approximation , 2014, Appl. Math. Comput..

[8]  Huiping Li,et al.  Robust H∞ filtering for nonlinear stochastic systems with uncertainties and Markov delays , 2012, Autom..

[9]  Marion Gilson,et al.  Instrumental variable methods for closed-loop system identification , 2005, Autom..

[10]  Tao Tang,et al.  Several gradient-based iterative estimation algorithms for a class of nonlinear systems using the filtering technique , 2014 .

[11]  F. Ding,et al.  Modelling and multi-innovation parameter identification for Hammerstein nonlinear state space systems using the filtering technique , 2016 .

[12]  Simon X. Yang,et al.  Observer-Based Adaptive Neural Network Trajectory Tracking Control for Remotely Operated Vehicle , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Feng Ding,et al.  Parameter estimation with scarce measurements , 2011, Autom..

[14]  Yide Wang,et al.  Fault diagnosis method based on FFT-RPCA-SVM for Cascaded-Multilevel Inverter. , 2016, ISA transactions.

[15]  Ling Xu,et al.  Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration , 2015 .

[16]  Feng Ding,et al.  Recursive Least Squares Parameter Estimation for a Class of Output Nonlinear Systems Based on the Model Decomposition , 2016, Circuits Syst. Signal Process..

[17]  Xiang Cao,et al.  Multi-AUV Target Search Based on Bioinspired Neurodynamics Model in 3-D Underwater Environments , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Huiping Li,et al.  On Neighbor Information Utilization in Distributed Receding Horizon Control for Consensus-Seeking , 2016, IEEE Transactions on Cybernetics.

[19]  Jian Pan,et al.  Image noise smoothing using a modified Kalman filter , 2016, Neurocomputing.

[20]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[21]  Feng Ding,et al.  Recursive parameter and state estimation for an input nonlinear state space system using the hierarchical identification principle , 2015, Signal Process..

[22]  Feng Ding,et al.  Recursive least squares algorithm and gradient algorithm for Hammerstein–Wiener systems using the data filtering , 2016 .

[23]  Lennart Ljung,et al.  Identification of Hammerstein-Wiener models , 2013, Autom..

[24]  F. Ding,et al.  Filtering-based iterative identification for multivariable systems , 2016 .

[25]  Feng Ding,et al.  Parameter estimation algorithms for multivariable Hammerstein CARMA systems , 2016, Inf. Sci..

[26]  Feng Ding,et al.  Kalman state filtering based least squares iterative parameter estimation for observer canonical state space systems using decomposition , 2016, J. Comput. Appl. Math..

[27]  Feng Ding,et al.  The auxiliary model based hierarchical gradient algorithms and convergence analysis using the filtering technique , 2016, Signal Process..

[28]  Huiping Li,et al.  Distributed receding horizon control of constrained nonlinear vehicle formations with guaranteed γ-gain stability , 2016, Autom..

[29]  Kamel Abderrahim,et al.  Identification of Wiener Time Delay Systems Based on Hierarchical Gradient Approach , 2015 .

[30]  Er-Wei Bai,et al.  A blind approach to the Hammerstein-Wiener model identification , 2002, Autom..

[31]  Feng Ding,et al.  Convergence Analysis of the Hierarchical Least Squares Algorithm for Bilinear-in-Parameter Systems , 2016, Circuits Syst. Signal Process..

[32]  Feng Ding,et al.  Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model , 2016, Autom..

[33]  Feng Ding,et al.  An auxiliary model based least squares algorithm for a dual-rate state space system with time-delay using the data filtering , 2016, J. Frankl. Inst..

[34]  Dongqing Wang,et al.  Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed models , 2016, Appl. Math. Lett..

[35]  Feng Ding,et al.  The recursive least squares identification algorithm for a class of Wiener nonlinear systems , 2016, J. Frankl. Inst..

[36]  Ximei Liu,et al.  New criteria for the robust impulsive synchronization of uncertain chaotic delayed nonlinear systems , 2014, Nonlinear Dynamics.

[37]  Ling Xu,et al.  Application of the Newton iteration algorithm to the parameter estimation for dynamical systems , 2015, J. Comput. Appl. Math..

[38]  Ling Xu,et al.  The damping iterative parameter identification method for dynamical systems based on the sine signal measurement , 2016, Signal Process..

[39]  Petre Stoica,et al.  Estimation of the parameters of a bilinear model with applications to submarine detection and system identification , 2007, Digit. Signal Process..

[40]  Hao Wu,et al.  An adaptive confidence limit for periodic non-steady conditions fault detection , 2016 .

[41]  Keum-Shik Hong,et al.  Maximum likelihood identification of Wiener–Hammerstein models , 2013 .

[42]  Feng Ding,et al.  Performance Analysis of the Auxiliary Model-Based Stochastic Gradient Parameter Estimation Algorithm for State-Space Systems with One-Step State Delay , 2013, Circuits Syst. Signal Process..

[43]  Er-Wei Bai,et al.  Least squares solutions of bilinear equations , 2006, Syst. Control. Lett..

[44]  Tao Tang,et al.  Recursive least squares estimation algorithm applied to a class of linear-in-parameters output error moving average systems , 2014, Appl. Math. Lett..

[45]  Cheng Wang,et al.  Parameter identification of a class of nonlinear systems based on the multi-innovation identification theory , 2015, J. Frankl. Inst..

[46]  E. Bai.  An optimal two stage identification algorithm for Hammerstein-Wiener nonlinear systems , 1998 .