Several multi-innovation identification methods

This paper considers connections between the cost functions of some parameter identification methods for system modelling, including the well known projection algorithm, stochastic gradient (SG) algorithm and recursive least squares (RLS) algorithm, and presents a modified SG algorithm by introducing the convergence index and a multi-innovation projection algorithm, a multi-innovation SG algorithm and a multi-innovation RLS algorithm by introducing the innovation length, aiming at improving the convergence rate of the SG and RLS algorithms. Furthermore, this paper derives an interval-varying multi-innovation SG and an interval-varying multi-innovation RLS algorithm in order to deal with missing data cases.

[1]  Feng Ding,et al.  Combined parameter and output estimation of dual-rate systems using an auxiliary model , 2004, Autom..

[2]  Feng Ding,et al.  Parameter Identification and Intersample Output Estimation for Dual-Rate Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Feng Ding,et al.  Multi-innovation stochastic gradient algorithms for multi-input multi-output systems , 2009, Digit. Signal Process..

[4]  Feng Ding,et al.  Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems , 2009, Autom..

[5]  Feng Ding,et al.  Auxiliary model-based least-squares identification methods for Hammerstein output-error systems , 2007, Syst. Control. Lett..

[6]  Feng Ding,et al.  Hierarchical gradient-based identification of multivariable discrete-time systems , 2005, Autom..

[7]  Feng Ding,et al.  Amendments to “Performance Analysis of Estimation Algorithms of Nonstationary ARMA Processes” [Mar 06 1041-1053] , 2008, IEEE Transactions on Signal Processing.

[8]  Feng Ding,et al.  Identification of Hammerstein nonlinear ARMAX systems , 2005, Autom..

[9]  Feng Ding,et al.  Multirate crosstalk identification in xDSL systems , 2006, IEEE Transactions on Communications.

[10]  James A. Cadzow.  Total Least Squares, Matrix Enhancement, and Signal Processing , 1994 .

[11]  G. Wittum,et al.  Adaptive filtering , 1997 .

[12]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[13]  Feng Ding,et al.  Extended stochastic gradient identification algorithms for Hammerstein-Wiener ARMAX systems , 2008, Comput. Math. Appl..

[14]  전창완,et al.  Total Least Squares , 2008 .

[15]  P. X. Liu,et al.  Multiinnovation Least-Squares Identification for System Modeling , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Andrew H. Jazwinski,et al.  Adaptive filtering , 1969, Autom..

[17]  F. Ding,et al.  An auxiliary model based on a recursive least-squares parameter estimation algorithm for non-uniformly sampled multirate systems , 2009 .

[18]  Feng Ding,et al.  Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises , 2009, Signal Process..

[19]  Feng Ding,et al.  Hierarchical least squares identification methods for multivariable systems , 2005, IEEE Trans. Autom. Control..

[20]  Feng Ding,et al.  Performance analysis of multi-innovation gradient type identification methods , 2007, Autom..

[21]  Feng Ding,et al.  Self-tuning control based on multi-innovation stochastic gradient parameter estimation , 2009, Syst. Control. Lett..

[22]  Yang Shi,et al.  l2–l∞ Filtering for Multirate Systems Based on Lifted Models , 2008 .

[23]  Feng Ding,et al.  Performance analysis of estimation algorithms of nonstationary ARMA processes , 2006, IEEE Transactions on Signal Processing.

[24]  Feng Ding,et al.  Auxiliary model identification method for multirate multi-input systems based on least squares , 2009, Math. Comput. Model..

[25]  Yang Shi,et al.  Output Feedback Stabilization of Networked Control Systems With Random Delays Modeled by Markov Chains , 2009, IEEE Transactions on Automatic Control.

[26]  Tongwen Chen,et al.  2-Norm Based Recursive Design of Transmultiplexers with Designable Filter Length , 2006 .

[27]  Feng Ding,et al.  Performance analysis of the auxiliary models based multi-innovation stochastic gradient estimation algorithm for output error systems , 2010, Digit. Signal Process..

[28]  Mohammad Bilal Malik,et al.  State-space least mean square , 2008, Digit. Signal Process..

[29]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[30]  Yanjun Liu,et al.  Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model , 2009, Appl. Math. Comput..

[31]  M. Yan,et al.  Robust discrete-time sliding mode control for uncertain systems with time-varying state delay , 2008 .

[32]  Feng Ding,et al.  Parameter estimation of dual-rate stochastic systems by using an output error method , 2005, IEEE Trans. Autom. Control..

[33]  Gene H. Golub,et al.  Total least squares , 1979 .

[34]  Feng Ding,et al.  Computers and Mathematics with Applications Identification for Multirate Multi-input Systems Using the Multi-innovation Identification Theory , 2022 .