Coupled-least-squares identification for multivariable systems

This article studies identification problems of multiple linear regression models, which may be described a class of multi-input multi-output systems (i.e. multivariable systems). Based on the coupling identification concept, a novel coupled-least-squares (C-LS) parameter identification algorithm is introduced for the purpose of avoiding the matrix inversion in the multivariable recursive least-squares (RLS) algorithm for estimating the parameters of the multiple linear regression models. The analysis indicates that the C-LS algorithm does not involve the matrix inversion and requires less computationally efforts than the multivariable RLS algorithm, and that the parameter estimates given by the C-LS algorithm converge to their true values. Simulation results confirm the presented convergence theorems.

[1]  N. Sinha,et al.  On-line estimation of the parameters of a multivariable system using matrix pseudo-inverse , 1976 .

[2]  L. Ljung.  Consistency of the least-squares identification method , 1976 .

[3]  V. Solo.  The convergence of AML , 1979 .

[4]  T. Lai,et al.  Least Squares Estimates in Stochastic Regression Models with Applications to Identification and Control of Dynamic Systems , 1982 .

[5]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[6]  T. Lai,et al.  Extended least squares and their applications to adaptive control and prediction in linear systems , 1986 .

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  C. Z. Wei.  Adaptive Prediction by Least Squares Predictors in Stochastic Regression Models with Applications to Time Series , 1987 .

[9]  T. Lai,et al.  Recursive identification and adaptive prediction in linear stochastic systems , 1991 .

[10]  Wei Ren,et al.  Stochastic adaptive prediction and model reference control , 1994, IEEE Trans. Autom. Control..

[11]  Wei Ren,et al.  On the convergence of least squares estimates in white noise , 1994, IEEE Trans. Autom. Control..

[12]  Feng Ding,et al.  Combined parameter and output estimation of dual-rate systems using an auxiliary model , 2004, Autom..

[13]  Feng Ding,et al.  Hierarchical identification of lifted state-space models for general dual-rate systems , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[14]  Feng Ding,et al.  Performance bounds of forgetting factor least-squares algorithms for time-varying systems with finite measurement data , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  Feng Ding,et al.  Hierarchical gradient-based identification of multivariable discrete-time systems , 2005, Autom..

[16]  Feng Ding,et al.  Performance analysis of multi-innovation gradient type identification methods , 2007, Autom..

[17]  M. Yan,et al.  Robust discrete-time sliding mode control for uncertain systems with time-varying state delay , 2008 .

[18]  Feng Ding,et al.  Performance analysis of stochastic gradient algorithms under weak conditions , 2008, Science in China Series F: Information Sciences.

[19]  F. Ding,et al.  On consistency of recursive least squares identification algorithms for controlled auto-regression models ☆ , 2008 .

[20]  Yang Shi,et al.  Output Feedback Stabilization of Networked Control Systems With Random Delays Modeled by Markov Chains , 2009, IEEE Transactions on Automatic Control.

[21]  Feng Ding,et al.  Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises , 2009, Signal Process..

[22]  Yanjun Liu,et al.  Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model , 2009, Appl. Math. Comput..

[23]  Feng Ding,et al.  Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems , 2009, Autom..

[24]  Jie Sheng,et al.  Convergence of stochastic gradient estimation algorithm for multivariable ARX-like systems , 2010, Comput. Math. Appl..

[25]  Feng Ding,et al.  Partially Coupled Stochastic Gradient Identification Methods for Non-Uniformly Sampled Systems , 2010, IEEE Transactions on Automatic Control.

[26]  Huizhong Yang,et al.  Modelling and identification for non-uniformly periodically sampled-data systems , 2010 .

[27]  Guowei Yang,et al.  Gradient-based iterative parameter estimation for Box-Jenkins systems , 2010, Comput. Math. Appl..

[28]  Huazhen Fang,et al.  Kalman filter-based identification for systems with randomly missing measurements in a network environment , 2010, Int. J. Control.

[29]  Feng Ding,et al.  Least squares based iterative algorithms for identifying Box-Jenkins models with finite measurement data , 2010, Digit. Signal Process..

[30]  Feng Ding,et al.  Parameter estimation with scarce measurements , 2011, Autom..

[31]  Feng Ding,et al.  Hierarchical Least Squares Identification for Linear SISO Systems With Dual-Rate Sampled-Data , 2011, IEEE Transactions on Automatic Control.

[32]  Asier Ibeas,et al.  Multimodel-based techniques for the identification and adaptive control of delayed multi-input multi-output systems , 2011 .

[33]  Feng Ding,et al.  Identification methods for Hammerstein nonlinear systems , 2011, Digit. Signal Process..

[34]  G. Goodwin,et al.  Identification of continuous-time state-space models from non-uniform fast-sampled data , 2011 .

[35]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[36]  Laurent Bako,et al.  Parameterization and identification of multivariable state-space systems: A canonical approach , 2011, Autom..

[37]  Jie Ding,et al.  Bias compensation‐based parameter estimation for output error moving average systems , 2011 .

[38]  D. Wang.  Brief paper: Lleast squares-based recursive and iterative estimation for output error moving average systems using data filtering , 2011 .

[39]  Feng Ding,et al.  Maximum likelihood least squares identification method for input nonlinear finite impulse response moving average systems , 2012, Math. Comput. Model..

[40]  Y. Liu,et al.  Gradient-based and least-squares-based iterative estimation algorithms for multi-input multi-output systems , 2012, J. Syst. Control. Eng..

[41]  Feng Ding,et al.  Performance analysis of the auxiliary model-based least-squares identification algorithm for one-step state-delay systems , 2012, Int. J. Comput. Math..

[42]  Er-Wei Bai,et al.  How Nonlinear Parametric Wiener System Identification is Under Gaussian Inputs? , 2012, IEEE Transactions on Automatic Control.

[43]  Wei Wang,et al.  Maximum likelihood least squares identification for systems with autoregressive moving average noise , 2012 .

[44]  Feng Ding,et al.  Performance Analysis of the Auxiliary Model-Based Stochastic Gradient Parameter Estimation Algorithm for State-Space Systems with One-Step State Delay , 2013, Circuits Syst. Signal Process..

[45]  Feng Ding,et al.  Decomposition based fast least squares algorithm for output error systems , 2013, Signal Process..

[46]  F. Ding.  Two-stage least squares based iterative estimation algorithm for CARARMA system modeling ☆ , 2013 .

[47]  F. Ding.  Hierarchical multi-innovation stochastic gradient algorithm for Hammerstein nonlinear system modeling , 2013 .