Recursive generalized extended least squares and RML algorithms for identification of bilinear systems with ARMA noise.

Bilinear systems are considered as a particular class of nonlinear systems including the state variables which are typically used for online identification. By using a recursive identification method and the maximum likelihood principle, this paper presents two recursive-based algorithms to identify the parameters of bilinear in parameter systems with ARMA noise. In this regard, recursive generalized extended least squares (RGELS) and recursive Maximum Likelihood (RML) algorithms have been proposed for identification of bilinear systems. These algorithms can be used as an alternative choice in system identification with acceptable performance. The proposed algorithms estimate the correlated noise parameters with high accuracy by making full use of the measurement data. Simulation results indicate that the proposed algorithms are effective for online identification of bilinear in parameter systems with high convergence speed.

[1]  Yi Yang,et al.  Constrained two dimensional recursive least squares model identification for batch processes , 2014 .

[2]  Feng Ding,et al.  Maximum likelihood least squares identification method for input nonlinear finite impulse response moving average systems , 2012, Math. Comput. Model..

[3]  Feng Ding,et al.  Decomposition Based Newton Iterative Identification Method for a Hammerstein Nonlinear FIR System with ARMA Noise , 2014, Circuits Syst. Signal Process..

[4]  Feng Ding,et al.  The Gradient-Based Iterative Estimation Algorithms for Bilinear Systems with Autoregressive Noise , 2017, Circuits, Systems, and Signal Processing.

[5]  Feng Ding,et al.  Iterative Identification Algorithms for Bilinear-in-parameter Systems by Using the Over-parameterization Model and the Decomposition , 2018 .

[6]  Xianku Zhang,et al.  Multi-innovation auto-constructed least squares identification for 4 DOF ship manoeuvring modelling with full-scale trial data. , 2015, ISA transactions.

[7]  Jacob Benesty,et al.  Adaptive filtering for the identification of bilinear forms , 2018, Digit. Signal Process..

[8]  F. Ding,et al.  Least-squares-based iterative and gradient-based iterative estimation algorithms for bilinear systems , 2017 .

[9]  Petre Stoica,et al.  Estimation of the parameters of a bilinear model with applications to submarine detection and system identification , 2007, Digit. Signal Process..

[10]  Richard W. Longman,et al.  Linear state representations for identification of bilinear discrete-time models by interaction matrices , 2014 .

[11]  Jong-Keol Song,et al.  Seismic Fragility Analysis of Seismically Isolated Nuclear Power Plant Structures using Equivalent Linear- and Bilinear- Lead Rubber Bearing Model. , 2015 .

[12]  Feng Ding,et al.  Decomposition-based recursive least squares identification methods for multivariate pseudo-linear systems using the multi-innovation , 2018, Int. J. Syst. Sci..

[13]  Feng Ding,et al.  Kalman state filtering based least squares iterative parameter estimation for observer canonical state space systems using decomposition , 2016, J. Comput. Appl. Math..

[14]  Feng Ding,et al.  Recursive least squares algorithm and gradient algorithm for Hammerstein–Wiener systems using the data filtering , 2016 .

[15]  Torsten Söderström,et al.  Accuracy analysis of time domain maximum likelihood method and sample maximum likelihood method for errors-in-variables and output error identification , 2010, Autom..

[16]  Guoqi Li,et al.  Fixed point iteration in identifying bilinear models , 2015, Syst. Control. Lett..

[17]  Feng Ding,et al.  Combined state and parameter estimation for a bilinear state space system with moving average noise , 2018, J. Frankl. Inst..

[18]  L. Ljung,et al.  Recursive identification of bilinear systems , 1987 .

[19]  Dongqing Wang,et al.  Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed models , 2016, Appl. Math. Lett..

[20]  Xianqiang Yang,et al.  Local Identification of LPV Dual-Rate System With Random Measurement Delays , 2018, IEEE Transactions on Industrial Electronics.

[21]  C. H. Chen,et al.  Maximum likelihood identification of stochastic Weiner-Hammerstein-type non-linear systems , 1992 .

[22]  Feng Ding,et al.  The maximum likelihood least squares based iterative estimation algorithm for bilinear systems with autoregressive moving average noise , 2017, J. Frankl. Inst..

[23]  Muhammad Saeed Aslam.  Maximum likelihood least squares identification method for active noise control systems with autoregressive moving average noise , 2016, Autom..

[24]  Christian Bauckhage,et al.  Human activity recognition by separating style and content , 2014, Pattern Recognit. Lett..

[25]  Ah Chung Tsoi,et al.  Nonlinear considerations in EEG signal classification , 1997, IEEE Trans. Signal Process..

[26]  Ling Xu,et al.  Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration , 2015 .

[27]  Feng Ding,et al.  Recursive Least Squares Parameter Estimation for a Class of Output Nonlinear Systems Based on the Model Decomposition , 2016, Circuits Syst. Signal Process..

[28]  Meihang Li,et al.  The least squares based iterative algorithms for parameter estimation of a bilinear system with autoregressive noise using the data filtering technique , 2018, Signal Process..

[29]  F. Ding,et al.  Filtering-based recursive least-squares identification algorithm for controlled autoregressive moving average systems using the maximum likelihood principle , 2015 .

[30]  Aliasghar Arab,et al.  An adaptive gradient descent-based local search in memetic algorithm applied to optimal controller design , 2015, Inf. Sci..

[31]  F. Ding,et al.  The filtering based maximum likelihood recursive least squares estimation for multiple-input single-output systems ☆ , 2016 .

[32]  Interval estimation for a simple bilinear model , 2013 .

[33]  R. Mohler.  An Overview of Bilinear System Theory and Applications , 1980 .

[34]  J. Schoukens,et al.  Blind Maximum Likelihood Identification of Hammerstein Systems , 2008 .

[35]  Feng Ding,et al.  The recursive least squares identification algorithm for a class of Wiener nonlinear systems , 2016, J. Frankl. Inst..

[36]  K. Narendra,et al.  An iterative method for the identification of nonlinear systems using a Hammerstein model , 1966 .

[37]  Yovani Marrero-Ponce,et al.  Novel 3D bio-macromolecular bilinear descriptors for protein science: Predicting protein structural classes. , 2015, Journal of theoretical biology.

[38]  Feng Ding,et al.  Joint state and multi-innovation parameter estimation for time-delay linear systems and its convergence based on the Kalman filtering , 2017, Digit. Signal Process..

[39]  F. Ding,et al.  Maximum likelihood gradient-based iterative estimation algorithm for a class of input nonlinear controlled autoregressive ARMA systems , 2015 .

[40]  F. Alsaadi,et al.  Recursive parameter identification of the dynamical models for bilinear state space systems , 2017 .

[41]  Jianqiang Pan,et al.  A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems , 2017 .

[42]  Er-Wei Bai,et al.  Least squares solutions of bilinear equations , 2006, Syst. Control. Lett..

[43]  T. Amemiya.  The nonlinear limited-information maximum- likelihood estimator and the modified nonlinear two-stage least-squares estimator , 1975 .

[44]  Tadao Kasami,et al.  A Trellis-Based Recursive Maximum-Likelihood Decoding Algorithm for Binary Linear Block Codes , 1998, IEEE Trans. Inf. Theory.

[45]  Weihua Gui,et al.  Event-Based Fault Detection Filtering for Complex Networked Jump Systems , 2018, IEEE/ASME Transactions on Mechatronics.

[46]  Feng Ding,et al.  Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model , 2016, Autom..

[47]  Maryam Dehghani,et al.  Identification of multivariable nonlinear systems in the presence of colored noises using iterative hierarchical least squares algorithm. , 2014, ISA transactions.

[48]  Feng Ding,et al.  Least squares based iterative algorithms for identifying Box-Jenkins models with finite measurement data , 2010, Digit. Signal Process..

[49]  Tianhong Pan,et al.  Recursive Bayesian Algorithm with Covariance Resetting for Identification of Box–Jenkins Systems with Non-uniformly Sampled Input Data , 2016, Circuits Syst. Signal Process..

[50]  Xinggao Liu,et al.  Recursive maximum likelihood method for the identification of Hammerstein ARMAX system , 2016 .

[51]  Qibing Jin,et al.  A novel optimization algorithm for MIMO Hammerstein model identification under heavy-tailed noise. , 2017, ISA transactions.

[52]  Justin Romberg,et al.  Fast and Guaranteed Blind Multichannel Deconvolution Under a Bilinear System Model , 2016, IEEE Transactions on Information Theory.

[53]  L. Peng,et al.  INFERENCE FOR A SPECIAL BILINEAR TIME‐SERIES MODEL , 2014, 1405.3029.

[54]  Brett Ninness,et al.  Maximum-likelihood parameter estimation of bilinear systems , 2005, IEEE Transactions on Automatic Control.

[55]  Feng Ding,et al.  Filtering-Based Maximum Likelihood Gradient Iterative Estimation Algorithm for Bilinear Systems with Autoregressive Moving Average Noise , 2018, Circuits Syst. Signal Process..

[56]  M. Arefi,et al.  A fast iterative recursive least squares algorithm for Wiener model identification of highly nonlinear systems. , 2017, ISA transactions.

[57]  Nicholas Kalouptsidis,et al.  Blind identification of bilinear systems , 2003, IEEE Trans. Signal Process..