Hammerstein system identification through best linear approximation inversion and regularisation

ABSTRACT Hammerstein systems are composed by the cascading of a static nonlinearity and a linear system. In this paper, a methodology for identifying such systems using a combination of least squares support vector machines (LS-SVM) and best linear approximation (BLA) techniques is proposed. To do this, a novel method for estimating the intermediate variable is presented allowing a clear separation of the identification steps. First, an approximation to the linear block is obtained through the BLA of the system. Then, an approximation to the intermediate variable is obtained using the inversion of the estimated linear block and the known output. Afterwards, a nonlinear model is calculated through LS-SVM using the estimated intermediate variable and the known input. To do this, the regularisation capabilities of LS-SVM play a crucial role. Finally, a parametric re-estimation of the linear block is made. The method was tested in three examples, two of them with hard nonlinearities, and was compared with four other methods showing very good performance in all cases. The obtained results demonstrate that also in the presence of noise, the method can effectively identify Hammerstein systems. The relevance of these findings lies in the fact that it is shown how the regularisation allows to bypass the usual problems associated with the noise backpropagation when the inversion of the estimated linear block is used to compute the intermediate variable.

[1]  K. U. Leuven A COMPARATIVE STUDY OF LS-SVM’S APPLIED TO THE SILVER BOX IDENTIFICATION PROBLEM , 2004 .

[2]  Rik Pintelon,et al.  System Identification: A Frequency Domain Approach , 2012 .

[3]  A. Janczak,et al.  Identification of Nonlinear Systems Using Neural Networks and Polynomial Models: A Block-Oriented Approach , 2004 .

[4]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[5]  Johan A. K. Suykens,et al.  Least-Squares Support Vector Machines for the Identification of Wiener-Hammerstein Systems , 2012 .

[6]  Robert Haber Nonlinear System Identification : Input-output Modeling Approach , 1999 .

[7]  Andrzej Janczak Identification of Nonlinear Systems Using Neural Networks and Polynomial Models , 2005 .

[8]  Julian J. Bussgang,et al.  Crosscorrelation functions of amplitude-distorted gaussian signals , 1952 .

[9]  Johan A. K. Suykens,et al.  Wiener-Hammerstein Benchmark , 2009 .

[10]  Johan Schoukens,et al.  Initial estimates of Wiener and Hammerstein systems using multisine excitation , 2001, IEEE Trans. Instrum. Meas..

[11]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[12]  P. Young,et al.  Stochastic, Dynamic Modelling and Signal Processing: Time Variable and State Dependent Parameter Estimation , 2000 .

[13]  Biao Huang,et al.  Identification of Hammerstein systems without explicit parameterisation of non-linearity , 2009, Int. J. Control.

[14]  K. Narendra,et al.  An iterative method for the identification of nonlinear systems using a Hammerstein model , 1966 .

[15]  Minyue Fu,et al.  A blind approach to Hammerstein model identification , 2002, IEEE Trans. Signal Process..

[16]  J. Schoukens,et al.  Parametric and nonparametric identification of linear systems in the presence of nonlinear distortions-a frequency domain approach , 1998, IEEE Trans. Autom. Control..

[17]  Akira Sano,et al.  Identification of a dynamical system with input nonlinearity , 1999 .

[18]  P. Young,et al.  Identification of non-linear stochastic systems by state dependent parameter estimation , 2001 .

[19]  Yves Rolain,et al.  Mastering System Identification in 100 Exercises , 2012 .

[20]  Johan A. K. Suykens,et al.  Identification of MIMO Hammerstein models using least squares support vector machines , 2005, Autom..

[21]  Johan A. K. Suykens,et al.  Fixed-Size LS-SVM Applied to the Wiener-Hammerstein Benchmark , 2009 .

[22]  Er-Wei Bai,et al.  Decoupling the linear and nonlinear parts in Hammerstein model identification , 2004, Autom..

[23]  Johan A. K. Suykens,et al.  Coupled Simulated Annealing , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Alan R. Jones,et al.  Fast Fourier Transform , 1970, SIGP.

[25]  Kang Li,et al.  Convergence of the iterative algorithm for a general Hammerstein system identification , 2010, Autom..

[26]  Johan A. K. Suykens,et al.  Identification of Wiener-Hammerstein Systems using LS-SVMs , 2009 .

[27]  E. Bai,et al.  Block Oriented Nonlinear System Identification , 2010 .

[28]  Romain Ravaud,et al.  Time-varying non linear modeling of electrodynamic loudspeakers , 2009 .

[29]  Johan A. K. Suykens,et al.  Incorporating Best Linear Approximation within LS-SVM-based Hammerstein System Identification , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[30]  Er-Wei Bai An optimal two-stage identification algorithm for Hammerstein-Wiener nonlinear systems , 1998, Autom..

[31]  Stephen A. Billings,et al.  Identification of systems containing linear dynamic and static nonlinear elements , 1982, Autom..

[32]  Er-Wei Bai Frequency domain identification of Hammerstein models , 2003, IEEE Trans. Autom. Control..