Optimality analysis of the Two-Stage Algorithm for Hammerstein system identification

The Two-Stage Algorithm (TSA) has been extensively used and adapted for the identification of Hammerstein systems. It is essentially based on a particular formulation of Hammerstein systems in the form of bilinearly parameterized linear regressions. This paper has been motivated by a somewhat contradictory fact: though the optimality of the TSA has been established by Bai in 1998 only in the case of some special weighting matrices, the unweighted TSA is usually used in practice. It is shown in this paper that the unweighted TSA indeed gives the optimal solution of the weighted nonlinear least-squares problem formulated with a particular weighting matrix. This provides a theoretical justification of the unweighted TSA, and leads to a generalization of the obtained result to the case of colored noise with noise whitening. Numerical examples of identification of Hammerstein systems are presented to validate the theoretical analysis.

[1]  E. Bai.  An optimal two stage identification algorithm for Hammerstein-Wiener nonlinear systems , 1998 .

[2]  Dennis S. Bernstein,et al.  SUBSPACE IDENTIFICATION OF PERIODICALLY SWITCHING HAMMERSTEIN-WIENER MODELS FOR MAGNETOSPHERIC DYNAMICS1 , 2006 .

[3]  R. Luus,et al.  A noniterative method for identification using Hammerstein model , 1971 .

[4]  C. Tomasi,et al.  Systems of Bilinear Equations , 1997 .

[5]  Er-Wei Bai,et al.  Least squares solutions of bilinear equations , 2006, Syst. Control. Lett..

[6]  Petre Stoica,et al.  Estimation of the parameters of a bilinear model with applications to submarine detection and system identification , 2007, Digit. Signal Process..

[7]  Georges Bastin,et al.  An estimator of the inverse covariance matrix and its application to ML parameter estimation in dynamical systems , 2001, Autom..

[8]  A. Janczak,et al.  Identification of Nonlinear Systems Using Neural Networks and Polynomial Models: A Block-Oriented Approach , 2004 .

[9]  A. Zinober.  Matrices: Methods and Applications , 1992 .

[10]  Enrique Baeyens,et al.  Identification of block-oriented nonlinear systems using orthonormal bases , 2004 .

[11]  Enrique Baeyens,et al.  Subspace-based Identification Algorithms for Hammerstein and Wiener Models , 2005, Eur. J. Control.

[12]  Tomas McKelvey,et al.  On identification of harnmerstein systems using excitation with a finite number of levels , 2003 .

[13]  Johan A. K. Suykens,et al.  Identification of MIMO Hammerstein models using least squares support vector machines , 2005, Autom..

[14]  Robert Haber.  Nonlinear System Identification : Input-output Modeling Approach , 1999 .

[15]  GRZEGORZ MZYK.  Zastosowanie metody zmiennych instrumentalnych do identyfikacji systemów Hammersteina-Wienera , 2001 .