Applying Polynomial Decoupling Methods to the Polynomial NARX Model

Abstract System identification uses measurements of a dynamic system’s input and output to reconstruct a mathematical model for that system. These can be mechanical, electrical, physiological, among others. Since most of the systems around us exhibit some form of nonlinear behavior, nonlinear system identification techniques are the tools that will help us gain a better understanding of our surroundings and potentially let us improve their performance. One model that is often used to represent nonlinear systems is the polynomial NARX model, an equation error model where the output is a polynomial function of the past inputs and outputs. That said, a major disadvantage with the polynomial NARX model is that the number of parameters increases rapidly with increasing polynomial order. Furthermore, the polynomial NARX model is a black-box model, and is therefore difficult to interpret. This paper discusses a decoupling algorithm for the polynomial NARX model that substitutes the multivariate polynomial with a transformation matrix followed by a bank of univariate polynomials. This decreases the number of model parameters significantly and also imposes structure on the black-box NARX model. Since a non-convex optimization is required for this identification technique, initialization is an important factor to consider. In this paper the decoupling algorithm is developed in conjunction with several different initialization techniques. The resulting algorithms are applied to two nonlinear benchmark problems: measurement data from the Silver-Box and simulation data from the Bouc-Wen friction model, and the performance is evaluated for different validation signals in both simulation and prediction.

[1]  Johan Schoukens,et al.  Decoupling Multivariate Polynomials Using First-Order Information and Tensor Decompositions , 2014, SIAM J. Matrix Anal. Appl..

[2]  Fei He,et al.  A new NARX-based Granger linear and nonlinear casual influence detection method with applications to EEG data , 2013, Journal of Neuroscience Methods.

[3]  S. Billings,et al.  Recursive algorithm for computing the frequency response of a class of non-linear difference equation models , 1989 .

[4]  K. Worden,et al.  Past, present and future of nonlinear system identification in structural dynamics , 2006 .

[5]  Ravindra Jategaonkar,et al.  Aerodynamic Modeling and System Identification from Flight Data , 2005, Journal of Aerospace Sciences and Technologies.

[6]  Johan Schoukens,et al.  A nonlinear state-space approach to hysteresis identification , 2016, ArXiv.

[7]  J. M. Caswell A Nonlinear Autoregressive Approach to Statistical Prediction of Disturbance Storm Time Geomagnetic Fluctuations Using Solar Data , 2014 .

[8]  Maria del Carmen Pegalajar Jiménez,et al.  An Application of Non-Linear Autoregressive Neural Networks to Predict Energy Consumption in Public Buildings , 2016 .

[9]  Johan Schoukens,et al.  Initial estimates of the linear subsystems of Wiener-Hammerstein models , 2012, Autom..

[10]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[11]  David T. Westwick,et al.  Identification of Stretch Reflex Dynamics from Closed-Loop Data , 2015 .

[12]  L. Piroddi,et al.  An identification algorithm for polynomial NARX models based on simulation error minimization , 2003 .

[13]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[14]  Lennart Ljung,et al.  Perspectives on system identification , 2010, Annu. Rev. Control..

[15]  Mehrdad Arashpour,et al.  Application of Nonlinear-Autoregressive-Exogenous model to predict the hysteretic behaviour of passive control systems , 2015 .

[16]  Liqi Wang,et al.  On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors , 2014, SIAM J. Matrix Anal. Appl..

[17]  Lennart Ljung,et al.  Nonlinear System Identification: A User-Oriented Road Map , 2019, IEEE Control Systems.

[18]  Johan Schoukens,et al.  Parameter reduction in nonlinear state-space identification of hysteresis , 2017, ArXiv.

[19]  Keith Worden,et al.  On evolutionary system identification with applications to nonlinear benchmarks , 2018, Mechanical Systems and Signal Processing.

[20]  Jean-Philippe Noël,et al.  Three Benchmarks Addressing Open Challenges in Nonlinear System Identification , 2017 .

[21]  Agathe Girard,et al.  Dynamic systems identification with Gaussian processes , 2005 .

[22]  Jean-Philippe Noël,et al.  Nonlinear system identification in structural dynamics: 10 more years of progress , 2017 .

[23]  Anriëtte Bekker,et al.  System identification and tracking using a statistical model and a Kalman filter , 2019, Mechanical Systems and Signal Processing.

[24]  J. Schoukens,et al.  Using Decoupling Methods to Reduce Polynomial NARX Models , 2018 .

[25]  Lennart Ljung,et al.  Nonlinear System Identification: A User-Oriented Road Map , 2019, IEEE Control Systems.

[26]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[27]  J. Schoukens,et al.  Recovering Wiener-Hammerstein nonlinear state-space models using linear algebra* , 2015 .

[28]  Satish Nagarajaiah,et al.  A novel unscented Kalman filter for recursive state-input-system identification of nonlinear systems , 2019, Mechanical Systems and Signal Processing.

[29]  Armin Shmilovici,et al.  Adaptive Matching Pursuit of Narx Models with Spline Basis Functions , 1999, Int. J. Syst. Sci..

[30]  S. Billings Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains , 2013 .

[31]  Mustafa Unel,et al.  Predicting NOx emissions in diesel engines via sigmoid NARX models using a new experiment design for combustion identification , 2019, Measurement.

[32]  Jean-Philippe Noël,et al.  Cross-fertilising research in nonlinear system identification between the mechanical, control and machine learning fields , 2019, Mechanical Systems and Signal Processing.

[33]  Rik Pintelon,et al.  System Identification: A Frequency Domain Approach , 2012 .

[34]  Rik Pintelon,et al.  Linear System Identification in a Nonlinear Setting: Nonparametric Analysis of the Nonlinear Distortions and Their Impact on the Best Linear Approximation , 2016, IEEE Control Systems.