A unified wavelet-based modelling framework for non-linear system identification: the WANARX model structure

A new unified modelling framework based on the superposition of additive submodels, functional components, and wavelet decompositions is proposed for non-linear system identification. A non-linear model, which is often represented using a multivariate non-linear function, is initially decomposed into a number of functional components via the well-known analysis of variance (ANOVA) expression, which can be viewed as a special form of the NARX (non-linear autoregressive with exogenous inputs) model for representing dynamic input–output systems. By expanding each functional component using wavelet decompositions including the regular lattice frame decomposition, wavelet series and multiresolution wavelet decompositions, the multivariate non-linear model can then be converted into a linear-in-the-parameters problem, which can be solved using least-squares type methods. An efficient model structure determination approach based upon a forward orthogonal least squares (OLS) algorithm, which involves a stepwise orthogonalization of the regressors and a forward selection of the relevant model terms based on the error reduction ratio (ERR), is employed to solve the linear-in-the-parameters problem in the present study. The new modelling structure is referred to as a wavelet-based ANOVA decomposition of the NARX model or simply WANARX model, and can be applied to represent high-order and high dimensional non-linear systems.

[1]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[2]  Alexander N. Gorban,et al.  Approximation of continuous functions of several variables by an arbitrary nonlinear continuous function of one variable, linear functions, and their superpositions , 1998 .

[3]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[4]  Steve A. Billings,et al.  Term and variable selection for non-linear system identification , 2004 .

[5]  Sheng Chen,et al.  Identification of non-linear output-affine systems using an orthogonal least-squares algorithm , 1988 .

[6]  Xia Hong,et al.  Nonlinear model structure detection using optimum experimental design and orthogonal least squares , 2001, IEEE Trans. Neural Networks.

[7]  T. Kavli.  ASMO—Dan algorithm for adaptive spline modelling of observation data , 1993 .

[8]  Qinghua Zhang,et al.  Using wavelet network in nonparametric estimation , 1997, IEEE Trans. Neural Networks.

[9]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[10]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[11]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[12]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[13]  R. Pearson.  Discrete-time Dynamic Models , 1999 .

[14]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[15]  Daniel Coca,et al.  Non-linear system identification using wavelet multiresolution models , 2001 .

[16]  S. Billings,et al.  DISCRETE WAVELET MODELS FOR IDENTIFICATION AND QUALITATIVE ANALYSIS OF CHAOTIC SYSTEMS , 1999 .

[17]  S. Billings,et al.  Orthogonal parameter estimation algorithm for non-linear stochastic systems , 1988 .

[18]  Zehua Chen.  Fitting Multivariate Regression Functions by Interaction Spline Models , 1993 .

[19]  Stephen A. Billings,et al.  Wavelet based non-parametric NARX models for nonlinear input–output system identification , 2006, Int. J. Syst. Sci..

[20]  Sheng Chen,et al.  Identification of MIMO non-linear systems using a forward-regression orthogonal estimator , 1989 .

[21]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[22]  Sheng Chen,et al.  Non-linear systems identification using radial basis functions , 1990 .

[23]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[24]  Steve A. Billings,et al.  Identification of Time-Varying Systems Using Multiresolution Wavelet Models , 2003 .

[25]  R. Pearson.  Nonlinear Input/Output Modeling , 1994 .

[26]  Guoping Liu,et al.  Nonlinear system identification using wavelet networks , 2000, Int. J. Syst. Sci..

[27]  I. J. Leontaritis,et al.  Parameter Estimation Techniques for Nonlinear Systems , 1982 .

[28]  S. Billings,et al.  Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks , 1996 .

[29]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[30]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  L. Schumaker.  Spline Functions: Basic Theory , 1981 .

[32]  C. Chui,et al.  On compactly supported spline wavelets and a duality principle , 1992 .