Nonlinear system identification by the Haar multiresolution analysis

The paper deals with the problem of reconstruction of nonlinearities in a certain class of nonlinear systems of composite structure from their input-output observations when prior information about the system is poor, thus excluding the standard parametric approach to the problem. The multiresolution idea, being the fundamental concept of modern wavelet theory, is adopted, and the Haar multiresolution analysis in particular is applied to construct nonparametric identification techniques of nonlinear characteristics. The pointwise convergence properties of the proposed identification algorithms are established. Conditions for the convergence are given; and for nonlinearities satisfying a local Lipschitz condition, the rate of convergence is evaluated, With applications in mind, the problem of data-driven selection of the optimum resolution degree in the identification procedure, essential for the multiresolution analysis, is considered as well. The theory is verified by computer simulations.

[1]  Miroslaw Pawlak,et al.  Nonparametric identification of a cascade nonlinear time series system , 1991, Signal Process..

[2]  Bernard Delyon,et al.  Nonlinear black-box models in system identification: Mathematical foundations , 1995, Autom..

[3]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[4]  Heinz Unbehauen,et al.  Structure identification of nonlinear dynamic systems - A survey on input/output approaches , 1990, Autom..

[5]  Stanley H. Johnson,et al.  Use of Hammerstein Models in Identification of Nonlinear Systems , 1991 .

[6]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[7]  W. Sethares,et al.  Suboptimal identification of nonlinear ARMA models using an orthogonality approach , 1995 .

[8]  M. C. Jones,et al.  Spline Smoothing and Nonparametric Regression. , 1989 .

[9]  Prakasa Rao.  Nonparametric functional estimation , 1983 .

[10]  L. Devroye,et al.  Nonparametric Density Estimation: The L 1 View. , 1985 .

[11]  J. Engel.  Density estimation with Haar series , 1990 .

[12]  E. Rafajłowicz,et al.  On optimal global rate of convergence of some nonparametric identification procedures , 1989 .

[13]  M. Pawlak,et al.  Nonparametric identification of a particular nonlinear time series system , 1992, IEEE Trans. Signal Process..

[14]  G. Walter.  Wavelets and other orthogonal systems with applications , 1994 .

[15]  Richard L. Wheeden.  Measure and integral , 1977 .

[16]  J. P. Norton,et al.  An Introduction to Identification , 1986 .

[17]  S. E. Kelly,et al.  Pointwise convergence of wavelet expansions , 1994, math/9401221.

[18]  A. Krzyżak.  Identification of discrete Hammerstein systems by the Fourier series regression estimate , 1989 .

[19]  M. Pawlak,et al.  On nonparametric identification of cascade nonlinear systems , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[20]  M. Pawlak.  On the series expansion approach to the identification of Hammerstein systems , 1991 .

[21]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[22]  I. W. Sandberg.  Approximation theorems for discrete-time systems , 1991, [1991] Proceedings of the 34th Midwest Symposium on Circuits and Systems.

[23]  Hai-Wen Chen,et al.  Modeling and identification of parallel nonlinear systems: structural classification and parameter estimation methods , 1995, Proc. IEEE.

[24]  D. Brillinger.  The identification of a particular nonlinear time series system , 1977 .

[25]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[26]  M. Pawlak.  On the almost everywhere properties of the kernel regression estimate , 1991 .

[27]  W. Greblicki,et al.  Identification of discrete Hammerstein systems using kernel regression estimates , 1986 .

[28]  Stephen A. Billings,et al.  Identi cation of nonlinear systems-A survey , 1980 .

[29]  Adam Krzyzak,et al.  On estimation of a class of nonlinear systems by the kernel regression estimate , 1990, IEEE Trans. Inf. Theory.

[30]  W. Greblicki,et al.  Cascade non-linear system identification by a non-parametric method , 1994 .

[31]  Miroslaw Pawlak,et al.  Nonparametric identification of Hammerstein systems , 1989, IEEE Trans. Inf. Theory.

[32]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[33]  S. Mallat.  Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[34]  W. Härdle,et al.  How Far are Automatically Chosen Regression Smoothing Parameters from their Optimum , 1988 .

[35]  Peter Hall,et al.  Formulae for Mean Integrated Squared Error of Nonlinear Wavelet-Based Density Estimators , 1995 .

[36]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[37]  I. W. Sandberg.  Approximation theorems for discrete-time systems , 1991 .

[38]  W. Greblicki,et al.  Fourier and Hermite series estimates of regression functions , 1985 .

[39]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[40]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[41]  W. Greblicki.  Nonparametric identification of Wiener systems by orthogonal series , 1994, IEEE Trans. Autom. Control..

[42]  Leszek Rutkowski,et al.  A general approach for nonparametric fitting of functions and their derivatives with applications to linear circuits identification , 1986 .

[43]  Wolfgang Härdle,et al.  Applied Nonparametric Regression , 1991 .

[44]  Miroslaw Pawlak,et al.  Dynamic system identification with order statistics , 1994, IEEE Trans. Inf. Theory.