Blind identification of quadratic nonlinear models using neural networks with higher order cumulants

A novel approach to blindly estimate kernels of any discrete- and finite-extent quadratic models in higher order cumulants domain based on artificial neural networks is proposed in this paper. The input signal is assumed an unobservable independently identically, distributed random sequence which is viable for engineering practice. Because of the properties of the third-order cumulant functions, identifiability of the nonlinear model holds, even when the model output measurement is corrupted by a Gaussian random disturbance. The proposed approach enables a nonlinear relationship between model kernels and model output cumulants to be established by means of neural networks. The approximation ability of the neural network with the weights-decoupled extended Kalman filter training algorithm is then used to estimate the model parameters. Theoretical statements and simulation examples together with practical application to the train vibration signals modeling corroborate that the developed methodology is capable of providing a very promising way to identify truncated Volterra models blindly.

[1]  Vasilis Z. Marmarelis,et al.  Volterra models and three-layer perceptrons , 1997, IEEE Trans. Neural Networks.

[2]  Vladik Kreinovich,et al.  Arbitrary nonlinearity is sufficient to represent all functions by neural networks: A theorem , 1991, Neural Networks.

[3]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[4]  K S Narendra,et al.  Control of nonlinear dynamical systems using neural networks. II. Observability, identification, and control , 1996, IEEE Trans. Neural Networks.

[5]  Tommy W. S. Chow,et al.  Semiblind identification of nonminimum-phase ARMA models via order recursion with higher order cumulants , 1998, IEEE Trans. Ind. Electron..

[6]  Edward J. Powers,et al.  Adaptive estimation of third-order frequency domain Volterra kernels , 1996 .

[7]  Francesco Palmieri,et al.  Optimal filtering algorithms for fast learning in feedforward neural networks , 1992, Neural Networks.

[8]  Kumpati S. Narendra,et al.  Identification Using Feedforward Networks , 1995, Neural Computation.

[9]  Nicholas Kalouptsidis,et al.  Nonlinear system identification using Gaussian inputs , 1995, IEEE Trans. Signal Process..

[10]  G. Sicuranza Quadratic filters for signal processing , 1992, Proc. IEEE.

[11]  Tommy W. S. Chow,et al.  Third-order cumulant RLS algorithm for nonminimum ARMA systems identification , 1997, Signal Process..

[12]  P. Bondon On the identifiability of a quadratic stochastic system , 1993, [1993 Proceedings] IEEE Signal Processing Workshop on Higher-Order Statistics.

[13]  Tommy W. S. Chow,et al.  An accelerated recurrent network training algorithm using IIR filter model and recursive least squares method , 1997 .

[14]  Anuradha M. Annaswamy,et al.  Θ-adaptive Neural Networks: a New Approach to Parameter Estimation , 1996, IEEE Trans. Neural Networks.

[15]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[16]  R.J. Cohen,et al.  Linear and nonlinear ARMA model parameter estimation using an artificial neural network , 1997, IEEE Transactions on Biomedical Engineering.

[17]  Mark E. Oxley,et al.  Comparative Analysis of Backpropagation and the Extended Kalman Filter for Training Multilayer Perceptrons , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Tommy W. S. Chow,et al.  Extended least squares based algorithm for training feedforward networks , 1997, IEEE Trans. Neural Networks.

[19]  Stanislaw Osowski,et al.  Multilayer neural network structure as Volterra filter , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.