Nonlinear system identification and fault detection using hierarchical clustering analysis and local linear models

This paper discusses the use of unsupervised learning and localized modeling to identify nonlinear dynamical systems from empirical data. A finite-order nonlinear autoregressive (AR) model is constructed to capture the system dynamics. The embedded input space for the nonlinear AR model is partitioned into overlapped regions that are fine enough so that localized modeling techniques, such as local linear modeling, can approximate system dynamics well in each region. Subsequently, unsupervised learning, such as hierarchical clustering analysis, is used for partitioning the embedded input space to achieve the tradeoff between the model complexity and the approximation error. The performance of the proposed nonlinear system identification is evaluated on two numerical examples: (i) time series prediction; (ii) identification of SISO system. Intelligent fault detection scheme is designed based on the identified linear models. Simulation results demonstrate that the proposed approach can capture the nonlinear system dynamics well and correctly detect the faults.

[1]  Niels Kjølstad Poulsen,et al.  Neural Networks for Modelling and Control of Dynamic Systems: A Practitioner’s Handbook , 2000 .

[2]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[3]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[4]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[5]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[6]  Hussain N. Al-Duwaish,et al.  Nonlinear System Identification Using Neural Networks , 2003 .

[7]  J. Slot,et al.  Dynamics of kinks in modulated crystals , 1988 .

[8]  James J. Carroll,et al.  Approximation of nonlinear systems with radial basis function neural networks , 2001, IEEE Trans. Neural Networks.

[9]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[10]  K S Narendra,et al.  IDENTIFICATION AND CONTROL OF DYNAMIC SYSTEMS USING NEURAL NETWORKS , 1990 .

[11]  Peter S. Maybeck,et al.  Reconfigurable flight control via multiple model adaptive control methods , 1990, 29th IEEE Conference on Decision and Control.

[12]  J. Sjöberg.  Neural networks for modelling and control of dynamic systems: M. Nørgaard, O. Ravn, N. K. Poulsen and L. K. Hansen. Springer-Verlag, London Berlin Heidelberg, 2000, pp. xiv+246 , 2004 .

[13]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[14]  V. Syrmos,et al.  Optimal cluster selection based on Fisher class separability measure , 2005, Proceedings of the 2005, American Control Conference, 2005..

[15]  A. N. Jha,et al.  Nonlinear System Identification using Neural Networks , 2007 .

[16]  L. Tsimring,et al.  The analysis of observed chaotic data in physical systems , 1993 .

[17]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[18]  Marcello R. Napolitano,et al.  Aircraft failure detection and identification using neural networks , 1993 .

[19]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[20]  J. Príncipe,et al.  Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control , 1998, Proc. IEEE.

[21]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.