Identification of nonlinear dynamical system using hierarchical clustering analysis and local linear models

This paper discusses the use of unsupervised learning and localized modeling to identify nonlinear dynamical systems from empirical series data. A finite-order nonlinear autoregressive (AR) model is constructed to capture the system dynamics. The embedded input space for the nonlinear AR model is partitioned into overlapped regions that are fine enough so that localized modeling techniques, such as local linear modeling, can approximate system dynamics well in each region. Subsequently, unsupervised learning, such as hierarchical clustering analysis, is used for partitioning the embedded input space to achieve the tradeoff between the model complexity and the approximation error. The performance of the proposed approach is evaluated on two numerical examples: (i) time series prediction; (ii) identification of SISO system. Simulation results demonstrate that the proposed approach can capture the nonlinear system dynamics well.

[1]  A. N. Jha,et al.  Nonlinear System Identification using Neural Networks , 2007 .

[2]  Niels Kjølstad Poulsen,et al.  Neural Networks for Modelling and Control of Dynamic Systems: A Practitioner’s Handbook , 2000 .

[3]  J. Sjöberg.  Neural networks for modelling and control of dynamic systems: M. Nørgaard, O. Ravn, N. K. Poulsen and L. K. Hansen. Springer-Verlag, London Berlin Heidelberg, 2000, pp. xiv+246 , 2004 .

[4]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[5]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[6]  V. Syrmos,et al.  Optimal cluster selection based on Fisher class separability measure , 2005, Proceedings of the 2005, American Control Conference, 2005..

[7]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[8]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[9]  Marcello R. Napolitano,et al.  Aircraft failure detection and identification using neural networks , 1993 .

[10]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[11]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[12]  L. Tsimring,et al.  The analysis of observed chaotic data in physical systems , 1993 .

[13]  J. Príncipe,et al.  Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control , 1998, Proc. IEEE.

[14]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[15]  K S Narendra,et al.  IDENTIFICATION AND CONTROL OF DYNAMIC SYSTEMS USING NEURAL NETWORKS , 1990 .

[16]  Peter S. Maybeck,et al.  Reconfigurable flight control via multiple model adaptive control methods , 1991 .

[17]  Johan A. K. Suykens,et al.  Nonlinear system identification using neural networks , 1996 .