Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control

The technique of local linear models is appealing for modeling complex time series due to the weak assumptions required and its intrinsic simplicity. Here, instead of deriving the local models from the data, we propose to estimate them directly from the weights of a self-organizing map (SOM), which functions as a dynamic preserving model of the dynamics. We introduce one modification to the Kohonen learning to ensure good representation of the dynamics and use weighted least squares to ensure continuity among the local models. The proposed scheme is tested using synthetic chaotic time series and real-world data. The practicality of the method is illustrated in the identification and control of the NASA Langley wind tunnel during aerodynamic tests of model aircraft. Modeling the dynamics with an SOM lends to a predictive multiple model control strategy. Comparison of the new controller against the existing controller in test runs shows the superiority of our method.

[1]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[2]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[3]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[4]  M. Priestley STATE‐DEPENDENT MODELS: A GENERAL APPROACH TO NON‐LINEAR TIME SERIES ANALYSIS , 1980 .

[5]  F. Takens Detecting strange attractors in turbulence , 1981 .

[6]  P. Grassberger,et al.  Characterization of Strange Attractors , 1983 .

[7]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[8]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[9]  Sawada,et al.  Measurement of the Lyapunov spectrum from a chaotic time series. , 1985, Physical review letters.

[10]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[11]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[12]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[13]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[14]  James P. Crutchfield,et al.  Equations of Motion from a Data Series , 1987, Complex Syst..

[15]  秦 浩起,et al.  Characterization of Strange Attractor (カオスとその周辺(基研長期研究会報告)) , 1987 .

[16]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[17]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[18]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[19]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[20]  S. P. Luttrell,et al.  Self-organisation: a derivation from first principles of a class of learning algorithms , 1989, International 1989 Joint Conference on Neural Networks.

[21]  Stephen M. Hammel,et al.  A noise reduction method for chaotic systems , 1990 .

[22]  James A. Yorke,et al.  Noise Reduction: Finding the Simplest Dynamical System Consistent with the Data , 1989 .

[23]  H. Abarbanel,et al.  Lyapunov exponents from observed time series. , 1990, Physical review letters.

[24]  Stanley C. Ahalt,et al.  Competitive learning algorithms for vector quantization , 1990, Neural Networks.

[25]  Grebogi,et al.  Using chaos to direct trajectories to targets. , 1990, Physical review letters.

[26]  Jörg A. Walter,et al.  Nonlinear prediction with self-organizing maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[27]  Helge Ritter,et al.  Learning with the Self-Organizing Map , 1991 .

[28]  Vladimir Cherkassky,et al.  Constrained topological mapping for nonparametric regression analysis , 1991, Neural Networks.

[29]  Giona,et al.  Functional reconstruction and local prediction of chaotic time series. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[30]  J.J. Sidorowich,et al.  Modeling of chaotic time series for prediction, interpolation, and smoothing , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[31]  Andrew C. Singer,et al.  Codebook prediction: a nonlinear signal modeling paradigm , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  L. Tsimring,et al.  The analysis of observed chaotic data in physical systems , 1993 .

[33]  Vladimir Cherkassky,et al.  Adaptive knot Placement for Nonparametric Regression , 1993, NIPS.

[34]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[35]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[36]  José Carlos Príncipe,et al.  Dynamic Modelling of Chaotic Time Series with Neural Networks , 1994, NIPS.

[37]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[38]  Ying-Cheng Lai,et al.  Controlling chaos , 1994 .

[39]  Simon Haykin,et al.  Detection of signals in chaos , 1995, Proc. IEEE.

[40]  Kumpati S. Narendra,et al.  Adaptation and learning using multiple models, switching, and tuning , 1995 .

[41]  F J Capone,et al.  The NASA Langley 16-Foot Transonic Tunnel---Historical Overview, Facility Description, Calibration, Flow Characteristics, Test Capabilities , 1995 .

[42]  J.C. Principe,et al.  Non-linear time series modeling with self-organization feature maps , 1995, Proceedings of 1995 IEEE Workshop on Neural Networks for Signal Processing.

[43]  Helge J. Ritter,et al.  Rapid learning with parametrized self-organizing maps , 1996, Neurocomputing.

[44]  Vladimir Cherkassky,et al.  Comparison of adaptive methods for function estimation from samples , 1996, IEEE Trans. Neural Networks.

[45]  Gustavo Deco,et al.  Dynamic modeling of chaotic time series by neural networks , 1997, Annual Conference Computational Learning Theory.

[46]  Snehasis Mukhopadhyay,et al.  Adaptive control using neural networks and approximate models , 1997, IEEE Trans. Neural Networks.

[47]  Kumpati S. Narendra,et al.  Adaptive control using multiple models , 1997, IEEE Trans. Autom. Control..

[48]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[49]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[50]  S. Haykin,et al.  Making sense of a complex world [chaotic events modeling] , 1998, IEEE Signal Process. Mag..