Online Identification of Nonlinear Spatiotemporal Systems Using Kernel Learning Approach

The identification of nonlinear spatiotemporal systems is of significance to engineering practice, since it can always provide useful insight into the underlying nonlinear mechanism and physical characteristics under study. In this paper, nonlinear spatiotemporal system models are transformed into a class of multi-input-multi-output (MIMO) partially linear systems (PLSs), and an effective online identification algorithm is therefore proposed by using a pruning error minimization principle and least square support vector machines. It is shown that many benchmark physical and engineering systems can be transformed into MIMO-PLSs which keep some important physical spatiotemporal relationships and are very helpful in the identification and analysis of the underlying system. Compared with several existing methods, the advantages of the proposed method are that it can make full use of some prior structural information about system physical models, can realize online estimation of the system dynamics, and achieve accurate characterization of some important nonlinear physical characteristics of the system. This would provide an important basis for state estimation, control, optimal analysis, and design of nonlinear distributed parameter systems. The proposed algorithm can also be applied to identification problems of stochastic spatiotemporal dynamical systems. Numeral examples and comparisons are given to demonstrate our results.

[1]  Stephen A. Billings,et al.  Identification of finite dimensional models of infinite dimensional dynamical systems , 2002, Autom..

[2]  Robert C. Dalang,et al.  The Non-Linear Stochastic Wave Equation in High Dimensions , 2008 .

[3]  Claes Johnson.  Numerical solution of partial differential equations by the finite element method , 1988 .

[4]  Weifeng Liu,et al.  Kernel Adaptive Filtering: A Comprehensive Introduction , 2010 .

[5]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[6]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[7]  Stephen A. Billings,et al.  State-Space Reconstruction and Spatio-Temporal Prediction of Lattice Dynamical Systems , 2007, IEEE Transactions on Automatic Control.

[8]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[9]  S. Chen,et al.  Fast orthogonal least squares algorithm for efficient subset model selection , 1995, IEEE Trans. Signal Process..

[10]  F. Browder.  Nonlinear functional analysis , 1970 .

[11]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[12]  Sheng Chen,et al.  Identification of MIMO non-linear systems using a forward-regression orthogonal estimator , 1989 .

[13]  H. Schober,et al.  Introduction to lattice dynamics , 1995 .

[14]  Chris J. Harris,et al.  On the modelling of nonlinear dynamic systems using support vector neural networks , 2001 .

[15]  Stephen A. Billings,et al.  Model structure selection using an integrated forward orthogonal search algorithm assisted by squared correlation and mutual information , 2008, Int. J. Model. Identif. Control..

[16]  R. Showalter.  Monotone operators in Banach space and nonlinear partial differential equations , 1996 .

[17]  A. Quarteroni,et al.  Numerical Approximation of Partial Differential Equations , 2008 .

[18]  Hannu T. Toivonen,et al.  Identification of state-dependent parameter models with support vector regression , 2007, Int. J. Control.

[19]  Stephen A. Billings,et al.  Neighbourhood detection and identification of spatio-temporal dynamical systems using a coarse-to-fine approach , 2007, Int. J. Syst. Sci..

[20]  Theo J. A. de Vries,et al.  Pruning error minimization in least squares support vector machines , 2003, IEEE Trans. Neural Networks.

[21]  L. Debnath.  Nonlinear Partial Differential Equations for Scientists and Engineers , 1997 .

[22]  Stephen A. Billings,et al.  Identification of partial differential equation models for a class of multiscale spatio-temporal dynamical systems , 2010, Int. J. Control.

[23]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[24]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[25]  Stephen A. Billings,et al.  Lattice Dynamical Wavelet Neural Networks Implemented Using Particle Swarm Optimization for Spatio–Temporal System Identification , 2009, IEEE Transactions on Neural Networks.

[26]  S. Haykin,et al.  Kernel Least‐Mean‐Square Algorithm , 2010 .

[27]  Stephen A. Billings,et al.  Identification of coupled map lattice models for spatio-temporal patterns using wavelets , 2006, Int. J. Syst. Sci..

[28]  Hermann G. Matthies,et al.  Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations , 2005 .

[29]  Martin Stynes,et al.  Numerical Treatment of Partial Differential Equations , 2007 .

[30]  L. Hörmander,et al.  On the existence of real analytic solutions of partial differential equations with constant coefficients , 1973 .

[31]  Zhimin Zhang,et al.  Finite element and difference approximation of some linear stochastic partial differential equations , 1998 .

[32]  Weifeng Liu,et al.  Kernel Adaptive Filtering , 2010 .

[33]  Matthias Gerdts,et al.  Numerical optimal control of the wave equation: optimal boundary control of a string to rest in finite time , 2008, Math. Comput. Simul..

[34]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[35]  Johan A. K. Suykens,et al.  Kernel based partially linear models and nonlinear identification , 2005, IEEE Transactions on Automatic Control.

[36]  Rong Chen,et al.  Online weighted LS-SVM for hysteretic structural system identification , 2006 .

[37]  Johan A. K. Suykens,et al.  Optimal control by least squares support vector machines , 2001, Neural Networks.

[38]  Carlo Novara,et al.  Set Membership identification of nonlinear systems , 2004, Autom..

[39]  René Carmona,et al.  Stochastic Partial Differential Equations: Six Perspectives , 1998 .

[40]  Paul Honeine,et al.  Online Prediction of Time Series Data With Kernels , 2009, IEEE Transactions on Signal Processing.

[41]  Jian Zhang,et al.  Novel support vector regression for structural system identification , 2007 .

[42]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[43]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[44]  Lennart Ljung,et al.  Regressor selection with the analysis of variance method , 2005, Autom..

[45]  Hyek Yoo,et al.  Semi-discretization of stochastic partial differential equations on R1 by a finite-difference method , 2000, Math. Comput..

[46]  D. Russell.  Controllability and Stabilizability Theory for Linear Partial Differential Equations: Recent Progress and Open Questions , 1978 .

[47]  Martin T. Dove,et al.  Introduction to Lattice Dynamics: Contents , 1993 .

[48]  Adrian Constantin,et al.  Nonlinear water waves , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[49]  Ping Li,et al.  Selective recursive kernel learning for online identification of nonlinear systems with NARX form , 2010 .