Relationship between levels of persistent excitation, architectures of neural networks and deterministic learning performance

Based on the concept of persistent excitation (PE), a deterministic learning algorithm is proposed for neural network (NN)-based identification of nonlinear systems recently. This paper investigates the quantitative relationship between the PE levels (including the level of excitation), the architectures of NNs and the convergence properties of deterministic learning, which is motivated by a practical problem of how to construct the NNs in order to guarantee sufficient level of excitation and identification accuracy for specific system trajectories. The results on PE levels are utilized to analyze the deterministic learning performance. It is proven that by increasing the density of NN centers, the approximation capabilities of NNs increase but the level of excitation decreases, which means that a trade-off exists in the convergence accuracy when adjusting NN architectures.

[1]  Junfei Qiao,et al.  An efficient self-organizing RBF neural network for water quality prediction , 2011, Neural Networks.

[2]  O. Rössler.  An equation for continuous chaos , 1976 .

[3]  Jianghai Hu,et al.  Variable Neural Adaptive Robust Control: A Switched System Approach , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Robert M. Sanner,et al.  Stable Recursive Identification Using Radial Basis Function Networks , 1992, 1992 American Control Conference.

[5]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[6]  David J. Hill,et al.  Deterministic Learning Theory , 2009 .

[7]  Cong Wang,et al.  Learning from neural control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[8]  Songwu Lu,et al.  Robust nonlinear system identification using neural-network models , 1998, IEEE Trans. Neural Networks.

[9]  Hao Yu,et al.  An Incremental Design of Radial Basis Function Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Dimitry M. Gorinevsky,et al.  On the persistency of excitation in radial basis function network identification of nonlinear systems , 1995, IEEE Trans. Neural Networks.

[11]  Yu Gong,et al.  Online Modeling With Tunable RBF Network , 2013, IEEE Transactions on Cybernetics.

[12]  Cong Wang,et al.  Rapid Detection of Small Oscillation Faults via Deterministic Learning , 2011, IEEE Transactions on Neural Networks.

[13]  F. J. Narcowich,et al.  Persistency of Excitation in Identification Using Radial Basis Function Approximants , 1995 .

[14]  Martin D. Buhmann,et al.  Radial Basis Functions , 2021, Encyclopedia of Mathematical Geosciences.

[15]  X. Liu,et al.  Adaptive Neural Control of Pure-Feedback Nonlinear Time-Delay Systems via Dynamic Surface Technique , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Chong Lin,et al.  Neural-based adaptive output-feedback control for a class of nonlinear systems , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[17]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Cong Wang,et al.  Persistency of excitation and performance of deterministic learning , 2011, Proceedings of the 30th Chinese Control Conference.

[19]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[20]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[21]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[22]  Cong Wang,et al.  Deterministic Learning and Rapid Dynamical Pattern Recognition , 2007, IEEE Transactions on Neural Networks.

[23]  Holger Wendland,et al.  Sobolev bounds on functions with scattered zeros, with applications to radial basis function surface fitting , 2004, Math. Comput..

[24]  Antonio Loría,et al.  Uniform exponential stability of linear time-varying systems: revisited , 2002, Syst. Control. Lett..