Prediction and identification of discrete-time dynamic nonlinear systems based on adaptive echo state network

In this paper, a new prediction and identification method based on adaptive echo state network (AESN) is proposed to identify a class of discrete-time dynamic nonlinear systems (DDNS). Firstly, according to the characteristics of input signals, the reservoir state update equation of AESN can be adaptively adjusted. In order to guarantee the echo state property of AESN, a sufficient condition for echo state property is given. Secondly, the reservoir parameters of AESN are optimized to improve the identification and prediction performance of AESN. Thirdly, an improved online output weights learning method based on historical reservoir state and output error is given. Finally, the effectiveness of the proposed method is verified by simulation examples.

[1]  Maryam Dehghani,et al.  Identification of multivariable nonlinear systems in the presence of colored noises using iterative hierarchical least squares algorithm. , 2014, ISA transactions.

[2]  Jiabin Wang,et al.  Functional echo state network for time series classification , 2016, Inf. Sci..

[3]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Jun Wang,et al.  Chaotic Time Series Prediction Based on a Novel Robust Echo State Network , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Xin Zhang,et al.  Online adaptive dynamic programming based on echo state networks for dissolved oxygen control , 2018, Appl. Soft Comput..

[7]  Xiangping Zeng,et al.  Identification of Nonlinear Dynamic System Using a Novel Recurrent Wavelet Neural Network Based on the Pipelined Architecture , 2014, IEEE Transactions on Industrial Electronics.

[8]  Lorenzo Livi,et al.  Determination of the Edge of Criticality in Echo State Networks Through Fisher Information Maximization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Zhihong Man,et al.  A New Adaptive Backpropagation Algorithm Based on Lyapunov Stability Theory for Neural Networks , 2006, IEEE Transactions on Neural Networks.

[10]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[11]  Derong Liu,et al.  Energy consumption prediction of office buildings based on echo state networks , 2016, Neurocomputing.

[12]  Rajesh Kumar,et al.  Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates , 2018, Neurocomputing.

[13]  Sankaran Mahadevan,et al.  Fuzzy stochastic neural network model for structural system identification , 2017 .

[14]  Ahmad M El-Nagar.  Nonlinear dynamic systems identification using recurrent interval type-2 TSK fuzzy neural network - A novel structure. , 2018, ISA transactions.

[15]  Chih-Min Lin,et al.  Self-evolving function-link interval type-2 fuzzy neural network for nonlinear system identification and control , 2017, Neurocomputing.

[16]  Vladimir Ceperic,et al.  Echo State Networks for Black-Box Modeling of Integrated Circuits , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[17]  Petia D. Koprinkova-Hristova,et al.  Learning to decode human emotions with Echo State Networks , 2016, Neural Networks.

[18]  O. Nelles.  Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models , 2000 .

[19]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[20]  Bjarne Foss,et al.  Echo State Networks for data-driven downhole pressure estimation in gas-lift oil wells , 2017, Neural Networks.

[21]  Junfei Qiao,et al.  Growing Echo-State Network With Multiple Subreservoirs , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Huaguang Zhang,et al.  Identification method for a class of periodic discrete-time dynamic nonlinear systems based on Sinusoidal ESN , 2018, Neurocomputing.

[23]  Petia Koprinkova-Hristova,et al.  Heuristic dynamic programming using echo state network as online trainable adaptive critic , 2012 .

[24]  Liqian Dou,et al.  Identification of nonlinear aeroelastic system using fuzzy wavelet neural network , 2016, Neurocomputing.

[25]  Enrico Zio,et al.  Ensemble of optimized echo state networks for remaining useful life prediction , 2017, Neurocomputing.

[26]  A. C. Gonçalves,et al.  Identification model of an accidental drop of a control rod in PWR reactors using thermocouple readings and radial basis function neural networks , 2017 .

[27]  I. Chairez.  Adaptive Neural Network Nonparametric Identifier With Normalized Learning Laws. , 2017, IEEE transactions on neural networks and learning systems.

[28]  Min Han,et al.  Laplacian Echo State Network for Multivariate Time Series Prediction , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Min Han,et al.  Online designed of Echo State Network based on Particle Swarm Optimization for system identification , 2011, 2011 2nd International Conference on Intelligent Control and Information Processing.

[30]  Jang Myung Lee,et al.  Fuzzy Echo State Neural Networks and Funnel Dynamic Surface Control for Prescribed Performance of a Nonlinear Dynamic System , 2014, IEEE Transactions on Industrial Electronics.

[31]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[32]  M. Gupta,et al.  Approximation of discrete-time state-space trajectories using dynamic recurrent neural networks , 1995, IEEE Trans. Autom. Control..

[33]  Lorenzo Livi,et al.  Investigating echo state networks dynamics by means of recurrence analysis , 2016, IEEE Trans. Neural Networks Learn. Syst..

[34]  Shu-Xian Lun,et al.  A new echo state network with variable memory length , 2016, Inf. Sci..

[35]  Omar Aguilar-Leal,et al.  Distributed parameter system identification using finite element differential neural networks , 2016, Appl. Soft Comput..

[36]  Dianhui Wang,et al.  A decentralized training algorithm for Echo State Networks in distributed big data applications , 2016, Neural Networks.

[37]  Peter Michael Young,et al.  A tighter bound for the echo state property , 2006, IEEE Transactions on Neural Networks.

[38]  Bo Yan,et al.  Beam Structure Damage Identification Based on BP Neural Network and Support Vector Machine , 2014 .

[39]  Lei Wang,et al.  Design of polynomial echo state networks for time series prediction , 2018, Neurocomputing.

[40]  Jun Song,et al.  Observer-based finite-time passive control for a class of uncertain time-delayed Lipschitz nonlinear systems , 2014 .

[41]  Mohammad Teshnehlab,et al.  Designing and Implementation of Stable Sinusoidal Rough-Neural Identifier , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[42]  S. Purushothaman,et al.  Application of Echo State Neural Network in Identification of Microcalcification in Breast , 2016 .

[43]  Yusuf Oysal,et al.  Fuzzy Wavelet Neural Network Models for Prediction and Identification of Dynamical Systems , 2010, IEEE Transactions on Neural Networks.

[44]  Stefan J. Kiebel,et al.  Re-visiting the echo state property , 2012, Neural Networks.

[45]  Eric Fock,et al.  Global Sensitivity Analysis Approach for Input Selection and System Identification Purposes—A New Framework for Feedforward Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Anis Sellami,et al.  Robust H∞ sliding mode observer design for fault estimation in a class of uncertain nonlinear systems with LMI optimization approach , 2012 .

[47]  Min Han,et al.  Adaptive Elastic Echo State Network for Multivariate Time Series Prediction , 2016, IEEE Transactions on Cybernetics.