A novel dynamic recurrent functional link neural network-based identification of nonlinear systems using Lyapunov stability analysis

In this paper, a novel dynamic recurrent functional link neural network (DRFLNN) is proposed for the identification of unknown dynamics of the nonlinear systems. The proposed structure contains a self-feedback loop(s) as well as the adjustable weighted feed-through of the input signals to the output neuron(s). A learning algorithm is developed using the combination of Lyapunov stability and dynamic back-propagation method and is applied to derive the stable parameter adjustment equations. The performance evaluation of the proposed DRFLNN model is done by comparing it with the multi-layer perceptron (consisting of a single hidden layer), radial basis function network, Elman recurrent neural network (ERNN), nonlinear auto-regressive moving average, and the conventional functional link neural network. Three benchmark systems have been used on which all these models are applied. From the results, it is found that ERNN provided better prediction accuracy as compared to the remaining models and the second-best accuracy is obtained from the proposed model. Further, the ERNN model is more complex and offers more parameters to be tuned as compared to the DRFLNN model. Thus, the training of the ERNN model is quite difficult as compared to the DRFLNN.

[1]  Khashayar Khorasani,et al.  Constructive feedforward neural networks using Hermite polynomial activation functions , 2005, IEEE Transactions on Neural Networks.

[2]  Guilherme De A. Barreto,et al.  Long-term time series prediction with the NARX network: An empirical evaluation , 2008, Neurocomputing.

[3]  Snehashish Chakraverty,et al.  Hermite Functional Link Neural Network for Solving the Van der Pol–Duffing Oscillator Equation , 2016, Neural Computation.

[4]  Tanvi Gupta,et al.  Prediction of compressive and flexural strengths of jarosite mixed cement concrete pavements using artificial neural networks , 2019 .

[5]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[6]  Jianzhou Wang,et al.  Forecasting wind speed using empirical mode decomposition and Elman neural network , 2014, Appl. Soft Comput..

[7]  Rudra Prakash Maheshwari,et al.  Improved Fault Classification in Series Compensated Transmission Line: Comparative Evaluation of Chebyshev Neural Network Training Algorithms , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Tom Murray,et al.  Predicting sun spots using a layered perceptron neural network , 1996, IEEE Trans. Neural Networks.

[9]  H. Gish,et al.  A probabilistic approach to the understanding and training of neural network classifiers , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[10]  Jagdish Chandra Patra,et al.  Nonlinear dynamic system identification using Legendre neural network , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[11]  Goutam Chakraborty,et al.  Legendre-FLANN-based nonlinear channel equalization in wireless communication system , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[12]  Pierre Baldi,et al.  Programmed interactions in higher-order neural networks: Maximal capacity , 1991, J. Complex..

[13]  Rozaida Ghazali,et al.  Functional Link Neural Network - Artificial Bee Colony for Time Series Temperature Prediction , 2013, ICCSA.

[14]  Seppo J. Ovaska,et al.  A modified Elman neural network model with application to dynamical systems identification , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[15]  Aistis Raudys,et al.  Comparison of ARMA and Multilayer Perceptron Based Methods for Economic Time Series Forecasting , 1999, Informatica.

[16]  Snehashish Chakraverty,et al.  Functional link neural network approach to solve structural system identification problems , 2017, Neural Computing and Applications.

[17]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[18]  Orly Yadid-Pecht,et al.  Modified high-order neural network for invariant pattern recognition , 2005, Pattern Recognit. Lett..

[19]  Smriti Srivastava,et al.  Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion. , 2017, ISA transactions.

[20]  Jiashu Zhang,et al.  Nonlinear dynamic system identification using pipelined functional link artificial recurrent neural network , 2009, Neurocomputing.

[21]  Eugen Diaconescu,et al.  The use of NARX neural networks to predict chaotic time series , 2008 .

[22]  Smriti Srivastava,et al.  Comparative study of neural networks for dynamic nonlinear systems identification , 2019, Soft Comput..

[23]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[24]  Okyay Kaynak,et al.  A type-2 fuzzy wavelet neural network for system identification and control , 2013, J. Frankl. Inst..

[25]  Smriti Srivastava,et al.  Modeling and adaptive control of nonlinear dynamical systems using radial basis function network , 2017, Soft Comput..

[26]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[27]  Colin Giles,et al.  Learning, invariance, and generalization in high-order neural networks. , 1987, Applied optics.

[28]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[29]  Liang Li,et al.  Nonlinear adaptive prediction of nonstationary signals , 1995, IEEE Trans. Signal Process..

[30]  Guoqiang Peter Zhang,et al.  An investigation of model selection criteria for neural network time series forecasting , 2001, Eur. J. Oper. Res..