Fuzzy Echo State Neural Network with Differential Evolution Framework for Time Series Forecasting

In this paper, differential evolution (DE) is used to find optimal weights for echo state neural network model and also to optimize the number of rules of the modeled fuzzy system that presents the input to the echo state neural network (ESNN) model. ESNN designed in this work possess a recurrent neuronal infra-structure called as reservoir. This work aims to develop a good reservoir for the ESNN model employing the coherent features and the ability of the differential evolution algorithm and fuzzy rule base system. DE aims to pre-train the fixed weight values of the network with its effective exploration and exploitation capability and fuzzy rule base system (FRBS) formulates a set of rules, which provides inferences for the inputs presented to the echo state network model. The performance of the developed optimized network is evaluated based on the error metrics and the computational time incurred for the training of the model. The test results of ESNN model using DE and FRBS are compared with that of ESNN without optimization and fuzzy rule to prove its validity and also with the related existing techniques. The perceived DE based fuzzy ESNN model is verified for its effectiveness with a set of time series forecasting benchmark problems. The empirical results prove the superiority and the effectiveness of the DE based fuzzy ESNN learning outcomes.

[1]  Christian Bauckhage,et al.  Using Echo State Networks for Cryptography , 2017, ICANN.

[2]  Claudio Gallicchio,et al.  Design of deep echo state networks , 2018, Neural Networks.

[3]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[4]  John Cotter,et al.  Long-Run Wavelet-Based Correlation for Financial Time Series , 2018, Eur. J. Oper. Res..

[5]  Bo Li,et al.  FluteDB: An efficient and scalable in-memory time series database for sensor-cloud , 2018, J. Parallel Distributed Comput..

[6]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[7]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[8]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[9]  J. A. Tenreiro Machado,et al.  Dynamic stability analysis of fractional order leaky integrator echo state neural networks , 2017, Commun. Nonlinear Sci. Numer. Simul..

[10]  G. Halvani,et al.  Safety performance evaluation in a steel industry: A short-term time series approach , 2018, Safety Science.

[11]  Roger Labahn,et al.  Design Strategies for Weight Matrices of Echo State Networks , 2012, Neural Computation.

[12]  Vladimir Ceperic,et al.  Reducing Complexity of Echo State Networks with Sparse Linear Regression Algorithms , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[13]  Massimo Panella,et al.  A Classification Approach to Modeling Financial Time Series , 2017, Neural Advances in Processing Nonlinear Dynamic Signals.

[14]  Aijun Liu,et al.  Quaternion-Valued Feedforward Neural Network Based Time Series Forecast , 2017, CSPS.

[15]  Shan Liu,et al.  Optimal Forecast Combination Based on Neural Networks for Time Series Forecasting , 2018, Appl. Soft Comput..

[16]  Jianjun Hu,et al.  Anti-oscillation and chaos control of the fractional-order brushless DC motor system via adaptive echo state networks , 2018, J. Frankl. Inst..

[17]  Hongfei Lin,et al.  Wavelet-denoising multiple echo state networks for multivariate time series prediction , 2018, Inf. Sci..

[18]  Adel M. Alimi,et al.  A Hybrid Approach Based on Particle Swarm Optimization for Echo State Network Initialization , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[19]  Z. Faizal Khan,et al.  Automated segmentation of lung images using textural echo state neural networks , 2017, 2017 International Conference on Informatics, Health & Technology (ICIHT).