Genetic algorithm for reservoir computing optimization

This paper presents reservoir computing optimization using Genetic Algorithm. Reservoir Computing is a new paradigm for using artificial neural networks. Despite its promising performance, Reservoir Computing has still some drawbacks: the reservoir is created randomly; the reservoir needs to be large enough to be able to capture all the features of the data. We propose here a method to optimize the choice of global parameters using genetic algorithm. This method was applied on a real problem of time series forecasting. The time of search for the best global parameters with GA was just 22.22% of the time- consuming task to an exhausting search of the same parameters.

[1]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[2]  Elias S. Manolakos,et al.  Using recurrent neural networks for adaptive communication channel equalization , 1994, IEEE Trans. Neural Networks.

[3]  Benjamin Schrauwen,et al.  The Introduction of Time-Scales in Reservoir Computing, Applied to Isolated Digits Recognition , 2007, ICANN.

[4]  Lakhmi C. Jain,et al.  Automatic generation of a neural network architecture using evolutionary computation , 1995, Proceedings Electronic Technology Directions to the Year 2000.

[5]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[6]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[7]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[8]  Benjamin Schrauwen,et al.  Event Detection and Localization in Mobile Robot Navigation Using Reservoir Computing , 2007, ICANN.

[9]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[10]  David B. Fogel,et al.  Evolutionary algorithms in theory and practice , 1997, Complex.

[11]  Teresa Bernarda Ludermir,et al.  Investigating the use of Reservoir Computing for forecasting the hourly wind speed in short -term , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[12]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[13]  K. Warwick,et al.  Dynamic recurrent neural network for system identification and control , 1995 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Teresa Bernarda Ludermir,et al.  Using Reservoir Computing for Forecasting Time Series: Brazilian Case Study , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[16]  José Carlos Príncipe,et al.  Water Inflow Forecasting using the Echo State Network: a Brazilian Case Study , 2007, 2007 International Joint Conference on Neural Networks.

[17]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[18]  Herbert Jaeger,et al.  A tutorial on training recurrent neural networks , covering BPPT , RTRL , EKF and the " echo state network " approach - Semantic Scholar , 2005 .

[19]  Gordon Pipa,et al.  2007 Special Issue: Fading memory and time series prediction in recurrent networks with different forms of plasticity , 2007 .