A reservoir radial-basis function neural network in prediction tasks

A reservoir radial-basis function neural network, which is based on the ideas of reservoir computing and neural networks and designated for solving extrapolation tasks of nonlinear non-stationary stochastic and chaotic time series under conditions of a short learning sample, is proposed in the paper. The network is built with the help of a radial-basis function neural network with an input layer, which is organized in a special manner and a kernel membership function. The proposed system provides high approximation quality in terms of a mean squared error and a high convergence speed using the second-order learning procedure. A software product that implements the proposed neural network has been developed. A number of experiments have been held in order to research the system’s properties. Experimental results prove the fact that the developed architecture can be used in Data Mining tasks and the fact that the proposed neural network has a higher accuracy compared to traditional forecasting neural systems.

[1]  Henry Markram,et al.  Fading memory and kernel properties of generic cortical microcircuit models , 2004, Journal of Physiology-Paris.

[2]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[3]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[4]  Francis wyffels,et al.  Using reservoir computing in a decomposition approach for time series prediction , 2008 .

[5]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[6]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[7]  V. A. Epanechnikov.  Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[8]  Jürgen Paetz,et al.  Reducing the number of neurons in radial basis function networks with dynamic decay adjustment , 2004, Neurocomputing.

[9]  Jochen J. Steil,et al.  Online stability of backpropagation-decorrelation recurrent learning , 2006, Neurocomputing.

[10]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[11]  Henry Markram,et al.  A New Approach towards Vision Suggested by Biologically Realistic Neural Microcircuit Models , 2002, Biologically Motivated Computer Vision.

[12]  H. Jaeger,et al.  Reservoir riddles: suggestions for echo state network research , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..