Although a large number of researches have been carried out into the analysis of nonlinear phenomena, little is reported about using reinforcement learning, which is widely used in artificial intelligent, intelligent control, and other fields. Here, we consider the problem of chaotic time series using a self-organized fuzzy neural network and reinforcement learning, in particular, a learning algorithm called Stochastic Gradient Ascent(SGA). The proposed fuzzy neural network is similar to a radial basis function network(RBFN), but has self-organization ability dealing with its dynamical inputs,and provides stochastic outputs. The outputs are values of predicted time series, which called actions in reinforcement learning. After feeding some training data of chaotic time series to the initial frame of system, the structure and synaptic weights will be organized, and the predictor begins to provide correct dynamics of time series. Applying our proposed method to the Lorenz system, we obtained a high accuracy estimation of short-term prediction, and a reasonable result of long-term prediction.
[1]
Richard S. Sutton,et al.
Reinforcement Learning: An Introduction
,
1998,
IEEE Trans. Neural Networks.
[2]
Henry Leung,et al.
Prediction of noisy chaotic time series using an optimal radial basis function neural network
,
2001,
IEEE Trans. Neural Networks.
[3]
A. Vannucci,et al.
Using artificial neural networks to forecast chaotic time series
,
2000
.
[4]
Shigenobu Kobayashi,et al.
Reinforcement learning for continuous action using stochastic gradient ascent
,
1998
.
[5]
Martin Casdagli,et al.
Nonlinear prediction of chaotic time series
,
1989
.
[6]
Vassilis S. Kodogiannis,et al.
Forecasting Financial Time Series using Neural Network and Fuzzy System-based Techniques
,
2002,
Neural Computing & Applications.
[7]
Jerry M. Mendel,et al.
Generating fuzzy rules by learning from examples
,
1991,
Proceedings of the 1991 IEEE International Symposium on Intelligent Control.