An online learning algorithm with adaptive forgetting factors for feedforward neural networks in financial time series forecasting

In this study, an online learning algorithm for feedforward neural networks (FNN) based on the optimized learning rate and adaptive forgetting factor is proposed for online financial time series prediction. The new learning algorithm is developed for online predictions in terms of the gradient descent technique, and can speed up the FNN learning process substantially relative to the standard FNN algorithm, with simultaneous preservation of stability of the learning process. In order to verify the effectiveness and efficiency of the proposed online learning algorithm, two typical financial time series are chosen as testing targets for illustration purposes.

[1]  Guido Deboeck,et al.  Trading on the Edge: Neural, Genetic, and Fuzzy Systems for Chaotic Financial Markets , 1994 .

[2]  Milton S. Boyd,et al.  Forecasting futures trading volume using neural networks , 1995 .

[3]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[4]  Richard P. Brent,et al.  Fast training algorithms for multilayer neural nets , 1991, IEEE Trans. Neural Networks.

[5]  Hideaki Sakai,et al.  A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter , 1992, IEEE Trans. Signal Process..

[6]  Tom Tollenaere,et al.  SuperSAB: Fast adaptive back propagation with good scaling properties , 1990, Neural Networks.

[7]  Mark E. Oxley,et al.  Comparative Analysis of Backpropagation and the Extended Kalman Filter for Training Multilayer Perceptrons , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  John Moody,et al.  Architecture Selection Strategies for Neural Networks: Application to Corporate Bond Rating Predicti , 1995, NIPS 1995.

[9]  Kin Keung Lai,et al.  A novel nonlinear ensemble forecasting model incorporating GLAR and ANN for foreign exchange rates , 2005, Comput. Oper. Res..

[10]  Makoto Kaneko,et al.  An Adaptive Training Method for Human-robot Systems Using Neural Networks , 2000 .

[11]  Kazuo Asakawa,et al.  Stock market prediction system with modular neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[12]  Vladimir B. Bajic,et al.  An on-line hybrid learning algorithm for multilayer perceptron in identification problems , 2002, Comput. Electr. Eng..

[13]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[14]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[15]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[16]  Michael Y. Hu,et al.  Neural network forecasting of the British pound/US dol-lar exchange rate , 1998 .

[17]  Robert J. Marks,et al.  An adaptively trained neural network , 1991, IEEE Trans. Neural Networks.