FINANCIAL TIME SERIES FORECASTING BY NEURAL NETWORK USING CONJUGATE GRADIENT LEARNING ALGORITHM AND MULTIPLE LINEAR REGRESSION WEIGHT INITIALIZATION

Multilayer neural network has been successfully applied to the time series forecasting. Backpropagation, a popular learning algorithm, converges slowly and has the difficulty in determining the network parameters. In this paper, conjugate gradient learning algorithm with restart procedure is introduced to overcome these problems. Also, the commonly used random weight initialization does not guarantee to generate a set of initial connection weights close to the optimal weights leading to slow convergence. Multiple linear regression (MLR) provides an alternative for weight initialization. The daily trade data of the listed companies from Shanghai Stock Exchange is collected for technical analysis with the means of neural networks. Two learning algorithms and two weight initializations are compared. The results find that neural networks can model the time series satisfactorily. The proposed conjugate gradient with MLR weight initialization requires a lower computation cost and learns better than backpropagation with random initialization.

[1]  Guido Deboeck,et al.  Trading on the Edge: Neural, Genetic, and Fuzzy Systems for Chaotic Financial Markets , 1994 .

[2]  Olve Maudal Preprocessing data for Neural Network based Classifiers - Rough Sets vs Principal Component Analysis , 1996 .

[3]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[4]  Bhaskar Dasgupta,et al.  Classifying trend movements in the MSCI U.S.A. capital market index - A comparison of regression, arima and neural network methods , 1996, Comput. Oper. Res..

[5]  Feipei Lai,et al.  An intelligent trend prediction and reversal recognition system using dual-module neural networks , 1991, Proceedings First International Conference on Artificial Intelligence Applications on Wall Street.

[6]  Donald C. Wunsch,et al.  Advanced neural network training methods for low false alarm stock trend prediction , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[7]  William H. Press,et al.  Numerical recipes in C , 2002 .

[8]  Donald C. Wunsch,et al.  Probabilistic and Time-Delay Techniques for Conservative Short-term Stock Trend Prediction , 1995 .

[9]  Emile Fiesler,et al.  High-order and multilayer perceptron initialization , 1997, IEEE Trans. Neural Networks.

[10]  B. Malkiel A Random Walk Down Wall Street , 1973 .

[11]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[12]  Achilleas Zapranis,et al.  Stock performance modeling using neural networks: A comparative study with regression models , 1994, Neural Networks.

[13]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[14]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[15]  Casimir C. Klimasauskas Neural networks for , 1996 .

[16]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[17]  Atam P. Dhawan,et al.  Use of genetic algorithms with backpropagation in training of feedforward neural networks , 1993, IEEE International Conference on Neural Networks.

[18]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[19]  Efraim Turban,et al.  Neural Networks in Finance and Investing: Using Artificial Intelligence to Improve Real-World Performance , 1992 .

[20]  Jae Kyu Lee,et al.  Artificial Intelligence in Finance & Investing: State-of-the-Art Technologies for Securities Selection and Portfolio Management , 1995 .

[21]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[22]  H. White,et al.  Economic prediction using neural networks: the case of IBM daily stock returns , 1988, IEEE 1988 International Conference on Neural Networks.

[23]  David F. Shanno,et al.  Conjugate Gradient Methods with Inexact Searches , 1978, Math. Oper. Res..

[24]  Chris Bishop,et al.  Exact Calculation of the Hessian Matrix for the Multilayer Perceptron , 1992, Neural Computation.

[25]  Edward Gately Neural networks for financial forecasting , 1995 .

[26]  Jukka Saarinen,et al.  Initializing Weights of a Multilayer Perceptron Network by Using the Orthogonal Least Squares Algorithm , 1995, Neural Computation.

[27]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[28]  Robert J. Kauffman,et al.  Comparing the Modeling Performance of Regression and Neural Networks as Data Quality Varies: A Business Value Approach , 1993, J. Manag. Inf. Syst..

[29]  Leorey Marquez,et al.  Neural network models as an alternative to regression , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[30]  Masaaki Kijima,et al.  THEORY AND ALGORITHMS OF , 1988 .

[31]  David M. Skapura,et al.  Building neural networks , 1995 .

[32]  M. S. Bazaraa,et al.  Nonlinear Programming , 1979 .

[33]  S. Achelis Technical analysis a to z , 1994 .