A genetic network programming with learning approach for enhanced stock trading model

In this paper, an enhancement of stock trading model using Genetic Network Programming (GNP) with Sarsa Learning is described. There are three important points in this paper: First, we use GNP with Sarsa Learning as the basic algorithm while both Technical Indices and Candlestick Charts are introduced for efficient stock trading decision-making. In order to create more efficient judgment functions to judge the current stock price appropriately, Importance Index (IMX) has been proposed to tell GNP the timing of buying and selling stocks. Second, to improve the performance of the proposed GNP-Sarsa algorithm, we proposed a new method that can learn the appropriate function describing the relation between the value of each technical index and the value of the IMX. This is an important point that devotes to the enhancement of the GNP-Sarsa algorithm. The third point is that in order to create more efficient judgment functions, sub-nodes are introduced in each node to select appropriate stock price information depending on the situations and to determine appropriate actions (buying/selling). To confirm the effectiveness of the proposed method, we carried out the simulation and compared the results of GNP-Sarsa with other methods like GNP with Actor Critic, GNP with Candlestick Chart, GA and Buy&Hold method. The results shows that the stock trading model using GNP-Sarsa outperforms all the other methods.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  Shingo Mabu,et al.  Trading Rules on Stock Markets Using Genetic Network Programming with Candle Chart , 2007 .

[3]  Norio Baba,et al.  Utilization of soft computing techniques for constructing reliable decision support systems for dealing stocks , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[4]  Shingo Mabu,et al.  Trading rules on stock markets using genetic network programming with reinforcement learning and importance index , 2007 .

[5]  Shingo Mabu,et al.  Genetic Network Programming with Reinforcement Learning and Its Application to Making Mobile Robot Behavior , 2006 .

[6]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[7]  Filippo Petroni,et al.  Inverse Statistics in the Foreign Exchange Market , 2004 .

[8]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[9]  Jean-Yves Potvin,et al.  Generating trading rules on the stock markets with genetic programming , 2004, Comput. Oper. Res..

[10]  Tae Yoon Kim,et al.  Portfolio algorithm based on portfolio beta using genetic algorithm , 2006, Expert Syst. Appl..

[11]  Hitoshi Iba,et al.  Using genetic programming to predict financial data , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[12]  Baikunth Nath,et al.  A fusion model of HMM, ANN and GA for stock market forecasting , 2007, Expert Syst. Appl..

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  Kotaro Hirasawa,et al.  A study of evolutionary multiagent models based on symbiosis , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Tae Yoon Kim,et al.  Using genetic algorithm to support portfolio optimization for index fund management , 2005, Expert Syst. Appl..

[16]  Shingo Mabu,et al.  A Graph-Based Evolutionary Algorithm: Genetic Network Programming (GNP) and Its Extension Using Reinforcement Learning , 2007, Evolutionary Computation.

[17]  Yang Han,et al.  A neural network model based on the multi-stage optimization approach for short-term food price forecasting in China , 2007, Expert Syst. Appl..

[18]  Po-Chang Ko,et al.  Resource allocation neural network in portfolio selection , 2008, Expert Syst. Appl..

[19]  Shingo Mabu,et al.  Genetic network programming with sarsa learning and its application to creating stock trading rules , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  Vasant Dhar A Comparison of GLOWER and other Machine Learning Methods for Investment Decision Making , 2001, EPIA.

[21]  Shingo Mabu,et al.  Trading Rules on the Stock Markets using Genetic Network Programming with Candlestick Chart , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[22]  Kyungjik Lee,et al.  Expert system for predicting stock market timing using a candlestick chart , 1999 .

[23]  Sergio Gómez,et al.  Portfolio selection using neural networks , 2005, Comput. Oper. Res..

[24]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[25]  Thomas Mikosch,et al.  Stock Market Risk-Return Inference. An Unconditional, Non-Parametric Approach. , 2003 .

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[27]  Chang-Chun Lin,et al.  Genetic algorithms for portfolio selection problems with minimum transaction lots , 2008, Eur. J. Oper. Res..

[28]  Shingo Mabu,et al.  Genetic network programming with actor-critic and its application to stock trading model , 2007, GECCO '07.