Simultaneous optimization of artificial neural networks for financial forecasting

Artificial neural networks (ANNs) have been popularly applied for stock market prediction, since they offer superlative learning ability. However, they often result in inconsistent and unpredictable performance in the prediction of noisy financial data due to the problems of determining factors involved in design. Prior studies have suggested genetic algorithm (GA) to mitigate the problems, but most of them are designed to optimize only one or two architectural factors of ANN. With this background, the paper presents a global optimization approach of ANN to predict the stock price index. In this study, GA optimizes multiple architectural factors and feature transformations of ANN to relieve the limitations of the conventional backpropagation algorithm synergistically. Experiments show our proposed model outperforms conventional approaches in the prediction of the stock price index.

[1]  Kai Ming Ting,et al.  Discretisation in Lazy Learning Algorithms , 1997, Artificial Intelligence Review.

[2]  Donald R. Cooper,et al.  Business Research Methods , 1980 .

[3]  Jack Sklansky,et al.  A neural network that explains as well as predicts financial market behavior , 1997, Proceedings of the IEEE/IAFE 1997 Computational Intelligence for Financial Engineering (CIFEr).

[4]  Kenneth DeJong,et al.  Feature Space Transformation Using Genetic Algorithms , 1998, IEEE Intell. Syst..

[5]  Paul D. Scott,et al.  Forming Categories in Exploratory Data Analysis and Data Mining , 1997, IDA.

[6]  Geert Wets,et al.  An initial comparison of a fuzzy neural classifier and a decision tree based classifier , 1998 .

[7]  Randall S Sexton,et al.  Employee turnover: a neural network solution , 2005, Comput. Oper. Res..

[8]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[9]  Shichao Zhang,et al.  Shell-neighbor method and its application in missing data imputation , 2011, Applied Intelligence.

[10]  S. Achelis.  Technical analysis a to z , 1994 .

[11]  Richard J. Bauer,et al.  Genetic Algorithms and Investment Strategies , 1994 .

[12]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[13]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[14]  Khosrow Kaikhah,et al.  Variable Hidden Layer Sizing in Elman Recurrent Neuro-Evolution , 2004, Applied Intelligence.

[15]  Randall S. Sexton,et al.  Toward global optimization of neural networks: A comparison of the genetic algorithm and backpropagation , 1998, Decis. Support Syst..

[16]  Tatsuo Higuchi,et al.  Efficient learning of NN-MLP based on individual evolutionary algorithm , 1996, Neurocomputing.

[17]  Constantin Zopounidis,et al.  Application of the Rough Set Approach to Evaluation of Bankruptcy Risk , 1995 .

[18]  Iren Valova,et al.  Bridging the fuzzy, neural and evolutionary paradigms for automatic target recognition , 2011, Applied Intelligence.

[19]  Mohd Wazir Mustafa,et al.  Hybrid neural genetic and fuzzy logic approach for real-time tuning of PID controller in AVR system , 2013 .

[20]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[21]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[22]  Benjamin W. Wah,et al.  Global Optimization for Neural Network Training , 1996, Computer.

[23]  Randall S. Sexton,et al.  Improving Decision Effectiveness of Artificial Neural Networks: A Modified Genetic Algorithm Approach , 2003, Decis. Sci..

[24]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[25]  An-Sing Chen,et al.  Application of Neural Networks to an Emerging Financial Market: Forecasting and Trading the Taiwan Stock Index , 2001, Comput. Oper. Res..

[26]  Bahram Alidaee,et al.  Global optimization for artificial neural networks: A tabu search application , 1998, Eur. J. Oper. Res..

[27]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[28]  Kyung-shik Shin,et al.  A genetic algorithm application in bankruptcy prediction modeling , 2002, Expert Syst. Appl..

[29]  Huan Liu,et al.  IEEE Intelligent Systems , 2019, Computer.

[30]  Carol E. Brown,et al.  Artificial neural networks in accounting and finance: modeling issues , 2000 .

[31]  Nicolas Durand,et al.  Neural Nets Trained by Genetic Algorithms for Collision Avoidance , 2000, Applied Intelligence.

[32]  Usama M. Fayyad,et al.  Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning , 1993, IJCAI.

[33]  Randall S. Sexton,et al.  Identifying irrelevant input variables in chaotic time series problems : Using the genetic algorithm for training neural networks , 1998 .

[34]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[35]  Sancho Salcedo-Sanz,et al.  A Hybrid Neural-Genetic Algorithm for the Frequency Assignment Problem in Satellite Communications , 2005, Applied Intelligence.

[36]  James V. Hansen,et al.  Comparative performance of backpropagation networks designed by genetic algorithms and heuristics , 1998, Intell. Syst. Account. Finance Manag..

[37]  Elli Gifford.  Investor's guide to technical analysis : prediction price action in the markets , 1995 .

[38]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[39]  E. Wegman,et al.  A Genetic Algorithm for Best Subset Selection in Linear Regression , 1996 .

[40]  Hojjat Adeli,et al.  Machine Learning: Neural Networks, Genetic Algorithms, and Fuzzy Systems , 1994 .

[41]  Ingoo Han,et al.  Optimal signal multi-resolution by genetic algorithms to support artificial neural networks for exchange-rate forecasting , 2000 .

[42]  Ingoo Han,et al.  Neuro-genetic approach for bankruptcy prediction: a comparison to back-propagation algorithms , 1998 .

[43]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[44]  Huan Liu,et al.  Dimensionality reduction via discretization , 1996, Knowl. Based Syst..

[45]  Tao Wang,et al.  Handling over-fitting in test cost-sensitive decision tree learning by feature selection, smoothing and pruning , 2010, J. Syst. Softw..

[46]  Riccardo Poli,et al.  Evolving the Topology and the Weights of Neural Networks Using a Dual Representation , 2004, Applied Intelligence.

[47]  James P. Ignizio,et al.  Simultaneous design and training of ontogenic neural network classifiers , 1996, Comput. Oper. Res..

[48]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[49]  Robert Susmaga,et al.  Analyzing Discretizations of Continuous Attributes Given a Monotonic Discrimination Function , 1997, Intell. Data Anal..

[50]  Adrian G. Williamson,et al.  Refining a neural network credit application vetting system with a genetic algorithm , 1995 .

[51]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Evolutionary Radial Basis Functions for Credit Assessment , 2005, Applied Intelligence.

[52]  Jerzy W. Bala,et al.  Hybrid Learning Using Genetic Algorithms and Decision Trees for Pattern Classification , 1995, IJCAI.

[53]  Randall S. Sexton,et al.  The Use of Parsimonious Neural Networks for Forecasting Financial Time Series , 1998 .

[54]  An-Sing Chen,et al.  Application of Neural Networks to an Emerging Financial Market: Forecasting and Trading the Taiwan Stock Index , 2001 .

[55]  Timothy Masters,et al.  Practical neural network recipes in C , 1993 .

[56]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[57]  Walter D. Potter,et al.  Predicting Aflatoxin Contamination in Peanuts: A Genetic Algorithm/Neural Network Approach , 2004, Applied Intelligence.

[58]  Randall S. Sexton,et al.  Comparing backpropagation with a genetic algorithm for neural network training , 1999 .

[59]  Hak-Keung Lam,et al.  Tuning of the structure and parameters of a neural network using an improved genetic algorithm , 2003, IEEE Trans. Neural Networks.

[60]  P. McNelis.  Neural networks in finance : gaining predictive edge in the market , 2005 .

[61]  J. V. Hansen,et al.  Forecasting and recombining time-series components by using neural networks , 2003, J. Oper. Res. Soc..

[62]  J. Murphy.  Technical Analysis of the Futures Markets: A Comprehensive Guide to Trading Methods and Applications , 1986 .