Predicting the direction of stock markets using optimized neural networks with Google Trends

Abstract The stock market is affected by many factors, such as political events, general economic conditions, and traders’ expectations. Predicting the direction of stock markets movement has been one of the most widely investigated and challenging problems for investors and researchers as well. Many researchers focus on stock market analysis using advanced knowledge of mathematics, computer sciences, economics and many other disciplines. In this paper, we present an improved sine cosine algorithm (ISCA), which introduces an additional parameter into the sine cosine algorithm (SCA), to optimize the weights and basis of back propagation neural networks (BPNN). Thus, ISCA and BPNN are combined to create a new network, ISCA-BPNN, for predicting the directions of the opening stock prices for the S&P 500 and Dow Jones Industrial Average Indices, respectively. In addition, Google Trends data are taken into consideration for improving stock prediction. We analyze two types of prediction: Type I is the prediction without Google Trends and Type II is the prediction with Google Trends. The predictability of stock price direction is verified by using the hybrid ISCA-BPNN model. The experimental results indicate that ISCA–BPNN outperforms BPNN, GWO-BPNN, PSO-BPNN, WOA-BPNN and SCA-BPNN in terms of predicting the direction of the opening price for both types and significantly for Type II. The hit ratios for ISCA-BPNN with Google Trends reach 86.81% for the S&P 500 Index, and 88.98% for the Dow Jones Industrial Average Index. Our results show that Google Trends can help in predicting the direction of the stock market index.

[1]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[2]  Yu Song,et al.  Application of artificial neural network for the prediction of stock market returns: The case of the Japanese stock market , 2016 .

[3]  Marcelo Portes Albuquerque,et al.  Predicting the Brazilian stock market through neural networks and adaptive exponential smoothing methods , 2009, Expert Syst. Appl..

[4]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[5]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[6]  David Enke,et al.  Stock Market Prediction Using a Combination of Stepwise Regression Analysis, Differential Evolution-based Fuzzy Clustering, and a Fuzzy Inference Neural Network , 2013, Intell. Autom. Soft Comput..

[7]  Prodromos D. Chatzoglou,et al.  An intelligent short term stock trading fuzzy system for assisting investors in portfolio management , 2016, Expert Syst. Appl..

[8]  S. Lahmiri.  Interest rate next-day variation prediction based on hybrid feedforward neural network, particle swarm optimization, and multiresolution techniques , 2016 .

[9]  Chulwoo Han,et al.  Deep learning networks for stock market analysis and prediction: Methodology, data representations, and case studies , 2017, Expert Syst. Appl..

[10]  Luis E. Zárate,et al.  Applying Artificial Neural Networks to prediction of stock price and improvement of the directional prediction index - Case study of PETR4, Petrobras, Brazil , 2013, Expert Syst. Appl..

[11]  Veera Boonjing,et al.  Artificial Neural Network and Genetic Algorithm Hybrid Intelligence for Predicting Thai Stock Price Index Trend , 2016, Comput. Intell. Neurosci..

[12]  Ang Li,et al.  Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine , 2016, Appl. Soft Comput..

[13]  T. T. Khuat,et al.  Forecasting Stock Price using Wavelet Neural Network Optimized by Directed Artificial Bee Colony Algorithm , 2016 .

[14]  Sahil Shah,et al.  Predicting stock market index using fusion of machine learning techniques , 2015, Expert Syst. Appl..

[15]  Wen-Chyuan Chiang,et al.  An adaptive stock index trading decision support system , 2016, Expert Syst. Appl..

[16]  Jun Wang,et al.  Financial Time Series Prediction Using Elman Recurrent Random Neural Networks , 2016, Comput. Intell. Neurosci..

[17]  Aderemi Oluyinka Adewumi,et al.  Comparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction , 2014, J. Appl. Math..

[18]  Salim Lahmiri,et al.  Minute-ahead stock price forecasting based on singular spectrum analysis and support vector regression , 2018, Appl. Math. Comput..

[19]  Tai-liang Chen,et al.  An intelligent pattern recognition model for supporting investment decisions in stock market , 2016, Inf. Sci..

[20]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[21]  Germán Hernández,et al.  High-Frequency Trading Strategy Based on Deep Neural Networks , 2016, ICIC.

[22]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[23]  Yu Song,et al.  Predicting the Direction of Stock Market Index Movement Using an Optimized Artificial Neural Network Model , 2016, PloS one.

[24]  H. Stanley,et al.  Quantifying Trading Behavior in Financial Markets Using Google Trends , 2013, Scientific Reports.

[25]  A. Hamid,et al.  Forecasting volatility with empirical similarity and Google Trends , 2015 .

[26]  Morteza Esfandyari,et al.  Stock Market Index Prediction Using Artificial Neural Network , 2016 .

[27]  Mohammad Mahdi Rounaghi,et al.  Application of artificial neural network models and principal component analysis method in predicting stock prices on Tehran Stock Exchange , 2015 .

[28]  Salim Lahmiri,et al.  Comparing Variational and Empirical Mode Decomposition in Forecasting Day-Ahead Energy Prices , 2017, IEEE Systems Journal.

[29]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[30]  Yongtao Hao,et al.  A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction , 2017, Expert Syst. Appl..

[31]  Francisco Guijarro,et al.  Stock market trading rule based on pattern recognition and technical analysis: Forecasting the DJIA index with intraday data , 2015, Expert Syst. Appl..

[32]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[33]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[34]  Vadlamani Ravi,et al.  Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks , 2009, Expert Syst. Appl..

[35]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[36]  D. Velumoni,et al.  Cognitive Intelligence based Expert System for Predicting Stock Markets using Prospect Theory , 2016 .

[37]  Xiao Zhong,et al.  Forecasting daily stock market return using dimensionality reduction , 2017, Expert Syst. Appl..

[38]  Manuel A. Fernández-Gámez,et al.  Corporate reputation and market value: Evidence with generalized regression neural networks , 2016, Expert Syst. Appl..

[39]  S. N. Sivanandam,et al.  Prediction of Stock Market Price using Hybrid of Wavelet Transform and Artificial Neural Network , 2016 .

[40]  Seyed Taghi Akhavan Niaki,et al.  Forecasting S&P 500 index using artificial neural networks and design of experiments , 2013 .

[41]  Manfred Grauer,et al.  Stock Market Prediction with Multiple Regression, Fuzzy Type-2 Clustering and Neural Networks , 2011, Complex Adaptive Systems.

[42]  张静,et al.  Banana Ovate family protein MaOFP1 and MADS-box protein MuMADS1 antagonistically regulated banana fruit ripening , 2015 .

[43]  Arun Agarwal,et al.  Recurrent neural network and a hybrid model for prediction of stock returns , 2015, Expert Syst. Appl..

[44]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[46]  Chih-Chou Chiu,et al.  Neural network forecasting of an opening cash price index , 2002, Int. J. Syst. Sci..