Systematic analysis and review of stock market prediction techniques

Abstract Prediction of stock market trends is considered as an important task and is of great attention as predicting stock prices successfully may lead to attractive profits by making proper decisions. Stock market prediction is a major challenge owing to non-stationary, blaring, and chaotic data, and thus, the prediction becomes challenging among the investors to invest the money for making profits. Several techniques are devised in the existing techniques to predict the stock market trends. This work presents the detailed review of 50 research papers suggesting the methodologies, like Bayesian model, Fuzzy classifier, Artificial Neural Networks (ANN), Support Vector Machine (SVM) classifier, Neural Network (NN), Machine Learning Methods and so on, based on stock market prediction. The obtained papers are classified based on different prediction and clustering techniques. The research gaps and the challenges faced by the existing techniques are listed and elaborated, which help the researchers to upgrade the future works. The works are analyzed using certain datasets, software tools, performance evaluation measures, prediction techniques utilized, and performance attained by different techniques. The commonly used technique for attaining effective stock market prediction is ANN and the fuzzy-based technique. Even though a lot of research efforts, the current stock market prediction technique still have many limits. From this survey, it can be concluded that the stock market prediction is a very complex task, and different factors should be considered for predicting the future of the market more accurately and efficiently.

[1]  Jyoti Badge,et al.  Forecasting of Indian Stock Market by Effective Macro- Economic Factors and Stochastic Model , 2012 .

[2]  Qinghua Wen,et al.  Automatic stock decision support system based on box theory and SVM algorithm , 2010, Expert Syst. Appl..

[3]  Philip S. Yu,et al.  Stock Market Prediction via Multi-Source Multiple Instance Learning , 2018, IEEE Access.

[4]  Chris Nikolopoulos,et al.  A hybrid expert system for investment advising , 1994 .

[5]  Esmaeil Hadavandi,et al.  Hybridization of evolutionary Levenberg-Marquardt neural networks and data pre-processing for stock market prediction , 2012, Knowl. Based Syst..

[6]  David Haussler,et al.  KDD for Science Data Analysis: Issues and Examples , 1996, KDD.

[7]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[8]  Hossam Faris,et al.  A Comparison between Regression, Artificial Neural Networks and Support Vector Machines for Predicting Stock Market Index , 2015 .

[9]  Derya Avci,et al.  An Adaptive Network-Based Fuzzy Inference System (ANFIS) for the prediction of stock market return: The case of the Istanbul Stock Exchange , 2010, Expert Syst. Appl..

[10]  Phichhang Ou,et al.  Prediction of Stock Market Index Movement by Ten Data Mining Techniques , 2009 .

[11]  A. Thavaneswaran,et al.  Weighted possibilistic moments of fuzzy numbers with applications to GARCH modeling and option pricing , 2009, Math. Comput. Model..

[12]  Chih-Chou Chiu,et al.  Integration of nonlinear independent component analysis and support vector regression for stock price forecasting , 2013, Neurocomputing.

[13]  Zhisong Pan,et al.  Stock Market Prediction on High-Frequency Data Using Generative Adversarial Nets , 2018 .

[14]  V. Chandra Prakash,et al.  Support vector regression and extended nearest neighbor for video object retrieval , 2018, Evolutionary Intelligence.

[15]  A. Gupta,et al.  Stock market prediction using Hidden Markov Models , 2012, 2012 Students Conference on Engineering and Systems.

[16]  Sahil Shah,et al.  Predicting stock market index using fusion of machine learning techniques , 2015, Expert Syst. Appl..

[17]  Md. Rafiul Hassan A combination of hidden Markov model and fuzzy model for stock market forecasting , 2009, Neurocomputing.

[18]  Victor Chang,et al.  An innovative neural network approach for stock market prediction , 2018, The Journal of Supercomputing.

[19]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[20]  David C. Yen,et al.  Predicting stock returns by classifier ensembles , 2011, Appl. Soft Comput..

[21]  Tae Hyup Roh Forecasting the volatility of stock price index , 2007, Expert Syst. Appl..

[22]  Aderemi Oluyinka Adewumi,et al.  Stock Price Prediction Using the ARIMA Model , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[23]  Hossein Javedani Sadaei,et al.  A hybrid model based on differential fuzzy logic relationships and imperialist competitive algorithm for stock market forecasting , 2016, Appl. Soft Comput..

[24]  S. S. Appadoo Pricing financial derivatives with fuzzy algebraic models: a theoretical and computational approach , 2006 .

[25]  P. Srinivasan,et al.  Forecasting Stock Market Volatility of Bse-30 Index Using Garch Models , 2010 .

[26]  Ching-Hsue Cheng,et al.  A hybrid model based on rough sets theory and genetic algorithms for stock price forecasting , 2010, Inf. Sci..

[27]  Muhammad Hisyam Lee,et al.  Multilayer Stock Forecasting Model Using Fuzzy Time Series , 2014, TheScientificWorldJournal.

[28]  George S. Atsalakis,et al.  Elliott Wave Theory and neuro-fuzzy systems, in stock market prediction: The WASP system , 2011, Expert Syst. Appl..

[29]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[30]  Mehdi Jalili,et al.  Forecasting stock prices using financial data mining and Neural Network , 2011, 2011 3rd International Conference on Computer Research and Development.

[31]  Francisco Guijarro,et al.  A dynamic trading rule based on filtered flag pattern recognition for stock market price forecasting , 2017, Expert Syst. Appl..

[32]  Zhi-Wei Ni,et al.  Stock trend prediction based on fractal feature selection and support vector machine , 2011, Expert Syst. Appl..

[33]  Mu-Yen Chen,et al.  A hybrid fuzzy time series model based on granular computing for stock price forecasting , 2015, Inf. Sci..

[34]  Chiew Tong Lau,et al.  Stock market prediction using neural network through news on online social networks , 2017, 2017 International Smart Cities Conference (ISC2).

[35]  Sahil Shah,et al.  Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques , 2015, Expert Syst. Appl..

[36]  Tiago Alessandro Espínola Ferreira,et al.  A Morphological-Rank-Linear evolutionary method for stock market prediction , 2013, Inf. Sci..

[37]  Zhongyi Hu,et al.  Multiple-output support vector regression with a firefly algorithm for interval-valued stock price index forecasting , 2014, Knowl. Based Syst..

[38]  A. Thavaneswaran,et al.  Fuzzy coefficient volatility (FCV) models with applications , 2007, Math. Comput. Model..

[39]  Manuel R. Vargas,et al.  Deep learning for stock market prediction from financial news articles , 2017, 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[41]  Christer Carlsson,et al.  On Possibilistic Mean Value and Variance of Fuzzy Numbers , 1999, Fuzzy Sets Syst..

[42]  Tai-Liang Chen,et al.  A hybrid model based on adaptive-network-based fuzzy inference system to forecast Taiwan stock market , 2011, Expert Syst. Appl..

[43]  Charles C. Snow,et al.  Stock market reaction to strategic investment decisions , 1990 .

[44]  Akbar Esfahanipour,et al.  Adapted Neuro-Fuzzy Inference System on indirect approach TSK fuzzy rule base for stock market analysis , 2010, Expert Syst. Appl..

[45]  Sotirios Chatzis,et al.  Forecasting stock market crisis events using deep and statistical machine learning techniques , 2018, Expert Syst. Appl..

[46]  P. Vijaya,et al.  Artificial neural network-based merging score for Meta search engine , 2016 .

[47]  Arash Ghanbari,et al.  Integration of genetic fuzzy systems and artificial neural networks for stock price forecasting , 2010, Knowl. Based Syst..

[48]  Ganapati Panda,et al.  Prediction of S&P 500 and DJIA stock indices using Particle Swarm Optimization technique , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[49]  Kazuo Asakawa,et al.  Stock market prediction system with modular neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[50]  Pradipta Kishore Dash,et al.  A hybrid FLANN and adaptive differential evolution model for forecasting of stock market indices , 2014, Int. J. Knowl. Based Intell. Eng. Syst..

[51]  Pei-Chann Chang,et al.  A novel model by evolving partially connected neural network for stock price trend forecasting , 2012, Expert Syst. Appl..

[52]  Farookh Khadeer Hussain,et al.  Support vector regression with chaos-based firefly algorithm for stock market price forecasting , 2013, Appl. Soft Comput..

[53]  Manfred Grauer,et al.  Stock Market Prediction with Multiple Regression, Fuzzy Type-2 Clustering and Neural Networks , 2011, Complex Adaptive Systems.

[54]  Asil Oztekin,et al.  A data analytic approach to forecasting daily stock returns in an emerging market , 2016, Eur. J. Oper. Res..

[55]  David Zimbra,et al.  Twitter brand sentiment analysis: A hybrid system using n-gram analysis and dynamic artificial neural network , 2013, Expert Syst. Appl..

[56]  Wei-Chang Yeh,et al.  Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm , 2011, Appl. Soft Comput..

[57]  Gregory Piatetsky-Shapiro,et al.  The KDD process for extracting useful knowledge from volumes of data , 1996, CACM.

[58]  S. Arun Joe Babulo,et al.  Stock Market Indices Prediction with Various Neural Network Models , 2014 .

[59]  Jonathan L. Ticknor A Bayesian regularized artificial neural network for stock market forecasting , 2013, Expert Syst. Appl..

[60]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[61]  Xin Xie,et al.  Recurrent neural network for forecasting stock market trend , 2016 .

[62]  Dinesh Bhuriya,et al.  Survey of stock market prediction using machine learning approach , 2017, 2017 International conference of Electronics, Communication and Aerospace Technology (ICECA).

[63]  Hongfei Lin,et al.  Stock Market Trend Prediction Using Recurrent Convolutional Neural Networks , 2018, NLPCC.

[64]  Xiao Zhong,et al.  Forecasting daily stock market return using dimensionality reduction , 2017, Expert Syst. Appl..

[65]  M. K. Tiwari,et al.  Clustering Indian stock market data for portfolio management , 2010, Expert Syst. Appl..

[66]  Shie-Jue Lee,et al.  A multiple-kernel support vector regression approach for stock market price forecasting , 2011, Expert Syst. Appl..

[67]  David Enke,et al.  The use of data mining and neural networks for forecasting stock market returns , 2005, Expert Syst. Appl..

[68]  Sreejit Chakravarty,et al.  A PSO based integrated functional link net and interval type-2 fuzzy logic system for predicting stock market indices , 2012, Appl. Soft Comput..

[69]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[70]  Morteza Esfandyari,et al.  Stock Market Index Prediction Using Artificial Neural Network , 2016 .

[71]  Alexander Porshnev,et al.  Machine Learning in Prediction of Stock Market Indicators Based on Historical Data and Data from Twitter Sentiment Analysis , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.