A comprehensive evaluation of ensemble learning for stock-market prediction

Stock-market prediction using machine-learning technique aims at developing effective and efficient models that can provide a better and higher rate of prediction accuracy. Numerous ensemble regressors and classifiers have been applied in stock market predictions, using different combination techniques. However, three precarious issues come in mind when constructing ensemble classifiers and regressors. The first concerns with the choice of base regressor or classifier technique adopted. The second concerns the combination techniques used to assemble multiple regressors or classifiers and the third concerns with the quantum of regressors or classifiers to be ensembled. Subsequently, the number of relevant studies scrutinising these previously mentioned concerns are limited. In this study, we performed an extensive comparative analysis of ensemble techniques such as boosting, bagging, blending and super learners (stacking). Using Decision Trees (DT), Support Vector Machine (SVM) and Neural Network (NN), we constructed twenty-five (25) different ensembled regressors and classifiers. We compared their execution times, accuracy, and error metrics over stock-data from Ghana Stock Exchange (GSE), Johannesburg Stock Exchange (JSE), Bombay Stock Exchange (BSE-SENSEX) and New York Stock Exchange (NYSE), from January 2012 to December 2018. The study outcome shows that stacking and blending ensemble techniques offer higher prediction accuracies (90–100%) and (85.7–100%) respectively, compared with that of bagging (53–97.78%) and boosting (52.7–96.32%). Furthermore, the root means square error (RMSE) recorded by stacking (0.0001–0.001) and blending (0.002–0.01) shows a better fit of ensemble classifiers and regressors based on these two techniques in market analyses compared with bagging (0.01–0.11) and boosting (0.01–0.443). Finally, the results undoubtedly suggest that an innovative study in the domain of stock market direction prediction ought to include ensemble techniques in their sets of algorithms.

[1]  Patricia Melin,et al.  Optimization of Ensemble Neural Networks with Type-1 and Type-2 Fuzzy Integration for Prediction of the Taiwan Stock Exchange , 2016, WCSC.

[2]  Michel Ballings,et al.  Evaluating multiple classifiers for stock price direction prediction , 2015, Expert Syst. Appl..

[3]  Yongtao Hao,et al.  A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction , 2017, Expert Syst. Appl..

[4]  Mahmoud Taleb Beidokhti,et al.  Advances in Intelligent Systems and Computing , 2016 .

[5]  Ling Liu,et al.  A social-media-based approach to predicting stock comovement , 2015, Expert Syst. Appl..

[6]  Mitat Uysal,et al.  Ensemble approach for time series analysis in demand forecasting: Ensemble learning , 2017, 2017 IEEE International Conference on INnovations in Intelligent SysTems and Applications (INISTA).

[7]  A Mayr,et al.  The Evolution of Boosting Algorithms , 2014, Methods of Information in Medicine.

[8]  Mehmet Özçalici,et al.  Integrating metaheuristics and Artificial Neural Networks for improved stock price prediction , 2016, Expert Syst. Appl..

[9]  Adriano M. Pereira,et al.  Designing Financial Strategies based on Artificial Neural Networks Ensembles for Stock Markets , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[10]  N. Sharma,et al.  Combining of random forest estimates using LSboost for stock market index prediction , 2017, 2017 2nd International Conference for Convergence in Technology (I2CT).

[11]  Nicolas Huck,et al.  Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500 , 2017, Eur. J. Oper. Res..

[12]  Seyed Reza Kamel,et al.  Improving the performance of support-vector machine by selecting the best features by Gray Wolf algorithm to increase the accuracy of diagnosis of breast cancer , 2019, Journal of Big Data.

[13]  Bing Yang,et al.  Stock market index prediction using deep neural network ensemble , 2017, 2017 36th Chinese Control Conference (CCC).

[14]  Wei Xu,et al.  Enhancing intraday stock price manipulation detection by leveraging recurrent neural networks with ensemble learning , 2019, Neurocomputing.

[15]  Lu Zhang,et al.  An improved Stacking framework for stock index prediction by leveraging tree-based ensemble models and deep learning algorithms , 2020 .

[16]  Jian Yang,et al.  Ensemble Model for Stock Price Movement Trend Prediction on Different Investing Periods , 2016, 2016 12th International Conference on Computational Intelligence and Security (CIS).

[17]  Parul Agarwal,et al.  Ensemble Learning Approach for Enhanced Stock Prediction , 2019, 2019 Twelfth International Conference on Contemporary Computing (IC3).

[18]  P. Priya,et al.  PREDICTING YIELD OF THE CROP USING MACHINE LEARNING ALGORITHM , 2018 .

[19]  Ben Jacobsen,et al.  Equity Premium Prediction with Bagged Machine Learning , 2019 .

[20]  Ponnuthurai Nagaratnam Suganthan,et al.  Ensemble methods for wind and solar power forecasting—A state-of-the-art review , 2015 .

[21]  Oscar Castillo,et al.  Design of Ensemble Neural Networks for Predicting the US Dollar/MX Time Series with Particle Swarm Optimization , 2014, WCSC.

[22]  Sourabh Yadav,et al.  Homogenous Ensemble of Time-Series Models for Indian Stock Market , 2018, BDA.

[23]  Guangwei Zhu,et al.  Stock selection with random forest: An exploitation of excess return in the Chinese stock market , 2019, Heliyon.

[24]  ChongEunsuk,et al.  Deep learning networks for stock market analysis and prediction , 2017 .

[25]  Manish Kumar,et al.  Forecasting Stock Index Movement: A Comparison of Support Vector Machines and Random Forest , 2006 .

[26]  Shingo Mabu,et al.  Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems , 2015, Appl. Soft Comput..

[27]  Stefan Feuerriegel,et al.  Decision support from financial disclosures with deep neural networks and transfer learning , 2017, Decis. Support Syst..

[28]  Isaac Kofi Nti,et al.  Random Forest Based Feature Selection of Macroeconomic Variables for Stock Market Prediction , 2019, American Journal of Applied Sciences.

[29]  Aiman Abdullah Anees,et al.  Predicting Stock Prices using Ensemble Learning and Sentiment Analysis , 2019, 2019 IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE).

[30]  A. Umamakeswari,et al.  A Review on Prediction of Stock Market using Various Methods in the Field of Data Mining , 2016 .

[31]  Rohan Pimprikar,et al.  USE OF MACHINE LEARNING ALGORITHMS AND TWITTER SENTIMENT ANALYSIS FOR STOCK MARKET PREDICTION , 2017 .

[32]  G. Amaratunga,et al.  Stock Price Forecasting with Empirical Mode Decomposition Based Ensemble \nu -Support Vector Regression Model , 2017, CICBA.

[33]  Anthony Macchiarulo,et al.  PREDICTING AND BEATING THE STOCK MARKET WITH MACHINE LEARNING AND TECHNICAL ANALYSIS , 2018 .

[34]  Bin Weng,et al.  Application of machine learning techniques for stock market prediction , 2017 .

[35]  Chi Xie,et al.  Comparison of individual, ensemble and integrated ensemble machine learning methods to predict China’s SME credit risk in supply chain finance , 2017, Neural Computing and Applications.

[36]  Chulwoo Han,et al.  Deep learning networks for stock market analysis and prediction: Methodology, data representations, and case studies , 2017, Expert Syst. Appl..

[37]  Pedro Aceituno-Aceituno,et al.  On the Economic Significance of Stock Market Prediction and the No Free Lunch Theorem , 2019, IEEE Access.

[38]  Isaac Kofi Nti,et al.  A systematic review of fundamental and technical analysis of stock market predictions , 2019, Artificial Intelligence Review.

[39]  Snehanshu Saha,et al.  Predicting the direction of stock market prices using random forest , 2016, ArXiv.

[40]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[41]  Dante Augusto Couto Barone,et al.  Ensemble system based on genetic algorithm for stock market forecasting , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[42]  Pahulpreet Singh Kohli,et al.  Stock Prediction Using Machine Learning Algorithms , 2018, Advances in Intelligent Systems and Computing.

[43]  Chin Kim On,et al.  Homogeneous Ensemble FeedForward Neural Network in CIMB Stock Price Forecasting , 2018, 2018 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET).

[44]  Gene H. Golub,et al.  Tikhonov Regularization and Total Least Squares , 1999, SIAM J. Matrix Anal. Appl..

[45]  Hideki Nakayama,et al.  Deep Learning for Forecasting Stock Returns in the Cross-Section , 2018, PAKDD.

[46]  Shouyang Wang,et al.  AdaBoost-LSTM Ensemble Learning for Financial Time Series Forecasting , 2018, ICCS.

[47]  Nashat T. AL-Jallad,et al.  Short-Term Forecasting for Energy Consumption through Stacking Heterogeneous Ensemble Learning Model , 2018, Energies.

[48]  Algirdas Maknickas,et al.  Application of Ensemble of Recurrent Neural Networks for Forecasting of Stock Market Sentiments , 2018 .

[49]  Kartick Gupta.  Oil price shocks, competition, and oil & gas stock returns — Global evidence , 2016 .

[50]  Iraj Sadegh Amiri,et al.  A Machine-Learning Approach to Phishing Detection and Defense , 2014 .

[51]  Sajjad Waheed,et al.  Stock market prediction using an improved training algorithm of neural network , 2016, 2016 2nd International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE).

[52]  Sushanta Biswas,et al.  A COMPARISON BETWEEN DIFFERENT CLASSIFIERS FOR TENNIS MATCH RESULT PREDICTION , 2019 .

[53]  Sherri Rose,et al.  Classifying Lung Cancer Severity with Ensemble Machine Learning in Health Care Claims Data , 2017, MLHC.

[54]  Vivek Tiwari,et al.  Stock Market Price Prediction Using LSTM RNN , 2018, Advances in Intelligent Systems and Computing.

[55]  Ash Booth,et al.  Automated trading with performance weighted random forests and seasonality , 2014, Expert Syst. Appl..

[56]  Bernd Bruegge,et al.  Ensemble Methods for App Review Classification: An Approach for Software Evolution (N) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[57]  Jianping Li,et al.  A deep learning ensemble approach for crude oil price forecasting , 2017 .

[58]  David C. Yen,et al.  A comparative study of classifier ensembles for bankruptcy prediction , 2014, Appl. Soft Comput..

[59]  Taghi M. Khoshgoftaar,et al.  Big Data: Deep Learning for financial sentiment analysis , 2018, Journal of Big Data.

[60]  Dhanya Jothimani,et al.  Stock trading decisions using ensemble-based forecasting models: a study of the Indian stock market , 2019, J. Bank. Financial Technol..

[61]  Tolunay Göçken,et al.  Assessment of Hybrid Artificial Neural Networks and Metaheuristics for Stock Market Forecasting , 2018 .

[62]  Mansoor Ebrahim,et al.  Predicting Market Performance with Hybrid Model , 2018, 2018 3rd International Conference on Emerging Trends in Engineering, Sciences and Technology (ICEEST).