Hybrid evolutionary intelligent system and hybrid time series econometric model for stock price forecasting

In this paper, a hybrid evolutionary intelligent system is proposed for dimensionality reduction and tuning the learnable parameters of artificial neural network (ANN) that can forecast the future (1‐day‐ahead) close price of the stock market using various technical indicators. Although the ANN possesses the ability to model highly uncertain and complex nonlinear data but the key challenge in ANN is tuning its parameters and minimizing the feature set that can be used in the input layer. The backpropagation approach used for training the ANN has a limitation to get trapped in local minima and overfitting the data. Motivated by this, we proposed a hybrid intelligent system for optimizing the initial parameters and for reducing the dimensions of the feature set. The proposed model is a combination of feature extraction technique, namely principal component analysis (PCA), particle swarm optimization (PSO), and Levenberg‐Marquardt (LM) algorithm for training the feed‐forward neural networks (FFNN). This paper also compares the forecasting efficiency of the proposed model with PSO‐FFNN, regular FFNN, two standard benchmark approaches viz. GA and DE and another hybrid model obtained by the combination of PCA and a time series econometric model viz. auto‐regressive distributed lag model. The presented technique has been tested to predict the close price of three stock indices viz. Nifty 50, Sensex, and S&P 500. Simulation results indicate that the proposed model shows superior forecasting accuracy as compared with other methods.

[1]  Fabio Caraffini,et al.  Cooperative and distributed decision-making in a multi-agent perception system for improvised land mines detection , 2020, Inf. Fusion.

[2]  Rui Ferreira Neves,et al.  Combining NeuroEvolution and Principal Component Analysis to trade in the financial markets , 2018, Expert Syst. Appl..

[3]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[4]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[5]  Luigi Glielmo,et al.  Spacecraft autonomy modeled via Markov decision process and associative rule-based machine learning , 2017, 2017 IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace).

[6]  Thar Baker,et al.  Analysis of Dimensionality Reduction Techniques on Big Data , 2020, IEEE Access.

[7]  Manas Ranjan Senapati,et al.  A Novel Model for Stock Price Prediction Using Hybrid Neural Network , 2018, Journal of The Institution of Engineers (India): Series B.

[8]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[9]  Uday Pratap Singh,et al.  Modified Chaotic Bat Algorithm Based Counter Propagation Neural Network for Uncertain Nonlinear Discrete Time System , 2016, Int. J. Comput. Intell. Appl..

[10]  Yongcheol Shin,et al.  An Autoregressive Distributed Lag Modelling Approach to Cointegration Analysis , 1995 .

[11]  Pradipta Kishore Dash,et al.  A hybrid evolutionary dynamic neural network for stock market trend analysis and prediction using unscented Kalman filter , 2014, Appl. Soft Comput..

[12]  Uday Pratap Singh,et al.  Image Segmentation Using Computational Intelligence Techniques: Review , 2019 .

[13]  Deepak Kumar,et al.  Proximal support vector machine based hybrid prediction models for trend forecasting in financial markets , 2016, J. Comput. Sci..

[14]  Shu Yang,et al.  A survey on application of machine learning for Internet of Things , 2018, International Journal of Machine Learning and Cybernetics.

[15]  I. Jolliffe.  Principal Components in Regression Analysis , 1986 .

[16]  Mehmet Özçalici,et al.  Integrating metaheuristics and Artificial Neural Networks for improved stock price prediction , 2016, Expert Syst. Appl..

[17]  Peter Vuust,et al.  Comparing the Performance of Popular MEG/EEG Artifact Correction Methods in an Evoked-Response Study , 2016, Comput. Intell. Neurosci..

[18]  Erik Cuevas,et al.  Differential Evolution (DE) , 2020 .

[19]  Chiun-Sin Lin,et al.  Empirical mode decomposition–based least squares support vector regression for foreign exchange rate forecasting , 2012 .

[20]  Alexei Botchkarev,et al.  Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typology , 2018, Interdisciplinary Journal of Information, Knowledge, and Management.

[21]  Amit Kant Pandit,et al.  Image segmentation using multilevel thresholding based on type II fuzzy entropy and marine predators algorithm , 2021, Multimedia Tools and Applications.

[22]  Abdulhamit Subasi,et al.  A comparison of time series and machine learning models for inflation forecasting: empirical evidence from the USA , 2016, Neural Computing and Applications.

[23]  Yu Song,et al.  Application of artificial neural network for the prediction of stock market returns: The case of the Japanese stock market , 2016 .

[24]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[25]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[26]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[27]  Da-yong Zhang,et al.  Stock market forecasting model based on a hybrid ARMA and support vector machines , 2008, 2008 International Conference on Management Science and Engineering 15th Annual Conference Proceedings.

[28]  Uday Pratap Singh,et al.  Vision-Based Gait Recognition: A Survey , 2018, IEEE Access.

[29]  Esmaeil Hadavandi,et al.  Hybridization of evolutionary Levenberg-Marquardt neural networks and data pre-processing for stock market prediction , 2012, Knowl. Based Syst..

[30]  Marco Ruffini,et al.  An Overview on Application of Machine Learning Techniques in Optical Networks , 2018, IEEE Communications Surveys & Tutorials.

[31]  Lin Lu,et al.  Predicting short-term stock prices using ensemble methods and online data sources , 2018, Expert Syst. Appl..

[32]  Uday Pratap Singh,et al.  Optimization of neural network for nonlinear discrete time system using modified quaternion firefly algorithm: case study of Indian currency exchange rate prediction , 2018, Soft Comput..

[33]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[34]  Ling Tang,et al.  A novel hybrid stock selection method with stock prediction , 2019, Appl. Soft Comput..

[35]  Uday Pratap Singh,et al.  FCPN Approach for Uncertain Nonlinear Dynamical System with Unknown Disturbance , 2017, Int. J. Fuzzy Syst..

[36]  Xiao Zhong,et al.  Forecasting daily stock market return using dimensionality reduction , 2017, Expert Syst. Appl..

[37]  H. Akaike.  Fitting autoregressive models for prediction , 1969 .

[38]  Kimon P. Valavanis,et al.  Surveying stock market forecasting techniques - Part II: Soft computing methods , 2009, Expert Syst. Appl..

[39]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[40]  Wen-Chyuan Chiang,et al.  An adaptive stock index trading decision support system , 2016, Expert Syst. Appl..

[41]  Veera Boonjing,et al.  Artificial Neural Network and Genetic Algorithm Hybrid Intelligence for Predicting Thai Stock Price Index Trend , 2016, Comput. Intell. Neurosci..

[42]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[43]  Mehmet Özçalici,et al.  Stock price prediction using hybrid soft computing models incorporating parameter tuning and input variable selection , 2019, Neural Computing and Applications.

[44]  A. T. C. Goh,et al.  Back-propagation neural networks for modeling complex systems , 1995, Artif. Intell. Eng..

[45]  Werner Kristjanpoller,et al.  A hybrid volatility forecasting framework integrating GARCH, artificial neural network, technical analysis and principal components analysis , 2018, Expert Syst. Appl..

[46]  Ammar Belatreche,et al.  Forecasting price movements using technical indicators: Investigating the impact of varying input window length , 2017, Neurocomputing.

[47]  Esmaeil Hadavandi,et al.  A bat-neural network multi-agent system (BNNMAS) for stock price prediction: Case study of DAX stock price , 2015, Appl. Soft Comput..

[48]  Le Hoang Phong,et al.  A Nonlinear Autoregressive Distributed Lag (NARDL) Analysis on the Determinants of Vietnam's Stock Market , 2018, ECONVN.

[49]  Javier Arroyo,et al.  An Intelligent Trading System with Fuzzy Rules and Fuzzy Capital Management , 2015, Int. J. Intell. Syst..

[50]  Matías Roodschild,et al.  A new approach for the vanishing gradient problem on sigmoid activation , 2020, Progress in Artificial Intelligence.

[51]  Francesco Palmieri,et al.  GGA: A modified genetic algorithm with gradient-based local search for solving constrained optimization problems , 2021, Inf. Sci..

[52]  Bruno Iochins Grisci,et al.  Neuroevolution of Neural Network Architectures Using CoDeepNEAT and Keras , 2020, ArXiv.

[53]  Vadlamani Ravi,et al.  Forecasting financial time series volatility using Particle Swarm Optimization trained Quantile Regression Neural Network , 2017, Appl. Soft Comput..

[54]  Aderemi Oluyinka Adewumi,et al.  Comparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction , 2014, J. Appl. Math..

[55]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[56]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[57]  Prithviraj Dasgupta,et al.  A multi‐agent system for analyzing the effect of information on prediction markets , 2011, Int. J. Intell. Syst..

[58]  Uday Pratap Singh,et al.  Stock Market Forecasting Using Computational Intelligence: A Survey , 2020, Archives of Computational Methods in Engineering.

[59]  C. B. Tilanus,et al.  Applied Economic Forecasting , 1966 .

[60]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[61]  Jun Wang,et al.  Forecasting stock market indexes using principle component analysis and stochastic time effective neural networks , 2015, Neurocomputing.

[62]  Francesco Palmieri,et al.  Knowledge elicitation based on genetic programming for non destructive testing of critical aerospace systems , 2020, Future Gener. Comput. Syst..