Expert Systems With Applications

We propose a survey of soft computing techniques applied to financial market.We surveyed several primary studies proposed in the literature.A framework for building an intelligent trading system was proposed.Future directions of this research field are discussed. Financial markets play an important role on the economical and social organization of modern society. In these kinds of markets, information is an invaluable asset. However, with the modernization of the financial transactions and the information systems, the large amount of information available for a trader can make prohibitive the analysis of a financial asset. In the last decades, many researchers have attempted to develop computational intelligent methods and algorithms to support the decision-making in different financial market segments. In the literature, there is a huge number of scientific papers that investigate the use of computational intelligence techniques to solve financial market problems. However, only few studies have focused on review the literature of this topic. Most of the existing review articles have a limited scope, either by focusing on a specific financial market application or by focusing on a family of machine learning algorithms. This paper presents a review of the application of several computational intelligent methods in several financial applications. This paper gives an overview of the most important primary studies published from 2009 to 2015, which cover techniques for preprocessing and clustering of financial data, for forecasting future market movements, for mining financial text information, among others. The main contributions of this paper are: (i) a comprehensive review of the literature of this field, (ii) the definition of a systematic procedure for guiding the task of building an intelligent trading system and (iii) a discussion about the main challenges and open problems in this scientific field.

[1]  Jiangling Yin,et al.  OBST-based segmentation approach to financial time series , 2013, Eng. Appl. Artif. Intell..

[2]  Chih-Chou Chiu,et al.  Integration of nonlinear independent component analysis and support vector regression for stock price forecasting , 2013, Neurocomputing.

[3]  Tuhin Mukherjee,et al.  Performance evaluation of Neural Network approach in financial prediction: Evidence from Indian Market , 2010, 2010 International Conference on Communication and Computational Intelligence (INCOCCI).

[4]  Gisele L. Pappa,et al.  From an artificial neural network to a stock market day-trading system: A case study on the BM&F BOVESPA , 2009, 2009 International Joint Conference on Neural Networks.

[5]  Babita Majhi,et al.  Multiobjective optimization based adaptive models with fuzzy decision making for stock market forecasting , 2015, Neurocomputing.

[6]  Deron Liang,et al.  Novel feature selection methods to financial distress prediction , 2014, Expert Syst. Appl..

[7]  Wu Meng,et al.  Application of Support Vector Machines in Financial Time Series Forecasting , 2007 .

[8]  Bruce J. Vanstone,et al.  Enhancing stockmarket trading performance with ANNs , 2010, Expert Syst. Appl..

[9]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Adriano L.I. Oliveira,et al.  Detecting novelties in time series through neural networks forecasting with robust confidence intervals , 2006, Neurocomputing.

[11]  Zhiguo Gong,et al.  Financial time series segmentation based on Turning Points , 2011, Proceedings 2011 International Conference on System Science and Engineering.

[12]  Nicolas Chapados,et al.  Cost functions and model combination for VaR-based asset allocation using neural networks , 2001, IEEE Trans. Neural Networks.

[13]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[14]  Yi-Ming Wei,et al.  Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology , 2013 .

[15]  Ying Chen,et al.  Improving option price forecasts with neural networks and support vector regressions , 2009, Neurocomputing.

[16]  Mustafa E. Abdual-Salam,et al.  Comparative study between Differential Evolution and Particle Swarm Optimization algorithms in training of feed-forward neural network for stock price prediction , 2010, 2010 The 7th International Conference on Informatics and Systems (INFOS).

[17]  Abdulah Kayal,et al.  A Neural Networks filtering mechanism for foreign exchange trading signals , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[18]  Richard A. Davis,et al.  Time Series: Theory and Methods (2nd ed.). , 1992 .

[19]  Michel Ballings,et al.  Evaluating multiple classifiers for stock price direction prediction , 2015, Expert Syst. Appl..

[20]  João Gama,et al.  A survey on learning from data streams: current and future trends , 2012, Progress in Artificial Intelligence.

[21]  C. Granger,et al.  THE RANDOM-WALK HYPOTHESIS OF STOCK MARKET BEHAVIOR† , 1964 .

[22]  Sheng-Hsun Hsu,et al.  A two-stage architecture for stock price forecasting by integrating self-organizing map and support vector regression , 2009, Expert Syst. Appl..

[23]  Fatos Xhafa,et al.  Utilizing artificial neural networks and genetic algorithms to build an algo-trading model for intra-day foreign exchange speculation , 2013, Math. Comput. Model..

[24]  Yukun Bao,et al.  A Comparative Study of Multi-step-ahead Prediction for Crude Oil Price with Support Vector Regression , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[25]  Ching-Hsue Cheng,et al.  A novel time-series model based on empirical mode decomposition for forecasting TAIEX , 2014 .

[26]  Wei-Sen Chen,et al.  Using neural networks and data mining techniques for the financial distress prediction model , 2009, Expert Syst. Appl..

[27]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[28]  Adriano Lorena Inácio de Oliveira,et al.  An autonomous trader agent for the stock market based on online sequential extreme learning machine ensemble , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[29]  Dobrivoje Popovic,et al.  Computational Intelligence in Time Series Forecasting: Theory and Engineering Applications (Advances in Industrial Control) , 2005 .

[30]  Shun-Feng Su,et al.  Robust support vector regression networks for function approximation with outliers , 2002, IEEE Trans. Neural Networks.

[31]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[32]  Xiaolong Wang,et al.  A novel text mining approach to financial time series forecasting , 2012, Neurocomputing.

[33]  Michael R. Lyu,et al.  Localized support vector regression for time series prediction , 2009, Neurocomputing.

[34]  Ming-Chi Lee,et al.  Using support vector machine with a hybrid feature selection method to the stock trend prediction , 2009, Expert Syst. Appl..

[35]  John B. Guerard,et al.  Earnings forecasting in a global stock selection model and efficient portfolio construction and management , 2015, Handbook of Applied Investment Research.

[36]  Xiao-Lei Zhang,et al.  Deep Belief Networks Based Voice Activity Detection , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  Laurence Irlicht.  Fast Recursive Portfolio Optimization , 2014, Algorithmic Finance.

[38]  Yuhong Li,et al.  Applications of Artificial Neural Networks in Financial Economics: A Survey , 2010, 2010 International Symposium on Computational Intelligence and Design.

[39]  Lili Huang,et al.  Financial time series forecasting based on wavelet kernel support vector machine , 2012, ICNC.

[40]  David M. Pennock,et al.  The Extent of Price Misalignment in Prediction Markets , 2014, Algorithmic Finance.

[41]  Jianxue Chen.  SVM application of financial time series forecasting using empirical technical indicators , 2010, 2010 International Conference on Information, Networking and Automation (ICINA).

[42]  Nikolaos Kourentzes,et al.  Neural network ensemble operators for time series forecasting , 2014, Expert Syst. Appl..

[43]  Jun Wang,et al.  Fluctuation prediction of stock market index by Legendre neural network with random time strength function , 2012, Neurocomputing.

[44]  Yong Hu,et al.  Stock trading rule discovery with an evolutionary trend following model , 2015, Expert Syst. Appl..

[45]  Tony Jan,et al.  Machine Learning Techniques and Use of Event Information for Stock Market Prediction: A Survey and Evaluation , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[46]  Ying Chen,et al.  Associating stock prices with web financial information time series based on support vector regression , 2013, Neurocomputing.

[47]  Huang Li-li,et al.  Financial time series forecasting based on wavelet kernel support vector machine , 2012, 2012 8th International Conference on Natural Computation.

[48]  Hakan Gunduz,et al.  Borsa Istanbul (BIST) daily prediction using financial news and balanced feature selection , 2015, Expert Syst. Appl..

[49]  Tobias Hahn,et al.  Creating trading systems with fundamental variables and neural networks: The Aby case study , 2012, Math. Comput. Simul..

[50]  Wei-Chang Yeh,et al.  Mining financial distress trend data using penalty guided support vector machines based on hybrid of particle swarm optimization and artificial bee colony algorithm , 2012, Neurocomputing.

[51]  Shen Furao,et al.  Forecasting exchange rate using deep belief networks and conjugate gradient method , 2015, Neurocomputing.

[52]  Adriano Lorena Inácio de Oliveira,et al.  A method for automatic stock trading combining technical analysis and nearest neighbor classification , 2010, Expert Syst. Appl..

[53]  Cheng-Lung Huang,et al.  A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting , 2009, Expert Syst. Appl..

[54]  梁循.  Associating stock prices with web financial information time series based on support vector regression , 2013 .

[55]  E. Fama.  The Behavior of Stock-Market Prices , 1965 .

[56]  Jonathan L. Ticknor.  A Bayesian regularized artificial neural network for stock market forecasting , 2013, Expert Syst. Appl..

[57]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[58]  Bruce J. Vanstone,et al.  An empirical methodology for developing stockmarket trading systems using artificial neural networks , 2009, Expert Syst. Appl..

[59]  Kimon P. Valavanis,et al.  Surveying stock market forecasting techniques - Part II: Soft computing methods , 2009, Expert Syst. Appl..

[60]  Umesh Deshpande,et al.  A stock market portfolio recommender system based on association rule mining , 2013, Appl. Soft Comput..

[61]  Zhidong Deng,et al.  Trading strategy design in financial investment through a turning points prediction scheme , 2009, Expert Syst. Appl..

[62]  T. Yu,et al.  Performance analysis of Indian stock market index using neural network time series model , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.

[63]  Nuno Horta,et al.  Boosting Trading Strategies performance using VIX indicator together with a dual-objective Evolutionary Computation optimizer , 2015, Expert Syst. Appl..

[64]  Luis E. Zárate,et al.  The use of artificial neural networks in the analysis and prediction of stock prices , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[65]  M. Shahidehpour,et al.  A Hybrid Model for Day-Ahead Price Forecasting , 2010, IEEE Transactions on Power Systems.

[66]  Azadeh Nikfarjam,et al.  Text mining approaches for stock market prediction , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[67]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[68]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[69]  Abir Jaafar Hussain,et al.  Non-stationary and stationary prediction of financial time series using dynamic ridge polynomial neural network , 2009, Neurocomputing.

[70]  Annett Baier.  Beyond Technical Analysis How To Develop And Implement A Winning Trading System , 2016 .

[71]  Zhe George Zhang,et al.  Forecasting stock indices with back propagation neural network , 2011, Expert Syst. Appl..

[72]  Leslie S. Smith,et al.  A novel neural network ensemble architecture for time series forecasting , 2011, Neurocomputing.

[73]  Sneha Soni,et al.  Applications of ANNs in Stock Market Prediction : A Survey , 2011 .

[74]  Adriano Lorena Inácio de Oliveira,et al.  An approach to handle concept drift in financial time series based on Extreme Learning Machines and explicit Drift Detection , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[75]  M. Valenzuela-Rendón,et al.  Genetic algorithms and Darwinian approaches in financial applications: A survey , 2015, Expert Syst. Appl..

[76]  Jan Muntermann,et al.  An intraday market risk management approach based on textual analysis , 2011, Decis. Support Syst..

[77]  Ying Wah Teh,et al.  Text mining of news-headlines for FOREX market prediction: A Multi-layer Dimension Reduction Algorithm with semantics and sentiment , 2015, Expert Syst. Appl..

[78]  Geoffrey E. Hinton.  Reducing the Dimensionality of Data with Neural , 2008 .

[79]  Yu-Hon Lui,et al.  The use of fundamental and technical analyses by foreign exchange dealers: Hong Kong evidence , 1998 .

[80]  Dimitris Kugiumtzis,et al.  A prediction scheme using perceptually important points and dynamic time warping , 2014, Expert Syst. Appl..

[81]  Imran Zualkernan,et al.  Neural Network design parameters for forecasting financial time series , 2013, 2013 5th International Conference on Modeling, Simulation and Applied Optimization (ICMSAO).

[82]  Chiun-Sin Lin,et al.  Empirical mode decomposition–based least squares support vector regression for foreign exchange rate forecasting , 2012 .

[83]  Amiya Kumar Rath,et al.  A Naïve SVM-KNN based stock market trend reversal analysis for Indian benchmark indices , 2015, Appl. Soft Comput..

[84]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[85]  Katarzyna Musial,et al.  Next challenges for adaptive learning systems , 2012, SKDD.

[86]  Eugene A. Durenard.  Professional Automated Trading: Theory and Practice , 2013 .

[87]  Jun Wang,et al.  Forecasting stock market indexes using principle component analysis and stochastic time effective neural networks , 2015, Neurocomputing.

[88]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[89]  Helena Veiga,et al.  Wavelet-based detection of outliers in financial time series , 2010, Comput. Stat. Data Anal..

[90]  Fangqiong Luo,et al.  A novel nonlinear combination model based on Support Vector Machine for stock market prediction , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[91]  Dazhuo Zhou,et al.  Clustering Based on LLE For Financial Multivariate Time Series , 2009, 2009 International Conference on Management and Service Science.

[92]  Ganapati Panda,et al.  Efficient prediction of exchange rates with low complexity artificial neural network models , 2009, Expert Syst. Appl..

[93]  Helena Veiga,et al.  Outliers, GARCH-type models and risk measures: A comparison of several approaches ☆ , 2014 .

[94]  Ying Wah Teh,et al.  Stock market co-movement assessment using a three-phase clustering method , 2014, Expert Syst. Appl..

[95]  George D. C. Cavalcanti,et al.  Improving financial time series prediction using exogenous series and neural networks committees , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[96]  Shingo Mabu,et al.  Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems , 2015, Appl. Soft Comput..

[97]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[98]  Aristides Gionis,et al.  Correlating financial time series with micro-blogging activity , 2012, WSDM '12.

[99]  Wen Qin,et al.  A nonparametric outlier detection method for financial data , 2009, 2009 International Conference on Management Science and Engineering.

[100]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[101]  Yves Lechevallier,et al.  Relational partitioning fuzzy clustering algorithms based on multiple dissimilarity matrices , 2013, Fuzzy Sets Syst..

[102]  D. Al-Jumeily,et al.  Adaptive Neural Network Model Using the Immune System for Financial Time Series Forecasting , 2009, 2009 International Conference on Computational Intelligence, Modelling and Simulation.

[103]  Donald R. Haurin,et al.  Predicting turning points in the housing market , 2009 .

[104]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[105]  Pierpaolo D'Urso,et al.  Clustering of financial time series , 2013 .

[106]  Chien-Feng Huang,et al.  A hybrid stock selection model using genetic algorithms and support vector regression , 2012, Appl. Soft Comput..

[107]  Irene Aldridge,et al.  High-frequency Trading High-frequency Trading Industry Strategy Project Engineering Leadership Program , 2022 .

[108]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[109]  Esmaeil Hadavandi,et al.  A bat-neural network multi-agent system (BNNMAS) for stock price prediction: Case study of DAX stock price , 2015, Appl. Soft Comput..

[110]  Yubo Yuan,et al.  Forecasting the movement direction of exchange rate with polynomial smooth support vector machine , 2013, Math. Comput. Model..

[111]  Guo-qiang Xie.  The Optimization of Share Price Prediction Model Based on Support Vector Machine , 2011, 2011 International Conference on Control, Automation and Systems Engineering (CASE).

[112]  Chi-Jie Lu,et al.  Combining nonlinear independent component analysis and neural network for the prediction of Asian stock market indexes , 2012, Expert Syst. Appl..

[113]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[114]  Yue Zhang,et al.  Deep Learning for Event-Driven Stock Prediction , 2015, IJCAI.

[115]  Zhou Zimu,et al.  RSSIからCSIへ:チャネルレスポンスによるインドア・ローカリゼーション , 2013 .

[116]  Monica Lam,et al.  Neural network techniques for financial performance prediction: integrating fundamental and technical analysis , 2004, Decis. Support Syst..

[117]  Shu-Hsien Liao,et al.  Data mining investigation of co-movements on the Taiwan and China stock markets for future investment portfolio , 2013, Expert Syst. Appl..

[118]  Hsinchun Chen,et al.  Evaluating sentiment in financial news articles , 2012, Decis. Support Syst..

[119]  Hasan Selim,et al.  A fuzzy rule based expert system for stock evaluation and portfolio construction: An application to Istanbul Stock Exchange , 2013, Expert Syst. Appl..

[120]  R. A. R. C. Gopura,et al.  Financial forecasting based on artificial neural networks: Promising directions for modeling , 2011, 2011 6th International Conference on Industrial and Information Systems.

[121]  Adriano Lorena Inácio de Oliveira,et al.  Automatic method for stock trading combining technical analysis and the Artificial Bee Colony Algorithm , 2013, 2013 IEEE Congress on Evolutionary Computation.

[122]  Milad Jasemi,et al.  A modern neural network model to do stock market timing on the basis of the ancient investment technique of Japanese Candlestick , 2011, Expert Syst. Appl..

[123]  Prodromos D. Chatzoglou,et al.  An intelligent short term stock trading fuzzy system for assisting investors in portfolio management , 2016, Expert Syst. Appl..

[124]  Michal Tkác,et al.  Artificial neural networks in business: Two decades of research , 2016, Appl. Soft Comput..

[125]  Ricardo Colomo Palacios,et al.  CAST: Using neural networks to improve trading systems based on technical analysis by means of the RSI financial indicator , 2011, Expert Syst. Appl..

[126]  Chih-Fong Tsai,et al.  Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches , 2010, Decis. Support Syst..

[127]  Hiok Chai Quek,et al.  Financial volatility trading using a self-organising neural-fuzzy semantic network and option straddle-based approach , 2010, Expert Systems with Applications.

[128]  Sahil Shah,et al.  Predicting stock market index using fusion of machine learning techniques , 2015, Expert Syst. Appl..

[129]  Kazuhiro Seki,et al.  Predicting Stock Market Trends by Recurrent Deep Neural Networks , 2014, PRICAI.

[130]  Chi-Jie Lu,et al.  An efficient CMAC neural network for stock index forecasting , 2011, Expert Syst. Appl..

[131]  Lyubka A. Doukovska,et al.  Design and application of Artificial Neural Networks for predicting the values of indexes on the Bulgarian Stock market , 2013, 2013 Signal Processing Symposium (SPS).

[132]  Cain Evans,et al.  Utilizing artificial neural networks and genetic algorithms to build an algo-trading model for intra-day foreign exchange speculation , 2013, Math. Comput. Model..

[133]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[134]  Kunikazu Kobayashi,et al.  Time series forecasting using a deep belief network with restricted Boltzmann machines , 2014, Neurocomputing.

[135]  Chi-Jie Lu,et al.  Integrating independent component analysis-based denoising scheme with neural network for stock price prediction , 2010, Expert Syst. Appl..