A Comparison between Nature-Inspired and Machine Learning Approaches to Detecting Trend Reversals in Financial Time Series

Detection of turning points is a critical task for financial forecasting applications. This chapter proposes a comparison between two different classification approaches on such a problem. Nature-Inspired methodologies are attracting growing interest due to their ability to cope with complex tasks like classification, forecasting, and anomaly detection problems. A swarm intelligence algorithm, namely Particle Swarm Optimization (PSO), and an artificial immune system algorithm, namely Negative Selection (NS), have been applied to the task of detecting turning points, modeled as an Anomaly Detection (AD) problem. Particular attention has also been given to the choice of the features considered as inputs to the classifiers, due to the significant impact they may have on the overall accuracy of the approach. In this work, starting from a set of eight input features, feature selection has been carried out by means of a greedy hill climbing algorithm, in order to analyze the incidence of feature reduction on the global accuracy of the approach. The performances obtained from the two approaches have also been compared to other traditional machine learning techniques implemented by WEKA and both methods have been found to give interesting results with respect to traditional techniques.

[1]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[2]  D. Dasgupta,et al.  Combining negative selection and classification techniques for anomaly detection , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[4]  Ralph Vince The Handbook of Portfolio Mathematics: Formulas for Optimal Allocation & Leverage , 2007 .

[5]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[6]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[7]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[8]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[9]  Matteo De Felice,et al.  A Study of Nature-Inspired Methods for Financial Trend Reversal Detection , 2010, EvoApplications.

[10]  Melanie Middlemiss,et al.  Positive and negative selection in a multilayer artificial immune system , 2006 .

[11]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[12]  Bing Liang,et al.  Amnestic neural network for classification: application on stock trend prediction , 2005, Proceedings of ICSSSM '05. 2005 International Conference on Services Systems and Services Management, 2005..

[13]  Jean-Philippe Rennard,et al.  Handbook of Research on Nature-inspired Computing for Economics and Management , 2006 .

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  David M. J. Tax,et al.  One-class classification , 2001 .

[16]  Yoav Freund,et al.  The Alternating Decision Tree Learning Algorithm , 1999, ICML.

[17]  Alan S. Perelson,et al.  Self-nonself discrimination in a computer , 1994, Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy.

[18]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[19]  Matteo De Felice,et al.  Soft Computing Techniques for Internet Backbone Traffic Anomaly Detection , 2009, EvoWorkshops.

[20]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[21]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[22]  John G. Cleary,et al.  K*: An Instance-based Learner Using and Entropic Distance Measure , 1995, ICML.

[23]  Ivanoe De Falco,et al.  Facing classification problems with Particle Swarm Optimization , 2007, Appl. Soft Comput..

[24]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[25]  Stephanie Forrest,et al.  A Machine Learning Evaluation of an Artificial Immune System , 2005, Evolutionary Computation.

[26]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[27]  Rich Caruana,et al.  Greedy Attribute Selection , 1994, ICML.

[28]  Fernando Niño,et al.  A Framework for Evolving Multi-Shaped Detectors in Negative Selection , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[29]  Adriano Lorena Inácio de Oliveira,et al.  Predicting stock trends through technical analysis and nearest neighbor classification , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[30]  Shu-Wei Hsu,et al.  The Construction of Stock_s Portfolios by Using Particle Swarm Optimization , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[31]  Claudia Eckert,et al.  Is negative selection appropriate for anomaly detection? , 2005, GECCO '05.

[32]  Bruce J Vanstone,et al.  A survey of the application of soft computing to investment and financial trading , 2003 .

[33]  Edgar E. Peters Chaos and order in the capital markets , 1991 .

[34]  Zhou Ji,et al.  Applicability issues of the real-valued negative selection algorithms , 2006, GECCO.

[35]  Feipei Lai,et al.  An intelligent trend prediction and reversal recognition system using dual-module neural networks , 1991, Proceedings First International Conference on Artificial Intelligence Applications on Wall Street.

[36]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[37]  Fabio A. González,et al.  A Randomized Real-Valued Negative Selection Algorithm , 2003, ICARIS.

[38]  Robert W. Colby,et al.  The Encyclopedia of Technical Market Indicators , 1988 .

[39]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .