Hybrid Systems to Select Variables for Time Series Forecasting Using MLP and Search Algorithms

Research on time series forecasting has been an area of considerable interest in recent decades. Several techniques have been researched for time series forecasting. There is a fundamental task in any area of knowledge of time series: use past values to predict future values from the available historical series. Thus, a very important step is to define which of these past values will be considered in the prediction process. In this paper it is proposed two hybrid systems to select variables: Harmony Search and Neural Networks (HS + MLP) and Temporal Memory Search and Neural Networks (TMS + MLP). The variables selections improves the performance of learning models by eliminating redundant or irrelevant attributes. To perform a comparative study between the techniques, ten real-world time series were used.

[1]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[2]  A. Campoccia,et al.  GA-based feature selection for faults identification in electrical distribution systems , 1999, PowerTech Budapest 99. Abstract Records. (Cat. No.99EX376).

[3]  Nong Sang,et al.  Feature selection using a radial basis function neural network based on fuzzy set theoretic measure , 2003, International Symposium on Multispectral Image Processing and Pattern Recognition.

[4]  Zong Woo Geem,et al.  Harmony Search for Generalized Orienteering Problem: Best Touring in China , 2005, ICNC.

[5]  Cong Wang,et al.  Feature Selection: A Hybrid Approach Based on Self-Adaptive Ant Colony and Support Vector Machine , 2008, 2008 International Conference on Computer Science and Software Engineering.

[6]  Shiyu Zhou,et al.  Automatic feature selection for unsupervised clustering of cycle-based signals in manufacturing processes , 2005 .

[7]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[8]  Zong Woo Geem,et al.  Harmony Search Optimization: Application to Pipe Network Design , 2002 .

[9]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[10]  Bernhard Schölkopf,et al.  Feature Selection for Troubleshooting in Complex Assembly Lines , 2007, IEEE Transactions on Automation Science and Engineering.

[11]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[12]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[13]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[14]  K. Lee,et al.  A new structural optimization method based on the harmony search algorithm , 2004 .

[15]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[16]  Z. Geem,et al.  PARAMETER ESTIMATION OF THE NONLINEAR MUSKINGUM MODEL USING HARMONY SEARCH 1 , 2001 .

[17]  Richard Jensen,et al.  Performing Feature Selection with ACO , 2006, Swarm Intelligence in Data Mining.

[18]  Antanas Verikas,et al.  Feature selection with neural networks , 2002, Pattern Recognit. Lett..