Two Step Swarm Intelligence to Solve the Feature Selection Problem

In this paper we propose a new approach to Swarm Intelligence called Two-Step Swarm Intelligence. The basic idea is to split the heuristic search performed by agents into two stages. In the first step the agents build partial solutions which, are used as initial states in the second step. We have studied the performance of this new approach for the Feature Selection Problem by using Ant Colony Optimization and Particle Swarm Optimization. The feature selection is based on the reduct concept of the Rough Set Theory. Experimental results obtained show that Two-step approach improves the performance of ACO and PSO metaheuristics when calculating reducts in terms of computation time cost and the quality of reducts.

[1]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[2]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[3]  Sheng-Fa Yuan,et al.  Fault diagnostics based on particle swarm optimisation and support vector machines , 2007 .

[4]  Xiangyang Wang,et al.  Finding Minimal Rough Set Reducts with Particle Swarm Optimization , 2005, RSFDGrC.

[5]  Pavel Pudil,et al.  Feature selection toolbox , 2002, Pattern Recognit..

[6]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[7]  Jerzy Stefanowski,et al.  An experimental evaluation of improving rule based classifiers with two approaches that change representations of learning examples , 2004, Eng. Appl. Artif. Intell..

[8]  Ravi Kothari,et al.  Feature subset selection using a new definition of classifiability , 2003, Pattern Recognit. Lett..

[9]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[10]  Pedro Larrañaga,et al.  Feature Subset Selection by Bayesian network-based optimization , 2000, Artif. Intell..

[11]  Lida Xu,et al.  Feature space theory - a mathematical foundation for data mining , 2001, Knowl. Based Syst..

[12]  Peter Vrancx,et al.  Using ACO and rough set theory to feature selection , 2005 .

[13]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[15]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[16]  Andrzej Skowron,et al.  Rough-Fuzzy Hybridization: A New Trend in Decision Making , 1999 .

[17]  Francis Eng Hock Tay,et al.  A Modified Chi2 Algorithm for Discretization , 2002, IEEE Trans. Knowl. Data Eng..

[18]  Terence Soule,et al.  Comparison of Genetic Algorithm and Particle Swarm Optimizer When Evolving a Recurrent Neural Network , 2003, GECCO.

[19]  Jiye Liang,et al.  Inclusion degree: a perspective on measures for rough set data analysis , 2002, Inf. Sci..

[20]  Hongbin Zhang,et al.  Feature selection using tabu search method , 2002, Pattern Recognit..

[21]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[22]  Francis Eng Hock Tay,et al.  Economic and financial prediction using rough sets model , 2002, Eur. J. Oper. Res..

[23]  Xiangyang Wang,et al.  Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma , 2006, Comput. Methods Programs Biomed..

[24]  Qiang Shen,et al.  Finding Rough Set Reducts with Ant Colony Optimization , 2003 .

[25]  Rafael Bello,et al.  A model based on ant colony system and rough set theory to feature selection , 2005, GECCO '05.

[26]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[27]  Tiago Ferra de Sousa,et al.  A Particle Swarm Data Miner , 2003, EPIA.