Rough Sets and Evolutionary Computation to Solve the Feature Selection Problem

The feature selection problem has been usually addressed through heuristic approaches given its significant computational complexity. In this context, evolutionary techniques have drawn the researchers’ attention owing to their appealing optimization capabilities. In this chapter, promising results achieved by the authors in solving the feature selection problem through a joint effort between rough set theory and evolutionary computation techniques are reviewed. In particular, two new heuristic search algorithms are introduced, i.e. Dynamic Mesh Optimization and another approach which splits the search process carried out by swarm intelligence methods.

[1]  Andrzej Skowron,et al.  Rough-Fuzzy Hybridization: A New Trend in Decision Making , 1999 .

[2]  José Francisco Martínez-Trinidad,et al.  Progress in Pattern Recognition, Image Analysis and Applications, 12th Iberoamericann Congress on Pattern Recognition, CIARP 2007, Valparaiso, Chile, November 13-16, 2007, Proceedings , 2008, CIARP.

[3]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[4]  Francis Eng Hock Tay,et al.  Economic and financial prediction using rough sets model , 2002, Eur. J. Oper. Res..

[5]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[6]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[7]  Xiangyang Wang,et al.  Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma , 2006, Comput. Methods Programs Biomed..

[8]  Rafael Bello,et al.  A model based on ant colony system and rough set theory to feature selection , 2005, GECCO '05.

[9]  María Matilde García Lorenzo,et al.  Two New Metrics for Feature Selection in Pattern Recognition , 2003, CIARP.

[10]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[12]  Rafael Bello,et al.  Two-Step Particle Swarm Optimization to Solve the Feature Selection Problem , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[13]  Andrzej Skowron,et al.  Rough Sets: A Tutorial , 1998 .

[14]  Qiang Shen,et al.  Finding Rough Set Reducts with Ant Colony Optimization , 2003 .

[15]  Alberto Sanfeliu,et al.  Progress in Pattern Recognition, Speech and Image Analysis , 2003, Lecture Notes in Computer Science.

[16]  Max Bramer,et al.  Artificial Intelligence in Theory and Practice II , 2009 .

[17]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[18]  Sheng-Fa Yuan,et al.  Fault diagnostics based on particle swarm optimisation and support vector machines , 2007 .

[19]  Heinz Mühlenbein,et al.  Schemata, Distributions and Graphical Models in Evolutionary Optimization , 1999, J. Heuristics.

[20]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[21]  Xiangyang Wang,et al.  Finding Minimal Rough Set Reducts with Particle Swarm Optimization , 2005, RSFDGrC.

[22]  Rafael Bello,et al.  Two new feature selection algorithms with Rough Sets Theory , 2006, IFIP AI.

[23]  Thomas Stützle,et al.  Ant Colony Optimization Theory , 2004 .

[24]  Rafael Bello,et al.  Feature Selection through Dynamic Mesh Optimization , 2008, CIARP.

[25]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[26]  Lida Xu,et al.  Feature space theory - a mathematical foundation for data mining , 2001, Knowl. Based Syst..

[27]  Peter Vrancx,et al.  Using ACO and rough set theory to feature selection , 2005 .

[28]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[29]  Jiye Liang,et al.  Inclusion degree: a perspective on measures for rough set data analysis , 2002, Inf. Sci..

[30]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[31]  Jirí Benes,et al.  On neural networks , 1990, Kybernetika.

[32]  Rafael Bello,et al.  Two Step Ant Colony System to Solve the Feature Selection Problem , 2006, CIARP.

[33]  Jerzy Stefanowski,et al.  An experimental evaluation of improving rule based classifiers with two approaches that change representations of learning examples , 2004, Eng. Appl. Artif. Intell..