New Rough Set Attribute Reduction Algorithm Based on Grey Wolf Optimization

In this paper, we propose a new attribute reduction strategy based on rough sets and grey wolf optimization (GWO). Rough sets have been used as an attribute reduction technique with much success, but current hill-climbing rough set approaches to attribute reduction are inconvenient at finding optimal reductions as no perfect heuristic can guarantee optimality. Otherwise, complete searches are not feasible for even medium sized datasets. So, stochastic approaches provide a promising attribute reduction technique. Like Genetic Algorithms, GWO is a new evolutionary computation technique, mimics the leadership hierarchy and hunting mechanism of grey wolves in nature. The grey wolf optimization find optimal regions of the complex search space through the interaction of individuals in the population. Compared with GAs, GWO does not need complex operators such as crossover and mutation, it requires only primitive and easy mathematical operators, and is computationally inexpensive in terms of both memory and runtime. Experimentation is carried out, using UCI data, which compares the proposed algorithm with a GA-based approach and other deterministic rough set reduction algorithms. The results show that GWO is efficient for rough set-based attribute reduction.

[1]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[2]  M. Esmel ElAlami A filter model for feature subset selection based on genetic algorithm , 2009, Knowl. Based Syst..

[3]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[4]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[5]  Laura Maria Cannas A framework for feature selection in high-dimensional domains , 2013 .

[6]  Wang Guo,et al.  Decision Table Reduction based on Conditional Information Entropy , 2002 .

[7]  Yumin Chen,et al.  A rough set approach to feature selection based on power set tree , 2011, Knowl. Based Syst..

[8]  Yuchang Lu,et al.  Feature ranking in rough sets , 2003, AI Commun..

[9]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[10]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[11]  Qinglin Guo,et al.  Implement web learning environment based on data mining , 2009, Knowl. Based Syst..

[12]  Richard Jensen,et al.  Combining rough and fuzzy sets for feature selection , 2004 .

[13]  Li Pheng Khoo,et al.  Feature extraction using rough set theory and genetic algorithms--an application for the simplification of product quality evaluation , 2002 .

[14]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..