An Innovative Approach for Attribute Reduction Using Rough Sets and Flower Pollination Optimisation

Optimal search is a major challenge for wrapper-based attribute reduction. Rough sets have been used with much success, but current hill-climbing rough set approaches to attribute reduction are insufficient for finding optimal solutions. In this paper, we propose an innovative use of an intelligent optimisation method, namely the flower search algorithm (FSA), with rough sets for attribute reduction. FSA is a relatively recent computational intelligence algorithm, which is inspired by the pollination process of flowers. For many applications, the attribute space, besides being very large, is also rough with many different local minima which makes it difficult to converge towards an optimal solution. FSA can adaptively search the attribute space for optimal attribute combinations that maximise a given fitness function, with the fitness function used in our work being rough set-based classification. Experimental results on various benchmark datasets from the UCI repository confirm our technique to perform well in comparison with competing methods.

[1]  Ilya Pavlyukevich Lévy flights, non-local search and simulated annealing , 2007, J. Comput. Phys..

[2]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[3]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[4]  Richard Jensen,et al.  Combining rough and fuzzy sets for feature selection , 2004 .

[5]  Qinglin Guo,et al.  Implement web learning environment based on data mining , 2009, Knowl. Based Syst..

[6]  Yumin Chen,et al.  A rough set approach to feature selection based on power set tree , 2011, Knowl. Based Syst..

[7]  M. Esmel ElAlami A filter model for feature subset selection based on genetic algorithm , 2009, Knowl. Based Syst..

[8]  Jerzy Stefanowski,et al.  On rough set based approaches to induction of decision rules , 1998 .

[9]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[10]  Xin-She Yang,et al.  Flower Pollination Algorithm for Global Optimization , 2012, UCNC.

[11]  Yuchang Lu,et al.  Feature ranking in rough sets , 2003, AI Commun..

[12]  Laura Maria Cannas A framework for feature selection in high-dimensional domains , 2013 .

[13]  Wang Guo,et al.  Decision Table Reduction based on Conditional Information Entropy , 2002 .

[14]  Xin-She Yang,et al.  Multi-Objective Flower Algorithm for Optimization , 2014, ICCS.

[15]  Li Pheng Khoo,et al.  Feature extraction using rough set theory and genetic algorithms--an application for the simplification of product quality evaluation , 2002 .

[16]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..