Fuzzy Population-Based Meta-Heuristic Approaches for Attribute Reduction in Rough Set Theory

Abstract—One of the global combinatorial optimization problems in machine learning is feature selection. It concerned with removing the irrelevant, noisy, and redundant data, along with keeping the original meaning of the original data. Attribute reduction in rough set theory is an important feature selection method. Since attribute reduction is an NP-hard problem, it is necessary to investigate fast and effective approximate algorithms. In this paper, we proposed two feature selection mechanisms based on memetic algorithms (MAs) which combine the genetic algorithm with a fuzzy record to record travel algorithm and a fuzzy controlled great deluge algorithm, to identify a good balance between local search and genetic search. In order to verify the proposed approaches, numerical experiments are carried out on thirteen datasets. The results show that the MAs approaches are efficient in solving attribute reduction problems when compared with other meta-heuristic approaches.

[1]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[2]  William E. Hart,et al.  Recent Advances in Memetic Algorithms , 2008 .

[3]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[4]  Andrzej Skowron,et al.  Dynamic Reducts as a Tool for Extracting Laws from Decisions Tables , 1994, ISMIS.

[5]  Salwani Abdullah,et al.  Investigating composite neighbourhood structure for attribute reduction in rough set theory , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[6]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[7]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Masao Fukushima,et al.  Tabu search for attribute reduction in rough set theory , 2008, Soft Comput..

[9]  Salwani Abdullah,et al.  Modified great deluge for attribute reduction in rough set theory , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[10]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[11]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[12]  Earl Cox,et al.  The fuzzy systems handbook - a practitioner's guide to building, using, and maintaining fuzzy systems , 1994 .

[13]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[14]  Qiang Shen,et al.  Finding Rough Set Reducts with Ant Colony Optimization , 2003 .

[15]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[16]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[17]  Shouyang Wang,et al.  Scatter Search for Rough Set Attribute Reduction , 2007, 2009 International Joint Conference on Computational Sciences and Optimization.

[18]  Yahya Z. Arajy,et al.  Hybrid variable neighbourhood search algorithm for attribute reduction in Rough Set Theory , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[21]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[22]  Nasser R. Sabar,et al.  A constructive hyper-heuristics for rough set attribute reduction , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[23]  Aleksander Øhrn,et al.  Discernibility and Rough Sets in Medicine: Tools and Applications , 2000 .

[24]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[25]  Daphne Koller,et al.  Toward Optimal Feature Selection , 1996, ICML.

[26]  Qiang Shen,et al.  Fuzzy-rough sets for descriptive dimensionality reduction , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[27]  S. Chen,et al.  Fast and accurate feature selection using hybrid genetic strategies , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  G. Dueck.  New optimization heuristics , 1993 .

[29]  Zdzisław Pawlak,et al.  Rough sets and data analysis , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[30]  Salwani Abdullah,et al.  Great Deluge Algorithm for Rough Set Attribute Reduction , 2010, FGIT-DTA/BSBT.

[31]  Ning Zhong,et al.  Using Rough Sets with Heuristics for Feature Selection , 1999, RSFDGrC.

[32]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[33]  Natalio Krasnogor,et al.  Studies on the theory and design space of memetic algorithms , 2002 .

[34]  Zuren Feng,et al.  An efficient ant colony optimization approach to attribute reduction in rough set theory , 2008, Pattern Recognit. Lett..

[35]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[36]  Nasser R. Sabar,et al.  An Exponential Monte-Carlo algorithm for feature selection problems , 2014, Comput. Ind. Eng..

[37]  Sergios Theodoridis,et al.  Pattern Recognition, Third Edition , 2006 .

[38]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.