Two new approaches to feature selection with harmony search

Many search strategies have been exploited in implementing feature selection, in an effort to identify smaller and better subsets. Such work typically involves the use of heuristics in one form or another. In this paper two novel methods are presented by applying harmony search to feature selection. In particular, it demonstrates the potential of utilising this search mechanism in combination with fuzzy-rough feature evaluation. The resulting techniques are compared with approaches that rely on hill-climbing, genetic algorithms and particle swarm optimisation.

[1]  M. Fesanghary,et al.  Combined heat and power economic dispatch by harmony search algorithm , 2007 .

[2]  C. Coello Constraint-Handling using an EvolutionaryMultiobjective Optimization , 2000 .

[3]  Qiang Shen,et al.  Rough set-aided keyword reduction for text categorization , 2001, Appl. Artif. Intell..

[4]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[5]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[6]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[7]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[8]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[9]  Dominik Slezak,et al.  Rough Discretization of Gene Expression Data , 2006, 2006 International Conference on Hybrid Information Technology.

[10]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[11]  Qiang Shen,et al.  Fuzzy-Rough Sets Assisted Attribute Selection , 2007, IEEE Transactions on Fuzzy Systems.

[12]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[13]  Piotr Synak,et al.  Tolerance Based Templates for Information Systems: Foundations and Perspectives , 2006, ICHIT.

[14]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[15]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.