Self-adjusting harmony search-based feature selection

Many strategies have been exploited for the task of feature selection, in an effort to identify more compact and better quality feature subsets. The development of nature-inspired stochastic search techniques allows multiple good quality feature subsets to be discovered without resorting to exhaustive search. In particular, harmony search is a recently developed technique mimicking musicians’ experience, which has been effectively utilised to cope with feature selection problems. In this paper, a self-adjusting approach is proposed for feature selection with an aim to further enhance the performance of the existing harmony search-based method. This novel approach includes three dynamic strategies: restricted feature domain, harmony memory consolidation, and pitch adjustment. Systematic experimental evaluations using high dimensional, real-valued benchmark data sets are conducted in order to verify the efficacy of the proposed work.

[1]  Z. Pawlak Rough set approach to knowledge-based decision support , 1997 .

[2]  Hui-Huang Hsu,et al.  Feature Selection via Correlation Coefficient Clustering , 2010, J. Softw..

[3]  Mohammed Azmi Al-Betar,et al.  University Course Timetabling Using a Hybrid Harmony Search Metaheuristic Algorithm , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[5]  Qiang Shen,et al.  Are More Features Better? A Response to Attributes Reduction Using Fuzzy Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[6]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[7]  Bijaya K. Panigrahi,et al.  Exploratory Power of the Harmony Search Algorithm: Analysis and Improvements for Global Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  M. Raju,et al.  Optimal Network Reconfiguration of Large-Scale Distribution System Using Harmony Search Algorithm , 2011, IEEE Transactions on Power Systems.

[9]  R. Bhattacharya,et al.  Nonparametic estimation of location and dispersion on Riemannian manifolds , 2002 .

[10]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[11]  Xin-She Yang Harmony Search as a Metaheuristic Algorithm , 2009 .

[12]  Chris Cornelis,et al.  Fuzzy Rough Sets: The Forgotten Step , 2007, IEEE Transactions on Fuzzy Systems.

[13]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2007 .

[14]  Mario Marchand,et al.  Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Morteza Haghir Chehreghani,et al.  Novel meta-heuristic algorithms for clustering web documents , 2008, Appl. Math. Comput..

[16]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[17]  K. Lee,et al.  A new structural optimization method based on the harmony search algorithm , 2004 .

[18]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[19]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[20]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[21]  M. Mahdavi,et al.  ARTICLE IN PRESS Available online at www.sciencedirect.com , 2007 .

[22]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Witold Pedrycz,et al.  A Tabu–Harmony Search-Based Approach to Fuzzy Linear Regression , 2011, IEEE Transactions on Fuzzy Systems.

[24]  R. Boggia,et al.  Genetic algorithms as a strategy for feature selection , 1992 .

[25]  Michael I. Jordan,et al.  Feature selection for high-dimensional genomic microarray data , 2001, ICML.

[26]  Ehl Emile Aarts,et al.  Simulated annealing : an introduction , 1989 .

[27]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[28]  Ian Witten,et al.  Data Mining , 2000 .

[29]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.

[30]  Reyer Zwiggelaar,et al.  Fuzzy-rough approaches for mammographic risk analysis , 2010, Intell. Data Anal..

[31]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[32]  Yoshua Bengio,et al.  Série Scientifique Scientific Series No Unbiased Estimator of the Variance of K-fold Cross-validation No Unbiased Estimator of the Variance of K-fold Cross-validation , 2022 .

[33]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[34]  Amitava Chatterjee,et al.  Design of a Hybrid Stable Adaptive Fuzzy Controller Employing Lyapunov Theory and Harmony Search Algorithm , 2010, IEEE Transactions on Control Systems Technology.

[35]  Qiang Shen,et al.  Two new approaches to feature selection with harmony search , 2010, International Conference on Fuzzy Systems.

[36]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[37]  Zong Woo Geem,et al.  Recent Advances In Harmony Search Algorithm , 2010, Recent Advances In Harmony Search Algorithm.

[38]  Changjing Shang,et al.  Fuzzy-rough feature selection aided support vector machines for Mars image classification , 2013, Comput. Vis. Image Underst..

[39]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  R. Bellman Dynamic programming. , 1957, Science.

[42]  Ling Zheng,et al.  Efficient feature selection using a self-adjusting harmony search algorithm , 2013, 2013 13th UK Workshop on Computational Intelligence (UKCI).

[43]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[44]  Xizhao Wang,et al.  Attributes Reduction Using Fuzzy Rough Sets , 2008, IEEE Transactions on Fuzzy Systems.

[45]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[46]  Nikhil R. Pal,et al.  Genetic programming for simultaneous feature selection and classifier design , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  M. Fesanghary,et al.  Combined heat and power economic dispatch by harmony search algorithm , 2007 .

[48]  Lajos Hanzo,et al.  Iterative Multiuser Detection and Channel Decoding for DS-CDMA Using Harmony Search , 2009, IEEE Signal Processing Letters.