Elitist Quantum-Inspired Differential Evolution Based Wrapper for Feature Subset Selection

In a Feature Subset Selection (FSS) problem, the objective is to obtain an optimal feature subset on which the learning algorithm can focus and neglect the irrelevant features. A wrapper formulates the FSS as a combinatorial optimization problem. In this paper, we propose an elitist quantum inspired Differential Evolution (QDE) algorithm for FSS. The performance of QDE is found to be significantly better than that of Binary Differential Evolution (BDE) algorithm on three benchmark problems taken from literature. In both cases, logistic regression was chosen as the classifier. Further, QDE outperformed not only the extant algorithms reported in literature but also the t-statistic cum logistic regression based filter method for FSS.

[1]  Siti Mariyam Shamsuddin,et al.  Quantum-inspired particle swarm optimization for feature selection and parameter optimization in evolving spiking neural networks for classification tasks , 2011 .

[2]  Ron Kohavi,et al.  Wrappers for feature selection , 1997 .

[3]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..

[4]  Ankit Pat,et al.  An adaptive quantum-inspired differential evolution algorithm for 0–1 knapsack problem , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[5]  Huiqing Liu,et al.  A comparative study on feature selection and classification methods using gene expression profiles and proteomic patterns. , 2002, Genome informatics. International Conference on Genome Informatics.

[6]  Liu Zhiming,et al.  Solving 0-1 Knapsack Problems by a Discrete Binary Version of Differential Evolution , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[7]  Olvi L. Mangasarian,et al.  Nuclear feature extraction for breast tumor diagnosis , 1993, Electronic Imaging.

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Lov K. Grover.  A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[10]  Max A. Little,et al.  Exploiting Nonlinear Recurrence and Fractal Scaling Properties for Voice Disorder Detection , 2007, Biomedical engineering online.

[11]  Max A. Little,et al.  Accurate Telemonitoring of Parkinson's Disease Progression by Noninvasive Speech Tests , 2009, IEEE Transactions on Biomedical Engineering.

[12]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[13]  Andries Petrus Engelbrecht,et al.  Binary differential evolution strategies , 2007, 2007 IEEE Congress on Evolutionary Computation.

[14]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..

[15]  Hao Chen,et al.  Optimal feature selection algorithm based on quantum-inspired clone genetic strategy in text categorization , 2009, GEC '09.

[16]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[17]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[18]  Mohamed Batouche,et al.  A Quantum-Inspired Differential Evolution Algorithm for Solving the N-Queens Problem , 2010, Int. Arab J. Inf. Technol..