Feature subset selection by particle swarm optimization with fuzzy fitness function

Feature extraction or feature subset selection is an important preprocessing task for pattern recognition, data mining or machine learning application. Feature subset selection basically depends on selecting a criterion function for evaluation of the feature subset and a search strategy to find the best feature subset from a large number of feature subsets. Lots of techniques have been developed so far, mainly from statistical theory, still research is going on to find better solutions in terms of optimality and computational ease. Recently soft computing techniques are gaining popularity for solving real world problems for their more flexibility compared to statistical or mathematical techniques. In this work an algorithm based on particle swarm optimization with fuzzy fitness function has been proposed for getting optimal feature subset from a feature set with large number of features. Simple simulation experiments with two benchmark data sets show that the proposed method is similar in performance to the results reported earlier and is computationally less demanding in comparison to genetic algorithm, another population based evolutionary search technique proposed earlier for feature subset selection by author.

[1]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[2]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[3]  Basabi Chakraborty,et al.  Fuzzy Set Theoretic Measure for Automatic Feature Evaluation , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[5]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[6]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[7]  Thomas G. Dietterich,et al.  Learning Boolean Concepts in the Presence of Many Irrelevant Features , 1994, Artif. Intell..

[8]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[9]  J. Kennedy,et al.  Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[10]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[11]  D. Agrafiotis,et al.  Feature selection for structure-activity correlation using binary particle swarms. , 2002, Journal of medicinal chemistry.

[12]  Basabi Chakraborty.  Genetic Algorithm with Fuzzy Operators for Feature Subset Selection , 2002, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[13]  Zenglin Xu,et al.  Feature Selection with Particle Swarms , 2004, CIS.

[14]  Erik D. Goodman,et al.  Swarmed feature selection , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[15]  Hong Hu,et al.  Using PSO algorithm to evolve an optimum input subset for a SVM in time series forecasting , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[16]  H. Moghaddam,et al.  Feature Subset Selection for Face Detection Using Genetic Algorithms and Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[17]  Worapoj Kreesuradej,et al.  Input Selection Using Binary Particle Swarm Optimization , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[18]  Li-Yeh Chuang,et al.  Feature Selection using PSO-SVM , 2007, IMECS.

[19]  Lenka Lhotská,et al.  Social Impact based Approach to Feature Subset Selection , 2007, NICSO.

[20]  Tsair-Fwu Lee,et al.  Features Selection of SVM and ANN Using Particle Swarm Optimization for Power Transformers Incipient Fault Symptom Diagnosis , 2007 .

[21]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[22]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[23]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.