A Review on Evolutionary Feature Selection

This paper presents a review of some of the most recent evolutionary algorithms used for solving feature selection based upon previously published research on feature selection. In addition, we discuss various research issues relating to each of the presented evolutionary algorithm. Evolutionary algorithms present several advantages over traditional search such as they require less domain-specific information. Such advantages have made them very popular within feature selection as explained in this paper. This paper covers the first part only of the evolutionary algorithms for the feature selection problem due to the limitation of the number of pages. The references cited in this paper cover the major theoretical issues, and provide access to the main branches of the literature dealing with such methods.

[1]  Seyed Mohammad Hosseini,et al.  A Novel Weighted Support Vector Machine Based on Particle Swarm Optimization for Gene Selection and Tumor Classification , 2012, Comput. Math. Methods Medicine.

[2]  Jacob Scharcanski,et al.  Feature selection for face recognition based on multi-objective evolutionary wrappers , 2013, Expert Syst. Appl..

[3]  Jihoon Yang,et al.  Experimental Comparison of Feature Subset Selection Using GA and ACO Algorithm , 2006, ADMA.

[4]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[5]  Sreeram Ramakrishnan,et al.  A hybrid approach for feature subset selection using neural networks and ant colony optimization , 2007, Expert Syst. Appl..

[6]  Paulo Cortez,et al.  Data Mining with , 2005 .

[7]  H. Abbasimehr,et al.  A Novel Genetic Algorithm Based Method for Building Accurate and Comprehensible Churn Prediction Models , 2013 .

[8]  Marcus Randall,et al.  Investigating the Effect of Fixing the Subset Length Using Ant Colony Optimization Algorithms for Feature Subset Selection Problems , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[9]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[10]  Hong Pan,et al.  Fusing multi-feature representation and PSO-Adaboost based feature selection for reliable frontal face detection , 2013, 2013 IEEE International Conference on Image Processing.

[11]  Marcus Randall,et al.  Feature Selection for Classification Using an Ant Colony System , 2010, 2010 Sixth IEEE International Conference on e-Science Workshops.

[12]  C.J.H. Mann,et al.  Handbook of Data Mining and Knowledge Discovery , 2004 .

[13]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[14]  Ee-Peng Lim,et al.  Web classification using support vector machine , 2002, WIDM '02.

[15]  Mahdi Eftekhari,et al.  A Feature Selection Method Based on ∩ - Fuzzy Similarity Measures Using Multi Objective Genetic Algorithm , 2013 .

[16]  Duy-Dinh Le,et al.  An Efficient Feature Selection Method for Object Detection , 2005, ICAPR.

[17]  Qiang Shen,et al.  Finding Rough Set Reducts with Ant Colony Optimization , 2003 .

[18]  Nanna Suryana,et al.  Combining Particle Swarm Optimization based Feature Selection and Bagging Technique for Software Defect Prediction , 2013 .

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[21]  Rafael Bello,et al.  A model based on ant colony system and rough set theory to feature selection , 2005, GECCO '05.

[22]  Zeyu Sun,et al.  RESEARCH OF COMBINATORIAL OPTIMIZATION PROBLEM BASED ON GENETIC ANT COLONY ALGORITHM , 2013 .

[23]  Muhammad Nazir,et al.  PSO-GA Based Optimized Feature Selection Using Facial and Clothing Information for Gender Classification , 2014 .

[24]  Houkuan Huang,et al.  Feature selection for text classification with Naïve Bayes , 2009, Expert Syst. Appl..

[25]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[26]  Adel Al-Jumaily,et al.  A Combined Ant Colony and Differential Evolution Feature Selection Algorithm , 2008, ANTS Conference.

[27]  Ghassan Kanaan,et al.  Text Feature Selection using Particle Swarm Optimization Algorithm , 2009 .

[28]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Nasser Ghasem-Aghaee,et al.  A novel ACO-GA hybrid algorithm for feature selection in protein function prediction , 2009, Expert Syst. Appl..

[30]  Paul F. Whelan,et al.  Machine Vision Algorithms in Java: Techniques and Implementation , 2000 .

[31]  Lisa Ann Osadciw,et al.  Feature selection optimized by discrete particle swarm optimization for face recognition , 2009, Defense + Commercial Sensing.

[32]  Thomas Serre,et al.  Feature Selection for Face Detection , 2000 .

[33]  Ebroul Izquierdo,et al.  Image classification using biologically inspired systems , 2006, MobiMedia '06.

[34]  Anupam Shukla,et al.  Real Life Applications of Soft Computing , 2010 .

[35]  Jihoon Yang,et al.  Experimental Comparison of Feature Subset Selection Methods , 2007 .

[36]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[37]  Lipo Wang,et al.  Data Mining With Computational Intelligence , 2006, IEEE Transactions on Neural Networks.

[38]  Figen Ertaş,et al.  FEATURE SELECTION AND CLASSIFICATION TECHNIQUES FOR SPEAKER RECOGNITION , 2001 .

[39]  Fernando Pérez-Cruz,et al.  Enhancing genetic feature selection through restricted search and Walsh analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  Christian Blum,et al.  Ant colony optimization: Introduction and recent trends , 2005 .

[41]  Akash Khandelwal,et al.  In silico ADME modelling 2: computational models to predict human serum albumin binding affinity using ant colony systems. , 2006, Bioorganic & medicinal chemistry.

[42]  Johannes Gehrke,et al.  Data Mining with Decision Trees , 2000, ICDE.

[43]  Ahmed Al-Ani.  Ant Colony Optimization for Feature Subset Selection , 2005, WEC.

[44]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[45]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[46]  Z. Michalewicz,et al.  A new version of ant system for subset problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[47]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[48]  R. M. Rizk-Allah,et al.  A Novel Hybrid Ant Colony Optimization and Firefly Algorithm for Solving Constrained Engineering Design Problems , 2013 .

[49]  Edward R. Dougherty,et al.  Feature selection algorithms to find strong genes , 2005, Pattern Recognit. Lett..

[50]  Andreas D. Baxevanis,et al.  Bioinformatics - a practical guide to the analysis of genes and proteins , 2001, Methods of biochemical analysis.

[51]  Sholom M. Weiss,et al.  Predictive data mining - a practical guide , 1997 .

[52]  Bin Hu,et al.  Hybrid Feature Selection Based on Improved Genetic Algorithm , 2013 .

[53]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[54]  Chee Peng Lim,et al.  Advances in Swarm Intelligence , 2009, Innovations in Swarm Intelligence.

[55]  W. Gutjahr.  A GENERALIZED CONVERGENCE RESULT FOR THE GRAPH-BASED ANT SYSTEM METAHEURISTIC , 2003, Probability in the Engineering and Informational Sciences.

[56]  David A. Fenstermacher,et al.  Introduction to bioinformatics , 2005, J. Assoc. Inf. Sci. Technol..

[57]  M. Indra Devi,et al.  Feature Selection for Web Page Classification , 2009 .

[58]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .

[59]  Jafar Tanha,et al.  Combination of Ant Colony Optimization and Bayesian Classification for Feature Selection in a Bioinformatics Dataset , 2009, Journal of Computer Science & Systems Biology.

[60]  Witold Pedrycz,et al.  Data Mining Methods for Knowledge Discovery , 1998, IEEE Trans. Neural Networks.

[61]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[62]  Carlos A. Coello Coello,et al.  A Review of Particle Swarm Optimization Methods Used for Multimodal Optimization , 2009, Innovations in Swarm Intelligence.

[63]  G. Theraulaz,et al.  Inspiration for optimization from social insect behaviour , 2000, Nature.

[64]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[65]  Shaogang Gong,et al.  Dynamic Vision - From Images to Face Recognition , 2000 .

[66]  Paul F. Whelan,et al.  Machine Vision Algorithms in Java , 2001 .

[67]  Dr. C. Chandrasekar,et al.  Modified PSO Based Feature Selection for Classification of Lung CT Images , 2014 .

[68]  Dell Zhang,et al.  Question classification using support vector machines , 2003, SIGIR.

[69]  Nong Ye,et al.  The Handbook of Data Mining , 2003 .

[70]  Erin James Montgomery,et al.  Solution biases and pheromone representation selection in ant colony optimisation , 2005 .

[71]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[72]  Kamaladdin Fataliyev,et al.  Feature Selection for Stock Market Analysis , 2013, ICONIP.