Improved PSO-based feature construction algorithm using Feature Selection Methods

Feature construction (FC) can improve the classification performance by creating powerful features from the original ones. Particle Swarm Optimization (PSO) is a global search technique that can construct features directly. We believe that using raw features may lead the PSO-based FC method to an inefficient feature, so in this paper, the aim is to select the prominent features before applying PSO-based FC method. The Forward Feature Selection (FFS) method is used for selecting more informative feature subset from original set and constructing feature by the selected ones. Experimental results show that the proposed method can increase the accuracy by constructing a new powerful feature.

[1]  Mark Johnston,et al.  Feature Construction and Dimension Reduction Using Genetic Programming , 2007, Australian Conference on Artificial Intelligence.

[2]  Mengjie Zhang,et al.  PSO for feature construction and binary classification , 2013, GECCO '13.

[3]  Larry Bull,et al.  Genetic Programming with a Genetic Algorithm for Feature Construction and Selection , 2005, Genetic Programming and Evolvable Machines.

[4]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[5]  Verónica Bolón-Canedo,et al.  A review of microarray datasets and applied feature selection methods , 2014, Inf. Sci..

[6]  Rui Zou,et al.  Particle Swarm Optimization-Based Source Seeking , 2015, IEEE Transactions on Automation Science and Engineering.

[7]  Mengjie Zhang,et al.  New Representations in PSO for Feature Construction in Classification , 2014, EvoApplications.

[8]  Mengjie Zhang,et al.  Improving performance for classification with incomplete data using wrapper-based feature selection , 2016, Evol. Intell..

[9]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[10]  Fernando E. B. Otero,et al.  Genetic Programming for Attribute Construction in Data Mining , 2002, EuroGP.

[11]  Alper Ekrem Murat,et al.  A discrete particle swarm optimization method for feature selection in binary classification problems , 2010, Eur. J. Oper. Res..

[12]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[13]  Mengjie Zhang,et al.  Genetic programming for feature construction and selection in classification on high-dimensional data , 2016, Memetic Comput..