Multi-Objective Cuckoo Search Optimization for Dimensionality Reduction

Commonly, attributes in data sets are originally correlated, noisy and redundant. Thus, attribute reduction is a challenging task as it substantially affects the overall classification accuracy. In this research, a system for attribute reduction was proposed using correlation-based filter model for attribute reduction. The cuckoo search (CS) optimization algorithm was utilized to search the attribute space with minimum correlation among selected attributes. Then, the initially selected solutions, guaranteed to have minor correlation, are candidates for further improvement towards the classification accuracy fitness function. The performance of the proposed system has been tested via implementing it using various data sets. Also, its performance have has been compared against other common attribute reduction algorithms. Experimental results showed that the proposed multi-objective CS system has outperformed the typical single-objective CS optimizer as well as outperforming both the particle swarm optimization (PSO) and genetic algorithm (GA) optimization algorithms.

[1]  Aboul Ella Hassanien,et al.  Wolf search algorithm for attribute reduction in classification , 2014, 2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[2]  Aboul Ella Hassanien,et al.  Multi-Objective Gray-Wolf Optimization for Attribute Reduction , 2015 .

[3]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[4]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[5]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[6]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[7]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[8]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[9]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[10]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[11]  Clifford T. Brown,et al.  Lévy Flights in Dobe Ju/’hoansi Foraging Patterns , 2007 .

[12]  Krzysztof Michalak,et al.  Feature selection in corporate credit rating prediction , 2013, Knowl. Based Syst..