Parasitism – Predation algorithm (PPA): A novel approach for feature selection

Abstract Maximizing the classification accuracy and minimizing the number of selected features are the two main incompatible objectives for using feature selection to overcome the curse of dimensionality. “Classification accuracy highly dependents on the nature of the features in a dataset which may contain irrelevant or redundant data. The main aim of feature selection is to eliminate these types of features to enhance the classification accuracy.” This work presents a new meta-heuristic optimization approach, called Parasitism-Predation Algorithm (PPA), which mimics the interaction between the predator (cats), the parasite (cuckoos) and the host (crows) in the crow–cuckoo–cat system model to overcome the problems of low convergence and the curse of dimensionality of large data. The proposed hybrid framework combines the relative advantages of cat swarm optimization (CSO), cuckoo search (CS) and crow search algorithm (CSA) to attain a combinatorial set of features to boost up the classification accuracy. Nesting, parasitism, and predation phases are supposed to help exploration ability and balance in the context of solving classification problems. In addition, Levy flight distribution is applied to help better diversity of conventional CSA and improve ability of exploration. Meanwhile, an effective fitness function is utilized to enable the proposed PPA-based feature selector using K-Nearest Neighbors algorithm (KNN) to attain a combinatorial set of features. The proposed PPA and four standard heuristic search algorithms are looked at to gauge how efficient the proposed option is. Additionally, eighteen classification datasets are deployed to gauges its efficacy. The results highlight that the algorithm proposed is both effective and competitive in terms of performance of classification and dimensionality reduction as opposed to other heuristic options.

[1]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[2]  P. Haemig Symbiotic nesting of birds with formidable animals: a review with applications to biodiversity conservation , 2001, Biodiversity & Conservation.

[3]  Arezoo Zakeri,et al.  Efficient feature selection method using real-valued grasshopper optimization algorithm , 2019, Expert Syst. Appl..

[4]  Yuanshi Wang,et al.  Transition of interactions between a cuckoo and its host: Fluctuating between parasitism and mutualism , 2016, Appl. Math. Comput..

[5]  V. K. Koumousis,et al.  A saw-tooth genetic algorithm combining the effects of variable population size and reinitialization to enhance performance , 2006, IEEE Transactions on Evolutionary Computation.

[6]  Yuanshi Wang Mutualisms in a parasitism–predation system consisting of crows, cuckoos and cats , 2016 .

[7]  Aboul Ella Hassanien,et al.  Modified cuckoo search algorithm with rough sets for feature selection , 2018, Neural Computing and Applications.

[8]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[9]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[10]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[11]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[12]  Xin-She Yang,et al.  Cuckoo search: recent advances and applications , 2013, Neural Computing and Applications.

[13]  R. Mantegna,et al.  Fast, accurate algorithm for numerical simulation of Lévy stable stochastic processes. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[14]  Yong Zhang,et al.  A PSO-based multi-objective multi-label feature selection method in classification , 2017, Scientific Reports.

[15]  F Bartumeus,et al.  Optimizing the encounter rate in biological interactions: Lévy versus Brownian strategies. , 2002, Physical review letters.

[16]  D. DeAngelis,et al.  A parasitism-mutualism-predation model consisting of crows, cuckoos and cats with stage-structure and maturation delays on crows and cuckoos. , 2018, Journal of theoretical biology.

[17]  Labiba Souici-Meslati,et al.  Hybrid ACO-PSO Based Approaches for Feature Selection , 2016 .

[18]  Yudong Zhang,et al.  Binary PSO with mutation operator for feature selection using decision tree applied to spam detection , 2014, Knowl. Based Syst..

[19]  Kamlesh Mistry,et al.  Feature selection using firefly optimization for classification and regression models , 2018, Decis. Support Syst..

[20]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[21]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[22]  Antonio J. Nebro,et al.  A survey of multi-objective metaheuristics applied to structural optimization , 2014 .

[23]  J. Martin Marcos,et al.  From Parasitism to Mutualism: Unexpected Interactions Between a Cuckoo and Its Host , 2014, Science.

[24]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[25]  Mengjie Zhang,et al.  Differential evolution for filter feature selection based on information theory and feature ranking , 2018, Knowl. Based Syst..

[26]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[27]  P. Barthelemy,et al.  A Lévy flight for light , 2008, Nature.

[28]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[29]  John Paul T. Yusiong,et al.  Optimizing Artificial Neural Networks using Cat Swarm Optimization Algorithm , 2012 .

[30]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[31]  Sakti Prasad Ghoshal,et al.  Cat Swarm Optimization algorithm for optimal linear phase FIR filter design. , 2013, ISA transactions.

[32]  Shu-Chuan Chu,et al.  COMPUTATIONAL INTELLIGENCE BASED ON THE BEHAVIOR OF CATS , 2007 .

[33]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[34]  Parham Moradi,et al.  An unsupervised feature selection algorithm based on ant colony optimization , 2014, Eng. Appl. Artif. Intell..

[35]  L. Faria,et al.  Prey dynamics under generalist predator culling in stage structured models. , 2017, Mathematical biosciences.

[36]  S. Kanmani,et al.  A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC Hybrid) , 2017, Swarm Evol. Comput..

[37]  Chicks of the Great Spotted Cuckoo May Turn Brood Parasitism into Mutualism by Producing a Foul-Smelling Secretion that Repels Predators , 2014, Journal of Chemical Ecology.

[38]  Sze-Bi Hsu,et al.  On the dynamics of two-consumers-one-resource competing systems with Beddington-DeAngelis functional response , 2013 .

[39]  J. Soler,et al.  Brood-parasite interactions between great spotted cuckoos and magpies: a model system for studying coevolutionary relationships , 2000, Oecologia.

[40]  Sankalap Arora,et al.  Binary butterfly optimization approaches for feature selection , 2019, Expert Syst. Appl..

[41]  Ganapati Panda,et al.  Solving multiobjective problems using cat swarm optimization , 2012, Expert Syst. Appl..

[42]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..