A Simultaneous Moth Flame Optimizer Feature Selection Approach Based on Levy Flight and Selection Operators for Medical Diagnosis

This paper proposes an effective wrapper approach by integrating the Levy flight and evolutionary selection operators into the Moth Flame Optimization (MFO) algorithm. The main purpose is to solve the Feature Selection (FS) problem in medical applications. FS is used as a preprocessing step in a data mining process to improve the performance of the classification system by eliminating irrelevant and redundant features from a dataset. This simplifies the generalization process and reduces the complexity of the generating models. Furthermore, it speeds up the learning process and reduces the cost for additional hardware resources. However, FS is a challenging NP-hard problem because the search space grows exponentially with an increase in the number of features. In this paper, the swarming behavior of the moths is utilized by using the MFO optimizer as a search strategy within a wrapper approach. The Levy flight operator is proposed to enhance the exploratory behavior of the MFO and mitigate the stagnation in local minima. Different selection mechanisms: random selection (RS), tournament selection (TS), and roulette wheel selection (RWS) methods, are investigated to decrease the bias of the MFO algorithm toward exploitation. These selection operators are proposed in the combination of the Levy flight in the form of four different FS methods LBMFO-R1, LBMFO-R2, LBMFO-TS, and LBMFO-RWS. The proposed methods are validated using 23 medical data sets from well-regarded data repositories. The comprehensive results and various comparisons reveal that the Levy flight and selection operators have a great positive impact on the performance of the MFO. They enhance the exploration, convergence trends, and diversity of solutions.

[1]  Seyedali Mirjalili,et al.  Approaches to Multi-Objective Feature Selection: A Systematic Literature Review , 2020, IEEE Access.

[2]  S. Gunasundari,et al.  Velocity Bounded Boolean Particle Swarm Optimization for improved feature selection in liver and kidney disease diagnosis , 2016, Expert Syst. Appl..

[3]  Mohammed Azmi Al-Betar,et al.  Tournament-based harmony search algorithm for non-convex economic load dispatch problem , 2016, Appl. Soft Comput..

[4]  Aboul Ella Hassanien,et al.  An improved moth flame optimization algorithm based on rough sets for tomato diseases detection , 2017, Comput. Electron. Agric..

[5]  Ahmad Taher Azar,et al.  Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis , 2014, Comput. Methods Programs Biomed..

[6]  Nor Ashidi Mat Isa,et al.  A GA-based feature selection and parameter optimization of an ANN in diagnosing breast cancer , 2015, Pattern Analysis and Applications.

[7]  Hossam Faris,et al.  Bat-inspired algorithms with natural selection mechanisms for global optimization , 2018, Neurocomputing.

[8]  S. C. Neoh,et al.  A Micro-GA Embedded PSO Feature Selection Approach to Intelligent Facial Emotion Recognition , 2017, IEEE Transactions on Cybernetics.

[9]  Oguz Findik,et al.  A comparison of feature selection models utilizing binary particle swarm optimization and genetic algorithm in determining coronary artery disease using support vector machine , 2010, Expert Syst. Appl..

[10]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[11]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[12]  Hossam Faris,et al.  Cost-sensitive ensemble methods for bankruptcy prediction in a highly imbalanced data distribution: a real case from the Spanish market , 2020, Progress in Artificial Intelligence.

[13]  Aboul Ella Hassanien,et al.  A hybrid SA-MFO algorithm for function optimization and engineering design problems , 2018 .

[14]  Aboul Ella Hassanien,et al.  Moth-flame swarm optimization with neutrosophic sets for automatic mitosis detection in breast cancer histology images , 2017, Applied Intelligence.

[15]  Khairul Akram Zainol Ariffin,et al.  Improved Harris Hawks Optimization Using Elite Opposition-Based Learning and Novel Search Mechanism for Feature Selection , 2020, IEEE Access.

[16]  Hossam Faris,et al.  Binary grasshopper optimisation algorithm approaches for feature selection problems , 2019, Expert Syst. Appl..

[17]  Pa-Chun Wang,et al.  Particle swarm optimization for feature selection with application in obstructive sleep apnea diagnosis , 2011, Neural Computing and Applications.

[18]  Kamlesh Mistry,et al.  Intelligent facial emotion recognition using moth-firefly optimization , 2016, Knowl. Based Syst..

[19]  Aboul Ella Hassanien,et al.  Modified cuckoo search algorithm with rough sets for feature selection , 2018, Neural Computing and Applications.

[20]  Hui Huang,et al.  Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses , 2017, Neurocomputing.

[21]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[22]  Razieh Sheikhpour,et al.  Particle swarm optimization for bandwidth determination and feature selection of kernel density estimation based classifiers in diagnosis of breast cancer , 2016, Appl. Soft Comput..

[23]  Mohd Saberi Mohamad,et al.  A Modified Binary Particle Swarm Optimization for Selecting the Small Subset of Informative Genes From Gene Expression Data , 2011, IEEE Transactions on Information Technology in Biomedicine.

[24]  Seyedali Mirjalili,et al.  Binary Multi-Objective Grey Wolf Optimizer for Feature Selection in Classification , 2020, IEEE Access.

[25]  Václav Snásel,et al.  Large-dimensionality small-instance set feature selection: A hybrid bio-inspired heuristic approach , 2018, Swarm Evol. Comput..

[26]  Mohammed Azmi Al-Betar,et al.  Natural selection methods for artificial bee colony with new versions of onlooker bee , 2018, Soft Comput..

[27]  Praveen Kumar Reddy Maddikunta,et al.  A hybrid cluster head selection model for Internet of Things , 2019, Clust. Comput..

[28]  Hao Dong,et al.  An improved particle swarm optimization for feature selection , 2011 .

[29]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[30]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[31]  Hossam Faris,et al.  Natural selection methods for Grey Wolf Optimizer , 2018, Expert Syst. Appl..

[32]  João Miguel da Costa Sousa,et al.  Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients , 2013, Appl. Soft Comput..

[33]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[34]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[35]  Haider Banka,et al.  A Hamming distance based binary particle swarm optimization (HDBPSO) algorithm for high dimensional feature selection, classification and validation , 2015, Pattern Recognit. Lett..

[36]  Haoran Zhao,et al.  Using GM (1,1) Optimized by MFO with Rolling Mechanism to Forecast the Electricity Consumption of Inner Mongolia , 2016 .

[37]  Jon Atli Benediktsson,et al.  A Novel Feature Selection Approach Based on FODPSO and SVM , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Ibrahim Aljarah,et al.  Improved whale optimization algorithm for feature selection in Arabic sentiment analysis , 2018, Applied Intelligence.

[39]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[40]  Hossam Faris,et al.  Asynchronous accelerating multi-leader salp chains for feature selection , 2018, Appl. Soft Comput..

[41]  Victor Trevino,et al.  Compact cancer biomarkers discovery using a swarm intelligence feature selection algorithm , 2010, Comput. Biol. Chem..

[42]  Hossam Faris,et al.  Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm , 2018, Cognitive Computation.