Impact of Chaos Functions on Modern Swarm Optimizers

Exploration and exploitation are two essential components for any optimization algorithm. Much exploration leads to oscillation and premature convergence while too much exploitation slows down the optimization algorithm and the optimizer may be stuck in local minima. Therefore, balancing the rates of exploration and exploitation at the optimization lifetime is a challenge. This study evaluates the impact of using chaos-based control of exploration/exploitation rates against using the systematic native control. Three modern algorithms were used in the study namely grey wolf optimizer (GWO), antlion optimizer (ALO) and moth-flame optimizer (MFO) in the domain of machine learning for feature selection. Results on a set of standard machine learning data using a set of assessment indicators prove advance in optimization algorithm performance when using variational repeated periods of declined exploration rates over using systematically decreased exploration rates.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[3]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[4]  Cheng-Lung Huang,et al.  ACO-based hybrid classification system with feature subset selection and model parameters optimization , 2009, Neurocomputing.

[5]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[6]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[7]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[8]  Juan M. Aguirregabiria,et al.  Robust chaos with variable Lyapunov exponent in smooth one-dimensional maps , 2008, 0810.3781.

[9]  RASHI VOHRA,et al.  AN EFFICIENT CHAOS-BASED OPTIMIZATION ALGORITHM APPROACH FOR CRYPTOGRAPHY , 2012 .

[10]  Maryam Kouzehgar,et al.  A Comparison among Wolf Pack Search and Four other Optimization Algorithms , 2012 .

[11]  Byung Ro Moon,et al.  Hybrid Genetic Algorithms for Feature Selection , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. Raymundo Marcial-Romero,et al.  Chaotic Time Series Prediction with Feature Selection Evolution , 2011, 2011 IEEE Electronics, Robotics and Automotive Mechanics Conference.

[13]  Babak Nadjar Araabi,et al.  Predicting Chaotic Time Series Using Neural and Neurofuzzy Models: A Comparative Study , 2006, Neural Processing Letters.

[14]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[15]  J. Rice.  Mathematical Statistics and Data Analysis , 1988 .

[16]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[17]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[18]  Hao Chen,et al.  A Heuristic Feature Selection Approach for Text Categorization by Using Chaos Optimization and Genetic Algorithm , 2013 .

[19]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[20]  Fang Liu,et al.  A chaos algorithm based on progressive optimality and tabu search algorithm , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[21]  Weizhou Zhong,et al.  Multi-objective Optimization using Chaos Based PSO , 2011 .

[22]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[23]  Mohammad Saleh Tavazoei,et al.  An optimization algorithm based on chaotic behavior and fractal nature , 2007 .

[24]  Li-Yeh Chuang,et al.  Improved binary particle swarm optimization using catfish effect for feature selection , 2011, Expert Syst. Appl..

[25]  Li-Yeh Chuang,et al.  Chaotic Binary Particle Swarm Optimization for Feature Selection using Logistic Map , 2008 .

[26]  Crina Grosan,et al.  Feature Subset Selection Approach by Gray-Wolf Optimization , 2014, AECIA.

[27]  Bing Li,et al.  Optimizing Complex Functions by Chaos Search , 1998, Cybern. Syst..

[28]  Lior Rokach,et al.  A Survey of Feature Selection Techniques , 2009, Encyclopedia of Data Warehousing and Mining.

[29]  Xin-She Yang,et al.  Flower Pollination Algorithm for Global Optimization , 2012, UCNC.

[30]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[31]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[32]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[33]  Aboul Ella Hassanien,et al.  Swarm Intelligence: Principles, Advances, and Applications , 2015 .

[34]  Crina Grosan,et al.  Feature Selection via Chaotic Antlion Optimization , 2016, PloS one.

[35]  Pu Han,et al.  Chaos optimization variable arguments PID controller, and its application to main steam pressure regulating system , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[36]  Luigi Fortuna,et al.  Does chaos work better than noise , 2002 .

[37]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms: Second Edition , 2010 .