Cognitive population initialization for swarm intelligence and evolutionary computing

Cognitive computing has been commonly used to address different forms of optimization issues. Swarm intelligence (SI) and evolutionary computing (EC) are population-based intelligent stochastic search techniques promoted to search for their food from the intrinsic way of bee swarming and human evolution. Initialization of populations is a critical factor in the Particle swarm optimization (PSO) algorithm that significantly affects diversity and convergence. Quasi-random sequences based on cognitive computing are more helpful in initializing the population than applying the random distribution for initialization to maximize diversity and convergence. The capacity of PSO is expanded to make it suitable for the optimization problem by adding new initialization techniques based on cognitive computing using the sequence of low discrepancies. The employed low discrepancies sequences included WELL named WE-PSO to solve the optimization problems in large-scale search spaces. The proposed approach has been tested on fifteen well-known uni-modal and multi-modal benchmark test problems extensively used in the literature. Also, WE-PSO efficiency has been compared to standard PSO, and two other Sobol-based PSO (SOB-PSO) and Halton-based PSO (HAL-PSO) initialization approach. The results were obtained to validate the efficiency and effectiveness of the proposed approach. Mean fitness values obtained using WE-PSO designate that WE-PSO is better than standard techniques in multi-modal problems. The computational results also show that the proposed technique outperformed and has a higher accuracy rate than the classical approaches. Besides, the proposed work’s result offers a foresight of how the proposed initialization approach has a significant effect on the importance of cost function, convergence, and diversity.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Lu Xiong,et al.  Multi-feature fusion and selection method for an improved particle swarm optimization , 2019 .

[3]  Konstantinos E. Parsopoulos,et al.  Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method , 2002 .

[4]  Marco Castellani,et al.  Evolutionary generation of neural network classifiers - An empirical comparison , 2013, Neurocomputing.

[5]  J. Salerno,et al.  Using the particle swarm optimization technique to train a recurrent neural model , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[6]  H. Niederreiter 1. Monte Carlo Methods and Quasi-Monte Carlo Methods , 1992 .

[7]  Nguyen Xuan Hoai,et al.  Initialising PSO with randomised low-discrepancy sequences: the comparative results , 2007, 2007 IEEE Congress on Evolutionary Computation.

[8]  Sung-Bae Cho,et al.  An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification , 2012, J. Syst. Softw..

[9]  Kusum Deep,et al.  Initializing PSO with probability distributions and low-discrepancy sequences: The comparative results , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[10]  Leandro dos Santos Coelho,et al.  PSO-E: Particle Swarm with Exponential Distribution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[11]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[12]  Yezid Donoso,et al.  Multi-Objective Optimization in Computer Networks Using Metaheuristics , 2007 .

[13]  Haoyu Wang,et al.  Smartly Handling Renewable Energy Instability in Supporting A Cloud Datacenter , 2020, 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[14]  Syed Jawad Hussain Shah,et al.  Visual features based automated identification of fish species using deep convolutional neural networks , 2019, Comput. Electron. Agric..

[15]  Shiro Usui,et al.  Mutation-based genetic neural network , 2005, IEEE Transactions on Neural Networks.

[16]  Yezid Donoso,et al.  Multi-Objective Optimization Concepts , 2007 .

[17]  Abdul Rauf Baig,et al.  Opposition based initialization in particle swarm optimization (O-PSO) , 2009, GECCO '09.

[18]  Muhammad Attique Khan,et al.  Particle Swarm Optimization With Probability Sequence for Global Optimization , 2020, IEEE Access.

[19]  Songfeng Lu,et al.  Improved salp swarm algorithm based on particle swarm optimization for feature selection , 2018, Journal of Ambient Intelligence and Humanized Computing.

[20]  A. L. Gutierrez,et al.  Comparison of different PSO initialization techniques for high dimensional search space problems: A test with FSS and antenna arrays , 2011, Proceedings of the 5th European Conference on Antennas and Propagation (EUCAP).

[21]  Inés María Galván,et al.  AMPSO: A New Particle Swarm Method for Nearest Neighborhood Classification , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Haiying Shen,et al.  Machine Learning Based Workload Prediction in Cloud Computing , 2020, 2020 29th International Conference on Computer Communications and Networks (ICCCN).

[23]  E. Nefzaoui,et al.  Nanostructures Thermal Emission Optimization using Genetic Algorithms and Particle Swarms , 2016, IJCCI.

[24]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[25]  Syed Ahmad Chan Bukhari,et al.  Lung nodules detection using semantic segmentation and classification with optimal features , 2020, Neural Computing and Applications.

[26]  Lijun Liu,et al.  An improved ant colony optimization algorithm based on particle swarm optimization algorithm for path planning of autonomous underwater vehicle , 2019, Journal of Ambient Intelligence and Humanized Computing.

[27]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[28]  Rubiyah Yusof,et al.  A new simple, fast and efficient algorithm for global optimization over continuous search-space problems: Radial Movement Optimization , 2014, Appl. Math. Comput..

[29]  Jing Wang,et al.  Swarm Intelligence in Cellular Robotic Systems , 1993 .

[30]  Haoyu Wang,et al.  Task Failure Prediction in Cloud Data Centers Using Deep Learning , 2020, IEEE Transactions on Services Computing.

[31]  Hafiz Tayyab Rauf,et al.  Adaptive inertia weight Bat algorithm with Sugeno-Function fuzzy search , 2020, Appl. Soft Comput..

[32]  Shuhei Kimura,et al.  Genetic algorithms using low-discrepancy sequences , 2005, GECCO '05.

[33]  Mu-En Wu,et al.  Modifying ORB trading strategies using particle swarm optimization and multi-objective optimization , 2021 .

[34]  Mark B. Wells Review: Donald E. Knuth, The Art of Computer Programming, Volume 1. Fundamental Algorithms and Volume 2. Seminumerical Algorithms , 1973 .

[35]  Zhu Shaotong,et al.  A Clean-Slate ID/Locator Split Architecture for Future Network , 2016 .

[36]  Pierre L'Ecuyer,et al.  Improved long-period generators based on linear recurrences modulo 2 , 2004, TOMS.

[37]  Ren-Jye Yang,et al.  Improved particle swarm optimization algorithm using design of experiment and data mining techniques , 2015 .