A Multiple Diversity-Driven Brain Storm Optimization Algorithm With Adaptive Parameters

Brain storm optimization (BSO) is a swarm intelligence optimization algorithm which is proven to have practical values in various fields. During these years, many modifications have been facilitated to effectively improve BSO’s search performance. So far, these modifications focus on improving the solution quality by applying different clustering methods and learning strategies, in which the population diversity is often neglected. However, in recent studies, population diversity plays a more significant role in designing optimization algorithm. A population that maintains its diversity in a high level can easily obtain better solutions than the one with low level of diversity. Therefore, this paper proposes a control method that evaluates the population diversity of BSO to improve its performance. Two diversity measures, which are known as distance-based diversity and fitness-based diversity, are implemented to realize the adaptation of algorithm parameters. The new algorithm is called multiple diversity-driven BSO (MDBSO). Its performance is verified by CEC2017 benchmark function suit and a neuron model training task. The results demonstrate the effectiveness and efficiency of MDBSO.

[1]  Zheng Tang,et al.  An artificial bee colony algorithm search guided by scale-free networks , 2019, Inf. Sci..

[2]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Binjie Gu,et al.  MODIFIED GRAVITATIONAL SEARCH ALGORITHM WITH PARTICLE MEMORY ABILITY AND ITS APPLICATION , 2013 .

[4]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[5]  Junfeng Chen,et al.  Brain storm optimization algorithm: a review , 2016, Artificial Intelligence Review.

[6]  Russell C. Eberhart,et al.  Population diversity of particle swarms , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  Tao Jiang,et al.  A neuron model with synaptic nonlinearities in a dendritic tree for liver disorders , 2017 .

[8]  Jun Zhang,et al.  Learning Multimodal Parameters: A Bare-Bones Niching Differential Evolution Approach , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Tao Gong,et al.  Graph planarization problem optimization based on triple-valued gravitational search algorithm , 2014 .

[10]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[11]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[13]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[14]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .

[15]  Jiujun Cheng,et al.  Ant colony optimization with clustering for solving the dynamic location routing problem , 2016, Appl. Math. Comput..

[16]  Jing Wang,et al.  Swarm Intelligence in Cellular Robotic Systems , 1993 .

[17]  Ying Tan,et al.  Fireworks Algorithm for Optimization , 2010, ICSI.

[18]  Mohammed El-Abd,et al.  Global-best brain storm optimization algorithm , 2017, Swarm Evol. Comput..

[19]  Jing Xin,et al.  An Adaptive Brain Storm Optimization Algorithm for Multiobjective Optimization Problems , 2015, ICSI.

[20]  Jiujun Cheng,et al.  ASBSO: An Improved Brain Storm Optimization With Flexible Search Length and Memory-Based Selection , 2018, IEEE Access.

[21]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[23]  Yuhui Shi,et al.  Brain storm optimization algorithm in objective space , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[24]  Carlos García-Martínez,et al.  Memetic Algorithms for Continuous Optimisation Based on Local Search Chains , 2010, Evolutionary Computation.

[25]  Hiroki Tamura,et al.  Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction , 2009, Neurocomputing.

[26]  Hang Yu,et al.  Self-Adaptive Gravitational Search Algorithm With a Modified Chaotic Local Search , 2017, IEEE Access.

[27]  Mohammed El-Abd,et al.  Brain storm optimization algorithm with re-initialized ideas and adaptive step size , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[28]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[29]  Kocsis Zoltán Tamás,et al.  IEEE World Congress on Computational Intelligence , 2019, IEEE Computational Intelligence Magazine.

[30]  Carlos A. Coello Coello,et al.  A Novel Diversity-Based Replacement Strategy for Evolutionary Algorithms , 2016, IEEE Transactions on Cybernetics.

[31]  Yang Yu,et al.  CBSO: a memetic brain storm optimization with chaotic local search , 2018, Memetic Comput..

[32]  Zheng Tang,et al.  Unsupervised learnable neuron model with nonlinear interaction on dendrites , 2014, Neural Networks.

[33]  Carlos A. Coello Coello,et al.  Current and Future Research Trends in Evolutionary Multiobjective Optimization , 2005 .

[34]  Xianneng Li,et al.  Artificial bee colony algorithm with memory , 2016, Appl. Soft Comput..

[35]  Shangce Gao,et al.  A hierarchical gravitational search algorithm with an effective gravitational constant , 2019, Swarm Evol. Comput..

[36]  Xiaodong Li,et al.  A Dynamic Neighborhood Learning-Based Gravitational Search Algorithm , 2018, IEEE Transactions on Cybernetics.

[37]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[38]  Jiujun Cheng,et al.  Dendritic Neuron Model With Effective Learning Algorithms for Classification, Approximation, and Prediction , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[40]  Tatsuya Nomura,et al.  An Analysis of Two-Parent Recombinations for Real-Valued Chromosomes in an Infinite Population , 2001, Evolutionary Computation.

[41]  Yang Yu,et al.  Multiple Chaos Embedded Gravitational Search Algorithm , 2017, IEICE Trans. Inf. Syst..

[42]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[43]  Jiahai Wang,et al.  Financial time series prediction using a dendritic neuron model , 2016, Knowl. Based Syst..

[44]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[45]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[46]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[47]  Yu Xue,et al.  A self-adaptive artificial bee colony algorithm based on global best for global optimization , 2017, Soft Computing.

[48]  Chunquan Li,et al.  A Brain Storm Optimization With Multi-Information Interactions for Global Optimization Problems , 2018, IEEE Access.

[49]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[50]  Yuhui Shi,et al.  Maintaining population diversity in brain storm optimization algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[51]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[52]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[53]  Bo Yang,et al.  Random Grouping Brain Storm Optimization Algorithm with a New Dynamically Changing Step Size , 2016, ICSI.

[54]  Gary G. Yen,et al.  Dynamic Evolutionary Algorithm With Variable Relocation , 2009, IEEE Transactions on Evolutionary Computation.

[55]  Laizhong Cui,et al.  Artificial bee colony algorithm with gene recombination for numerical function optimization , 2017, Appl. Soft Comput..

[56]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[57]  Enrique Alba,et al.  Improving Diversity in Evolutionary Algorithms: New Best Solutions for Frequency Assignment , 2017, IEEE Transactions on Evolutionary Computation.

[58]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[59]  Graham Kendall,et al.  Advanced Population Diversity Measures in Genetic Programming , 2002, PPSN.

[60]  Sam Kwong,et al.  Gbest-guided artificial bee colony algorithm for numerical function optimization , 2010, Appl. Math. Comput..

[61]  Lingling Huang,et al.  Enhancing artificial bee colony algorithm using more information-based search equations , 2014, Inf. Sci..

[62]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm , 2011, ICSI.

[63]  Yan Wang,et al.  Gravitational search algorithm combined with chaos for unconstrained numerical optimization , 2014, Appl. Math. Comput..

[64]  Yang Yu,et al.  A Pruning Neural Network Model in Credit Classification Analysis , 2018, Comput. Intell. Neurosci..

[65]  Jiujun Cheng,et al.  An approximate logic neuron model with a dendritic structure , 2016, Neurocomputing.

[66]  S. Mirjalili,et al.  A new hybrid PSOGSA algorithm for function optimization , 2010, 2010 International Conference on Computer and Information Application.

[67]  Jiujun Cheng,et al.  Using a Single Dendritic Neuron to Forecast Tourist Arrivals to Japan , 2017, IEICE Trans. Inf. Syst..