An Improved Brain Storm Optimization with Differential Evolution Strategy for Applications of ANNs

Brain Storm Optimization (BSO) algorithm is a swarm intelligence algorithm inspired by human being’s behavior of brainstorming. The performance of BSO is maintained by the creating process of ideas, but when it cannot find a better solution for some successive iterations, the result will be so inefficient that the population might be trapped into local optima. In this paper, we propose an improved BSO algorithm with differential evolution strategy and new step size method. Firstly, differential evolution strategy is incorporated into the creating operator of ideas to allow BSO jump out of stagnation, owing to its strong searching ability. Secondly, we introduce a new step size control method that can better balance exploration and exploitation at different searching generations. Finally, the proposed algorithm is first tested on 14 benchmark functions of CEC 2005 and then is applied to train artificial neural networks. Comparative experimental results illustrate that the proposed algorithm performs significantly better than the original BSO.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  A. Osborn.  Applied imagination : principles and procedures of creative problem-solving , 1957 .

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[5]  W. Pinebrook.  The evolution of strategy. , 1990, Case studies in health administration.

[6]  Alberto Tesi,et al.  On the Problem of Local Minima in Backpropagation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[8]  A. Roli.  Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[9]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[10]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[11]  Michael Negnevitsky,et al.  Artificial Intelligence: A Guide to Intelligent Systems , 2001 .

[12]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[13]  Neil Genzlinger.  A. and Q , 2006 .

[14]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[15]  Frank Pettersson,et al.  A genetic algorithms based multi-objective neural net applied to noisy blast furnace data , 2007, Appl. Soft Comput..

[16]  Lifeng Xi,et al.  Evolving artificial neural networks using an improved PSO and DPSO , 2008, Neurocomputing.

[17]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[18]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[19]  Amir Hossein Alavi,et al.  Prediction of principal ground-motion parameters using a hybrid method coupling artificial neural networks and simulated annealing , 2011 .

[20]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm , 2011, ICSI.

[21]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[22]  Yuhui Shi,et al.  An Optimization Algorithm Based on Brainstorming Process , 2011, Int. J. Swarm Intell. Res..

[23]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[24]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm for Multi-objective Optimization Problems , 2012, ICSI.

[25]  Zhi-hui Zhan,et al.  A modified brain storm optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[26]  H. T. Jadhav,et al.  Brain storm optimization algorithm based economic dispatch considering wind power , 2012, 2012 IEEE International Conference on Power and Energy (PECon).

[27]  Yuhui Shi,et al.  Optimal Satellite Formation Reconfiguration Based on Closed-Loop Brain Storm Optimization , 2013, IEEE Computational Intelligence Magazine.

[28]  Yuhui Shi,et al.  Predator–Prey Brain Storm Optimization for DC Brushless Motor , 2013, IEEE Transactions on Magnetics.

[29]  Jun Zhang,et al.  Parameter investigation in brain storm optimization , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[30]  Yuhui Shi,et al.  Multi-Objective Optimization Based on Brain Storm Optimization Algorithm , 2013, Int. J. Swarm Intell. Res..

[31]  Yuhui Shi,et al.  Maintaining population diversity in brain storm optimization algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[32]  Feng Zou,et al.  A hybridization of teaching–learning-based optimization and differential evolution for chaotic time series prediction , 2014, Neural Computing and Applications.

[33]  Nirupam Chakraborti,et al.  Evolutionary Design of Nickel-Based Superalloys Using Data-Driven Genetic Algorithms and Related Strategies , 2015 .

[34]  Yuhui Shi,et al.  Advanced discussion mechanism-based brain storm optimization algorithm , 2015, Soft Comput..

[35]  A. Gandomi,et al.  Prediction of peak ground acceleration of Iran’s tectonic regions using a hybrid soft computing technique , 2016 .