Small-world hidden in differential evolution

Differential evolution is an effective population-based global optimizer which is used in many areas of research. The population consists of individuals, which are mutated, crossed and better of them survive to the next generation. In this paper, we look at this process as at the communication between individuals which can be modeled by the network where the individuals are represented by the nodes and the edges between them reflect the dynamics in the population, i.e. interactions between individuals. The main goal of this work is to find out if the differential evolution algorithm is able to create the networks where the small-world phenomenon (known as six degrees of separation) is observed. The secondary objective was to investigate the dependency between the type of the selected test function and the extent of this phenomenon. To evaluate the performance of the algorithm eleven test functions from the benchmark set CEC 2015 have been used. The analysis of the generated networks indicates that the differential evolution is able to create small-world networks in majority of test functions. As the result, the selected test functions can be classified into three categories which binds to the degree of cooperation between the individuals in the population.

[1]  Karl-Dirk Kammeyer,et al.  Parameter Study for Differential Evolution Using a Power Allocation Problem Including Interference Cancellation , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[2]  Ville Tirronen,et al.  Scale factor local search in differential evolution , 2009, Memetic Comput..

[3]  Michal Pluhacek,et al.  Complex Network Analysis of Discrete Self-organising Migrating Algorithm , 2014 .

[4]  Mehmet Fatih Tasgetiren,et al.  A Multi-Populated Differential Evolution Algorithm for Solving Constrained Optimization Problem , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  Ivan Zelinka,et al.  Differential Evolution Enhanced by the Closeness Centrality: Initial Study , 2015, 2015 International Conference on Intelligent Networking and Collaborative Systems.

[6]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[7]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Liang Gao,et al.  A new differential evolution algorithm with a hybrid mutation operator and self-adapting control parameters for global optimization problems , 2014, Applied Intelligence.

[9]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[10]  R. Storn,et al.  Design of efficient erasure codes with differential evolution , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[11]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[12]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[13]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[14]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[15]  T. Prescott,et al.  The brainstem reticular formation is a small-world, not scale-free, network , 2006, Proceedings of the Royal Society B: Biological Sciences.

[16]  Tomás Fabián,et al.  Differential evolution dynamics analysis by complex networks , 2015, Soft Computing.

[17]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Jafar Albadarneh,et al.  Cluster-based differential evolution with heterogeneous influence for numerical optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[19]  Godfrey C. Onwubolu,et al.  Scheduling flow shops using differential evolution algorithm , 2006, Eur. J. Oper. Res..

[20]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Yang Liu,et al.  A fast differential evolution algorithm using k-Nearest Neighbour predictor , 2011, Expert Syst. Appl..

[22]  Ivan Zelinka,et al.  Handbook of Optimization - From Classical to Modern Approach , 2012, Handbook of Optimization.

[23]  Shiwen Yang,et al.  Sideband suppression in time-modulated linear arrays by the differential evolution algorithm , 2002 .

[24]  Arthur C. Sanderson,et al.  An approximate gaussian model of Differential Evolution with spherical fitness functions , 2007, 2007 IEEE Congress on Evolutionary Computation.

[25]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .

[26]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[27]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[28]  Wojciech Kwedlo,et al.  A clustering method combining differential evolution with the K-means algorithm , 2011, Pattern Recognit. Lett..

[29]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[30]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[31]  Laizhong Cui,et al.  Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations , 2016, Comput. Oper. Res..

[32]  C. Stam,et al.  Small-world networks and functional connectivity in Alzheimer's disease. , 2006, Cerebral cortex.

[33]  J. Kiefer,et al.  Sequential minimax search for a maximum , 1953 .

[34]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[35]  J. Montoya,et al.  Small world patterns in food webs. , 2002, Journal of theoretical biology.

[36]  Julio R. Banga,et al.  Enhanced parallel Differential Evolution algorithm for problems in computational systems biology , 2015, Appl. Soft Comput..

[37]  Roman Senkerik,et al.  Preliminary investigation on relations between complex networks and evolutionary algorithms dynamics , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).