Understanding differential evolution: A Poisson law derived from population interaction network

Abstract Differential evolution (DE) is one of evolutionary algorithms to effectively handle optimization problems. We propose a population interaction network (PIN) to investigate the relationship constituted by populations. The cumulative distribution function (CDF) of degree in PIN is analyzed by five fitting models on 12 benchmark functions. The goodness of fit is used to measure the fitting results. The experimental results demonstrate the CDF meets cumulative Poisson distribution. Besides, the number of nodes in PIN and the rate parameter λ in the fitted Poisson distribution are further studied using different control parameters of DE, which exhibits the effect and characteristic of the population interaction.

[1]  Pascal Bouvry,et al.  Study of different small-world topology generation mechanisms for Genetic Algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[2]  JAMES M. WHITACRE,et al.  Effects of Adaptive Social Networks on the Robustness of Evolutionary Algorithms , 2011, Int. J. Artif. Intell. Tools.

[3]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[5]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Jie Qi,et al.  The emergence of scaling laws search dynamics in a particle swarm optimization , 2013 .

[7]  Prügel-Bennett,et al.  Analysis of genetic algorithms using statistical mechanics. , 1994, Physical review letters.

[8]  Alessandro Vespignani,et al.  Epidemic spreading in scale-free networks. , 2000, Physical review letters.

[9]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[10]  Marco Tomassini,et al.  Takeover time curves in random and small-world structured populations , 2005, GECCO '05.

[11]  Ruhul A. Sarker,et al.  The Self-Organization of Interaction Networks for Nature-Inspired Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[12]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[13]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[14]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[15]  Pascal Bouvry,et al.  Evolutionary Algorithms Based on Game Theory and Cellular Automata with Coalitions , 2013, Handbook of Optimization.

[16]  Marco Tomassini,et al.  Effects of Scale-Free and Small-World Topologies on Binary Coded Self-adaptive CEA , 2006, EvoCOP.

[17]  Bernhard Sendhoff,et al.  Theoretical comparisons of search dynamics of genetic algorithms and evolution strategies , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  Yang Yu,et al.  A new approach to estimating the expected first hitting time of evolutionary algorithms , 2006, Artif. Intell..

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  Jiujun Cheng,et al.  An approximate logic neuron model with a dendritic structure , 2016, Neurocomputing.

[21]  Rakesh Angira,et al.  A Comparative Study of Differential Evolution Algorithms for Estimation of Kinetic Parameters , 2012 .

[22]  Jinhang Li,et al.  Scale-free properties of information flux networks in genetic algorithms , 2012 .

[23]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[24]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[25]  Albert-László Barabási,et al.  Scale-Free Networks: A Decade and Beyond , 2009, Science.

[26]  Roberto Santana,et al.  Estimation of Bayesian networks algorithms in a class of complex networks , 2010, IEEE Congress on Evolutionary Computation.

[27]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[28]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[29]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[30]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[31]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[32]  S. Bornholdt,et al.  Scale-free topology of e-mail networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Enrique Alba,et al.  Hierarchical Cellular Genetic Algorithm , 2006, EvoCOP.

[34]  Jiahai Wang,et al.  Financial time series prediction using a dendritic neuron model , 2016, Knowl. Based Syst..

[35]  J. van Gijn Holland , 2004, Practical Neurology.

[36]  MengChu Zhou,et al.  Routing in Internet of Vehicles: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[37]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[38]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Filippo Menczer,et al.  Correlated topologies in citation networks and the Web , 2004 .

[40]  Dana L. Haynie,et al.  Friendship Networks and Delinquency: The Relative Nature of Peer Delinquency , 2002 .

[41]  Jiujun Cheng,et al.  Ant colony optimization with clustering for solving the dynamic location routing problem , 2016, Appl. Math. Comput..

[42]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Miguel Rio,et al.  Modeling internet topology dynamics , 2008, CCRV.