Dynamic function optimisation with hybridised extremal dynamics

Dynamic function optimisation is an important research area because many real-world problems are inherently dynamic in nature. Over the years, a wide variety of algorithms have been proposed to solve dynamic optimisation problems, and many of these algorithms have used the Moving Peaks (MP) benchmark to test their own capabilities against other approaches. This paper presents a detailed account of our hybridised Extremal Optimisation (EO) approach that has achieved hitherto unsurpassed results on the three standardised scenarios of the MP problem. Several different components are used in the hybrid EO, and it has been shown that a large proportion of the quality of its outstanding performance is due to the local search component. In this paper, the behaviour of the local search algorithms used is analysed, and the roles of other components are discussed. In the concluding remarks, the generalisation ability of this method and its wider applicability are highlighted.

[1]  Tim Hendtlass,et al.  A simple and efficient multi-component algorithm for solving dynamic function optimisation problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Dumitru Dumitrescu,et al.  Evolutionary swarm cooperative optimization in dynamic environments , 2009, Natural Computing.

[3]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[4]  S. Boettcher.  Extremal Optimization of Graph Partitioning at the Percolation Threshold , 1999, cond-mat/9901353.

[5]  Xiaodong Li,et al.  Particle swarm with speciation and adaptation in a dynamic environment , 2006, GECCO.

[6]  Tim M. Blackwell,et al.  Swarms in Dynamic Environments , 2003, GECCO.

[7]  Shengxiang Yang,et al.  Triggered Memory-Based Swarm Optimization in Dynamic Environments , 2007, EvoWorkshops.

[8]  Arvind S. Mohais,et al.  DynDE: a differential evolution for dynamic optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[9]  Hussein A. Abbass,et al.  Diversity as a selection pressure in dynamic environments , 2005, GECCO '05.

[10]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[11]  P. John Clarkson,et al.  Erratum: A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2003, Evolutionary Computation.

[12]  Raymond Chiong,et al.  Nature That Breeds Solutions , 2012, Int. J. Signs Semiot. Syst..

[13]  Raymond Chiong,et al.  A Hooke-Jeeves Based Memetic Algorithm for Solving Dynamic Optimisation Problems , 2009, HAIS.

[14]  Peter J. Angeline,et al.  Tracking Extrema in Dynamic Environments , 1997, Evolutionary Programming.

[15]  Xiaodong Li,et al.  A particle swarm model for tracking multiple peaks in a dynamic environment using speciation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[16]  N. Salvatore,et al.  Surrogate assisted local search in PMSM drive design , 2008 .

[17]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[18]  John J. Grefenstette,et al.  Evolvability in dynamic fitness landscapes: a genetic algorithm approach , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[19]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[20]  M. K. De,et al.  Stochastic Diffusion Search: Partial Function Evaluation In Swarm Intelligence Dynamic Optimisation , 2006 .

[21]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[22]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[23]  Abderrahim Belmadani,et al.  Hooke-Jeeves' Method Applied to a New Economic Dispatch Problem Formulation , 2008, J. Inf. Sci. Eng..

[24]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[25]  Barenco,et al.  Conditional Quantum Dynamics and Logic Gates. , 1995, Physical review letters.

[26]  Shengxiang Yang,et al.  Memory-based immigrants for genetic algorithms in dynamic environments , 2005, GECCO '05.

[27]  Xiufen Zou,et al.  Evolutionary optimization based on chaotic sequence in dynamic environments , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[28]  Thomas Martinetz,et al.  Explicit Speciation with few a priori Parameters for Dynamic Optimization Problems , 2001 .

[29]  Ian Moser,et al.  Applying Extremal Optimisation To Dynamic Optimisation Problems , 2008 .

[30]  Martin Middendorf,et al.  A Hierarchical Particle Swarm Optimizer for Dynamic Optimization Problems , 2004, EvoWorkshops.

[31]  Journal of the Association for Computing Machinery , 1961, Nature.

[32]  Stefan Boettcher,et al.  Extremal Optimization , 1999 .

[33]  Irene Moser.  Hooke-Jeeves revisited , 2009, 2009 IEEE Congress on Evolutionary Computation.

[34]  A. Percus,et al.  Nature's Way of Optimizing , 1999, Artif. Intell..

[35]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[36]  Bak,et al.  Punctuated equilibrium and criticality in a simple model of evolution. , 1993, Physical review letters.

[37]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[38]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[39]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[40]  Raymond Chiong,et al.  Why Is Optimization Difficult? , 2009, Nature-Inspired Algorithms for Optimisation.

[41]  Haluk Topcuoglu,et al.  A comparative study of evolutionary optimization techniques in dynamic environments , 2006, GECCO '06.

[42]  Hussein A. Abbass,et al.  Multiobjective optimization for dynamic environments , 2005, 2005 IEEE Congress on Evolutionary Computation.

[43]  P. Balle,et al.  Integrated control, diagnosis and reconfiguration of a heat exchanger , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[44]  Krzysztof Trojanowski,et al.  B-Cell Algorithm as a Parallel Approach to Optimization of Moving Peaks Benchmark Tasks , 2007, 6th International Conference on Computer Information Systems and Industrial Management Applications (CISIM'07).