Evolutionary and population-based methods versus constructive search strategies in dynamic combinatorial optimization

Abstract Optimization in dynamic environments is a hot research area that has attracted a notable attention in the past decade. It is clear from the dynamic optimization literature that most of the effort is devoted to continuous dynamic optimization problems although majority of the real-life problems are combinatorial. Additionally, in comparison to evolutionary or population-based approaches, constructive search strategy, which is shown to be successful in stationary combinatorial optimization problems, is commonly ignored by the dynamic optimization community. In the present work, a constructive and multi-start search strategy is proposed to solve dynamic multi-dimensional knapsack problem, which has numerous applications in real world. Making use of constructive and multi-start features, the aim here is to test the performance of such a strategy and to observe its behavior in dynamically changing environments. In this regard, this strategy is compared to the well-known evolutionary and population-based approaches, including a Genetic Algorithm-based memetic algorithm, Differential Evolution algorithm, Firefly Algorithm and a hyper-heuristic, which employs these population-based algorithms as low-level heuristics in accordance with their individual contributions. Furthermore, in order to improve their performances in dynamic environments, the mentioned evolutionary algorithms are enhanced by using triggered random immigrants and adaptive hill climbing strategies. As one can see from the comprehensive experimental analysis, while the proposed approach outperforms most of the evolutionary-based approaches, it is outperformed by firefly and hyper-heuristic algorithms in some of the instances. This points out competiveness of the proposed approaches. Finally, according to the statistical results of non-parametric tests, one can conclude that the proposed approach can be considered as a promising and a competitive algorithm in dynamic environments.

[1]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[2]  Reinaldo J. Moraga,et al.  Meta-RaPS approach for the 0-1 Multidimensional Knapsack Problem , 2005, Comput. Ind. Eng..

[3]  Hans Kellerer,et al.  Knapsack problems , 2004 .

[4]  Shengxiang Yang,et al.  Associative Memory Scheme for Genetic Algorithms in Dynamic Environments , 2006, EvoWorkshops.

[5]  Michalis Mavrovouniotis,et al.  Ant Colony Optimization in Stationary and Dynamic Environments , 2013 .

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[8]  Adil Baykasoglu,et al.  A multi-agent based approach to dynamic scheduling of machines and automated guided vehicles in manufacturing systems , 2012, Appl. Soft Comput..

[9]  Ali Sadollah,et al.  Gradient-based Water Cycle Algorithm with evaporation rate applied to chaos suppression , 2017, Appl. Soft Comput..

[10]  Jenny Fajardo Calderín,et al.  Algorithm portfolio based scheme for dynamic optimization problems , 2015, Int. J. Comput. Intell. Syst..

[11]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[12]  Alireza Alfi,et al.  A memetic algorithm applied to trajectory control by tuning of Fractional Order Proportional-Integral-Derivative controllers , 2015, Appl. Soft Comput..

[13]  Haluk Topcuoglu,et al.  A hyper-heuristic based framework for dynamic optimization problems , 2014, Appl. Soft Comput..

[14]  Ming Yang,et al.  Multi-population methods in unconstrained continuous dynamic environments: The challenges , 2015, Inf. Sci..

[15]  Adil Baykasoglu,et al.  A classification scheme for agent based approaches to dynamic optimization , 2012, Artificial Intelligence Review.

[16]  Salwani Abdullah,et al.  A multi-population electromagnetic algorithm for dynamic optimisation problems , 2014, Appl. Soft Comput..

[17]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[18]  Shengxiang Yang,et al.  A memetic algorithm with adaptive hill climbing strategy for dynamic optimization problems , 2009, Soft Comput..

[19]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[20]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[21]  Adil Baykasoglu,et al.  An improved firefly algorithm for solving dynamic multidimensional knapsack problems , 2014, Expert Syst. Appl..

[22]  Christoph F. Eick,et al.  Supporting Polyploidy in Genetic Algorithms Using Dominance Vectors , 1997, Evolutionary Programming.

[23]  Trung Thanh Nguyen,et al.  Continuous dynamic optimisation using evolutionary algorithms , 2011 .

[24]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[25]  Adil Baykasoğlu,et al.  A multi-agent based approach to modeling and solving dynamic generalized travelling salesman problem , 2016, J. Intell. Fuzzy Syst..

[26]  J. Urgen Branke Evolutionary Approaches to Dynamic Optimization Problems -a Survey , 1999 .

[27]  Adil Baykasoglu,et al.  A multi-population firefly algorithm for dynamic optimization problems , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[28]  Shengxiang Yang,et al.  Metaheuristics for dynamic combinatorial optimization problems. , 2013 .

[29]  A. Şima Uyar Experimental Comparison of Replacement Strategies in Steady State Genetic Algorithms for the Dynamic MKP , 2009 .

[30]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[31]  Adil Baykasoğlu,et al.  A MULTI-AGENT FRAMEWORK FOR LOAD CONSOLIDATION IN LOGISTICS , 2011 .

[32]  A. Sima Etaner-Uyar,et al.  A Critical Look at Dynamic Multi-dimensional Knapsack Problem Generation , 2009, EvoWorkshops.

[33]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[34]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[35]  Vangelis Th. Paschos,et al.  A survey on combinatorial optimization in dynamic environments , 2011, RAIRO Oper. Res..

[36]  Aliasghar Arab,et al.  An adaptive gradient descent-based local search in memetic algorithm applied to optimal controller design , 2015, Inf. Sci..

[37]  Adil Baykasoglu,et al.  Dynamic optimization in a dynamic and unpredictable world , 2011, 2011 Proceedings of PICMET '11: Technology Management in the Energy Smart World (PICMET).

[38]  R. Steele Optimization , 2005 .

[39]  Jürgen Branke,et al.  The Role of Representations in Dynamic Knapsack Problems , 2006, EvoWorkshops.

[40]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[41]  Gülgün Kayakutlu,et al.  A Partheno-Genetic Algorithm for Dynamic 0-1 Multidimensional Knapsack Problem , 2016, RAIRO Oper. Res..

[42]  Theodora Varvarigou,et al.  Resource management in software as a service using the knapsack problem model , 2013 .

[43]  Jrgen Branke,et al.  Evolutionary approaches to dynamic optimization problems , 2001 .

[44]  Reinaldo J. Moraga Meta-raps : an effective approach for combinatorial problems , 2002 .

[45]  Adil Baykasoglu,et al.  A constructive search algorithm for combinatorial dynamic optimization problems , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[46]  Mauricio G. C. Resende,et al.  Greedy Randomized Adaptive Search Procedures , 1995, J. Glob. Optim..

[47]  Joseph C. Hartman,et al.  An approximate dynamic programming approach to solving a dynamic, stochastic multiple knapsack problem , 2009, Int. Trans. Oper. Res..

[48]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[49]  Salwani Abdullah,et al.  A multi-population harmony search algorithm with external archive for dynamic optimization problems , 2014, Inf. Sci..

[50]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[51]  Sachin S. Sapatnekar,et al.  Residential task scheduling under dynamic pricing using the multiple knapsack method , 2012, 2012 IEEE PES Innovative Smart Grid Technologies (ISGT).