A new co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization

Bi-Level Optimization Problems (BLOPs) are a class of challenging problems with two levels of optimization tasks. The main goal is to optimize the upper level problem which has another optimization problem as a constraint. The latter is called the lower level problem. In this way, the evaluation of each upper level solution requires finding an (near) optimal solution to the corresponding lower level problem, which is computationally very expensive. Many real world applications are bi-level by nature, ranging from logistics to software engineering. Further, proposed bi-level approaches have been restricted to solve linear BLOPs. This fact has attracted the evolutionary computation community to tackle such complex problems and many interesting works have recently been proposed. Unfortunately, most of these works are restricted to the continuous case. Motivated by this observation, we propose in this paper a new Co-evolutionary Decomposition Algorithm inspired from Chemical Reaction Optimization algorithm, called E-CODBA (Energy-based CODBA), to solve combinatorial bi-level problems. Our algorithm is based on our previous works within this research area. The main idea behind E-CODBA is to exploit co-evolution, decomposition, and energy laws to come up with good solution(s) within an acceptable execution time. The statistical analysis of the experimental results on the Bi-level Multi-Depot Vehicle Routing Problem (Bi-MDVRP) show the out-performance of our E-CODBA against four recently proposed works in terms of effectiveness and efficiency.

[1]  Gerhard J. Woeginger,et al.  A Complexity and Approximability Study of the Bilevel Knapsack Problem , 2013, IPCO.

[2]  Tung Khac Truong,et al.  Chemical reaction optimization with greedy strategy for the 0-1 knapsack problem , 2013, Appl. Soft Comput..

[3]  Xiaowen Chu,et al.  Autonomous-Vehicle Public Transportation System: Scheduling and Admission Control , 2015, IEEE Transactions on Intelligent Transportation Systems.

[4]  El-Ghazali Talbi,et al.  Metaheuristics for Bi-level Optimization , 2013 .

[5]  Victor O. K. Li,et al.  Chemical Reaction Optimization: a tutorial , 2012, Memetic Computing.

[6]  Karina Valdivia Delgado,et al.  Learning to program using hierarchical model-based debugging , 2015, Applied Intelligence.

[7]  Herminia I. Calvete,et al.  A Hybrid Algorithm for Solving a Bilevel Production-Distribution Planning Problem , 2013, MS.

[8]  C. M. Khaled Saifullah,et al.  Chemical reaction optimization for solving shortest common supersequence problem. , 2016, Computational biology and chemistry.

[9]  Nataliya I. Kalashnykova,et al.  Optimality conditions for bilevel programming problems , 2006 .

[10]  Abir Chaabani,et al.  An Efficient Chemical Reaction Optimization Algorithm for Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[11]  Paul H. Calamai,et al.  Bilevel and multilevel programming: A bibliography review , 1994, J. Glob. Optim..

[12]  Diego Cabrera,et al.  Hierarchical feature selection based on relative dependency for gear fault diagnosis , 2015, Applied Intelligence.

[13]  Michel Gendreau,et al.  A hybrid Tabu-ascent algorithm for the linear Bilevel Programming Problem , 1996, J. Glob. Optim..

[14]  Leslie Pérez Cáceres,et al.  The irace package: Iterated racing for automatic algorithm configuration , 2016 .

[15]  Taisir Eldos Simulated Annealing with Deterministic Decisions , 2009 .

[16]  Gilles Savard,et al.  The steepest descent direction for the nonlinear bilevel programming problem , 1990, Oper. Res. Lett..

[17]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[18]  Yafeng Yin,et al.  Multiobjective bilevel optimization for transportation planning and management problems , 2002 .

[19]  Jin Xu,et al.  Chemical Reaction Optimization for Task Scheduling in Grid Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[20]  Hong Liu,et al.  A cooperative coevolutionary biogeography-based optimizer , 2015, Applied Intelligence.

[21]  M. C. Roboredo,et al.  Solving bilevel combinatorial optimization as bilinear min-max optimization via a branch-and-cut algorithm , 2013 .

[22]  Jacob Cohen,et al.  Statistical Power Analysis For The Behavioral Sciences Revised Edition , 1987 .

[23]  Herminia I. Calvete,et al.  A Multiobjective Bilevel Program for Production-Distribution Planning in a Supply Chain , 2008, MCDM.

[24]  Bruce E. Hajek,et al.  Cooling Schedules for Optimal Annealing , 1988, Math. Oper. Res..

[25]  Abir Chaabani,et al.  A new co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization , 2015, Applied Intelligence.

[26]  Victor O. K. Li,et al.  Adaptive chemical reaction optimization for global numerical optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[27]  Sweta Srivastava,et al.  Nested hybrid evolutionary model for traffic signal optimization , 2016, Applied Intelligence.

[28]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[29]  Wilfred Candler,et al.  A linear two-level programming problem, , 1982, Comput. Oper. Res..

[30]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[31]  Patrice Marcotte,et al.  An overview of bilevel optimization , 2007, Ann. Oper. Res..

[32]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[33]  Abir Chaabani,et al.  An indicator-based chemical reaction optimization algorithm for multi-objective search , 2014, GECCO.

[34]  G. Laporte,et al.  A tabu search heuristic for periodic and multi-depot vehicle routing problems , 1997, Networks.

[35]  Abir Chaabani,et al.  An Improved Co-evolutionary Decomposition-based Algorithm for Bi-level Combinatorial Optimization , 2015, GECCO.

[36]  Arnaud Liefooghe,et al.  CoBRA: A cooperative coevolutionary algorithm for bi-level optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[37]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[38]  Rajkumar Roy,et al.  Bi-level optimisation using genetic algorithm , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[39]  Monireh Abdoos,et al.  Hierarchical control of traffic signals using Q-learning with tile coding , 2013, Applied Intelligence.

[40]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[41]  Nataliya I. Kalashnykova,et al.  Bilevel Programming and Applications , 2015 .

[42]  Hai Yang,et al.  An equivalent continuously differentiable model and a locally convergent algorithm for the continuous network design problem , 2001 .

[43]  Patrice Marcotte,et al.  A Trust-Region Method for Nonlinear Bilevel Programming: Algorithm and Computational Experience , 2005, Comput. Optim. Appl..

[44]  A. Koh A Metaheuristic Framework for Bi-level Programming Problems with Multi-disciplinary Applications , 2013 .

[45]  Makoto Yasuda,et al.  Deterministic Annealing: A Variant of Simulated Annealing and its Application to Fuzzy Clustering , 2017 .

[46]  Dazhi Sun,et al.  Bi‐level Programming Formulation and Heuristic Solution Approach for Dynamic Traffic Signal Optimization , 2006, Comput. Aided Civ. Infrastructure Eng..

[47]  L. N. Vicente,et al.  Multicriteria Approach to Bilevel Optimization , 2006 .

[48]  S. Dempe Annotated Bibliography on Bilevel Programming and Mathematical Programs with Equilibrium Constraints , 2003 .

[49]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[50]  Victor O. K. Li,et al.  Evolutionary artificial neural network based on Chemical Reaction Optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[51]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[52]  Lucio Bianco,et al.  A Bilevel flow model for HazMat transportation network design , 2008 .

[53]  Panos M. Pardalos,et al.  A new bilevel formulation for the vehicle routing problem and a solution method using a genetic algorithm , 2007, J. Glob. Optim..

[54]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[55]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[56]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[57]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[58]  A. E. Eiben,et al.  Parameter tuning for configuring and analyzing evolutionary algorithms , 2011, Swarm Evol. Comput..

[59]  Thomas Bartz-Beielstein,et al.  Efficient global optimization for combinatorial problems , 2014, GECCO.

[60]  Zhao Wei,et al.  Chemical Reaction Optimization for the Fuzzy Rule learning problem , 2012, 2012 IEEE Congress on Evolutionary Computation.

[61]  Raul Poler,et al.  Non-Linear Programming , 2014 .

[62]  Geoffrey C. Fox,et al.  A deterministic annealing approach to clustering , 1990, Pattern Recognit. Lett..

[63]  Samy Bengio,et al.  The Vehicle Routing Problem with Time Windows Part II: Genetic Search , 1996, INFORMS J. Comput..

[64]  Jane J. Ye,et al.  Optimality conditions for bilevel programming problems , 1995 .

[65]  W. Y. Szeto,et al.  Chemical reaction optimization for solving a static bike repositioning problem , 2016 .

[66]  Eitaro Aiyoshi,et al.  HIERARCHICAL DECENTRALIZED SYSTEM AND ITS NEW SOLUTION BY A BARRIER METHOD. , 1980 .

[67]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[68]  Li Lei,et al.  Research on problems Bilevel Programming for personnel allocation in enterprise , 2010, 2010 International Conference on Management Science & Engineering 17th Annual Conference Proceedings.