Bilevel optimization based on iterative approximation of multiple mappings

A large number of application problems involve two levels of optimization, where one optimization task is nested inside the other. These problems are known as bilevel optimization problems and have been studied by both classical optimization community and evolutionary optimization community. Most of the solution procedures proposed until now are either computationally very expensive or applicable to only small classes of bilevel optimization problems adhering to mathematically simplifying assumptions. In this paper, we propose an evolutionary optimization method that tries to reduce the computational expense by iteratively approximating two important mappings in bilevel optimization; namely, the lower level rational reaction mapping and the lower level optimal value function mapping. The algorithm has been tested on a large number of test problems and comparisons have been performed with other algorithms. The results show the performance gain to be quite significant. To the best knowledge of the authors, a combined theory-based and population-based solution procedure utilizing mappings has not been suggested yet for bilevel problems.

[1]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[2]  Kalyanmoy Deb,et al.  Transportation policy formulation as a multi-objective bilevel optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[3]  Omar Ben-Ayed,et al.  Bilevel linear programming , 1993, Comput. Oper. Res..

[4]  Kalyanmoy Deb,et al.  Test Problem Construction for Single-Objective Bilevel Optimization , 2014, Evolutionary Computation.

[5]  Ting L. Lei Identifying Critical Facilities in Hub‐and‐Spoke Networks: A Hub Interdiction Median Problem , 2013 .

[6]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[7]  Stephan Dempe,et al.  Directional derivatives of the solution of a parametric nonlinear program , 1995, Math. Program..

[8]  J. Mirrlees The Theory of Moral Hazard and Unobservable Behaviour: Part I , 1999 .

[9]  Jane J. Ye,et al.  New Necessary Optimality Conditions for Bilevel Programs by Combining the MPEC and Value Function Approaches , 2010, SIAM J. Optim..

[10]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[11]  M. Patriksson,et al.  Stochastic bilevel programming in structural optimization , 2001 .

[12]  Ue-Pyng Wen,et al.  Linear Bi-level Programming Problems — A Review , 1991 .

[13]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[15]  Jonathan F. Bard,et al.  Practical Bilevel Optimization , 1998 .

[16]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[17]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[18]  Xianjia Wang,et al.  A Hybrid Differential Evolution Algorithm for Solving Nonlinear Bilevel Programming with Linear Constraints , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[19]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[20]  Berç Rustem,et al.  Pessimistic Bilevel Optimization , 2013, SIAM J. Optim..

[21]  Martin P. Bendsøe,et al.  Optimization of Structural Topology, Shape, And Material , 1995 .

[22]  P. K. Kannan,et al.  Retail Channel Structure Impact on Strategic Engineering Product Design , 2011, Manag. Sci..

[23]  Jirí Vladimír Outrata,et al.  On the numerical solution of a class of Stackelberg problems , 1990, ZOR Methods Model. Oper. Res..

[24]  Jean-Paul Laumond,et al.  From human to humanoid locomotion—an inverse optimal control approach , 2010, Auton. Robots.

[25]  Xiangyong Li,et al.  A Hierarchical Particle Swarm Optimization for Solving Bilevel Programming Problems , 2006, ICAISC.

[26]  Tapabrata Ray,et al.  An Enhanced Memetic Algorithm for Single-Objective Bilevel Optimization Problems , 2016, Evolutionary Computation.

[27]  Yuping Wang,et al.  A Hybrid Genetic Algorithm for Solving Nonlinear Bilevel Programming Problems Based on the Simplex Method , 2007, Third International Conference on Natural Computation (ICNC 2007).

[28]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[29]  Michael Ulbrich,et al.  Imitating human reaching motions using physically inspired optimization principles , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[30]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[31]  Kalyanmoy Deb,et al.  Evolutionary Bilevel Optimization: An Introduction and Recent Advances , 2017, Recent Advances in Evolutionary Multi-objective Optimization.

[32]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[33]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[34]  Kalyanmoy Deb,et al.  Solving optimistic bilevel programs by iteratively approximating lower level optimal value function , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[35]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[36]  Tapabrata Ray,et al.  A Surrogate Assisted Approach for Single-Objective Bilevel Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[37]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[38]  Yan Jiang,et al.  Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem , 2013, Appl. Math. Comput..

[39]  Alain B. Zemkoho,et al.  Necessary optimality conditions in pessimistic bilevel programming , 2014 .

[40]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[41]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[42]  Jerome Bracken,et al.  Defense Applications of Mathematical Programs with Optimization Problems in the Constraints , 1974, Oper. Res..

[43]  Aravind Srinivasan,et al.  A Population-Based, Parent Centric Procedure for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[44]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[45]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[46]  B. Mordukhovich,et al.  New necessary optimality conditions in optimistic bilevel programming , 2007 .

[47]  Stephan Dempe,et al.  Foundations of Bilevel Programming , 2002 .

[48]  Hecheng Li,et al.  A genetic algorithm using a finite search space for solving nonlinear/linear fractional bilevel programming problems , 2015, Ann. Oper. Res..

[49]  Jirí V. Outrata,et al.  A note on the usage of nondifferentiable exact penalties in some special optimization problems , 1988, Kybernetika.

[50]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[51]  Arthur W. Westerberg,et al.  Bilevel programming for steady-state chemical process design , 1990 .

[52]  Takeshi Uno,et al.  An evolutionary multi-agent based search method for stackelberg solutions of bilevel facility location problems , 2008 .

[53]  Miles G. Nicholls,et al.  Aluminum Production Modeling - A Nonlinear Bilevel Programming Approach , 1995, Oper. Res..

[54]  Yuping Wang,et al.  A New Evolutionary Algorithm for a Class of Nonlinear Bilevel Programming Problems and Its Global Convergence , 2011, INFORMS J. Comput..

[55]  Shi Feng Bi-level Simulated Annealing Algorithm for Facility Location , 2007 .

[56]  K. Jittorntrum Solution point differentiability without strict complementarity in nonlinear programming , 1984 .

[57]  Zhongping Wan,et al.  A hybrid intelligent algorithm by combining particle swarm optimization with chaos searching technique for solving nonlinear bilevel programming problems , 2013, Swarm Evol. Comput..

[58]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[59]  Helio J. C. Barbosa,et al.  A study on the use of heuristics to solve a bilevel programming problem , 2015, Int. Trans. Oper. Res..

[60]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[61]  Michael Florian,et al.  Optimizing frequencies in a transit network: a nonlinear bi-level programming approach , 1995 .

[62]  Kalyanmoy Deb,et al.  Evolutionary algorithm for bilevel optimization using approximations of the lower level optimal solution mapping , 2017, Eur. J. Oper. Res..

[63]  Jonathan F. Bard,et al.  Algorithms for nonlinear bilevel mathematical programs , 1991, IEEE Trans. Syst. Man Cybern..

[64]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[65]  Bo An,et al.  A Deployed Quantal Response-Based Patrol Planning System for the U.S. Coast Guard , 2013, Interfaces.

[66]  Jonathan F. Bard,et al.  A Branch and Bound Algorithm for the Bilevel Programming Problem , 1990, SIAM J. Sci. Comput..

[67]  Guoshan Liu,et al.  A trust region algorithm for bilevel programing problems , 1998 .

[68]  William R. Smith,et al.  Chemical Reaction Equilibrium Analysis: Theory and Algorithms , 1982 .

[69]  J. Morgan,et al.  Existence of Solutions to Bilevel Variational Problems in Banach Spaces , 2001 .

[70]  Kalyanmoy Deb,et al.  A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications , 2017, IEEE Transactions on Evolutionary Computation.

[71]  Daniel Ralph,et al.  Using EPECs to Model Bilevel Games in Restructured Electricity Markets with Locational Prices , 2007, Oper. Res..

[72]  Panos M. Pardalos,et al.  Global optimization of concave functions subject to quadratic constraints: An application in nonlinear bilevel programming , 1992, Ann. Oper. Res..