Technical Note - There's No Free Lunch: On the Hardness of Choosing a Correct Big-M in Bilevel Optimization

One of the most frequently used approaches to solve linear bilevel optimization problems consists in replacing the lower-level problem with its Karush-Kuhn-Tucker (KKT) conditions and by reformulating the KKT complementarity conditions using techniques from mixed-integer linear optimization. The latter step requires to determine some big-M constant in order to bound the lower level's dual feasible set such that no bilevel-optimal solution is cut off. In practice, heuristics are often used to find a big-M although it is known that these approaches may fail. In this paper, we consider the hardness of two proxies for the above mentioned concept of a bilevel-correct big-M. First, we prove that verifying that a given big-M does not cut off any feasible vertex of the lower level's dual polyhedron cannot be done in polynomial time unless P=NP. Second, we show that verifying that a given big-M does not cut off any optimal point of the lower level's dual problem (for any point in the projection of the high-point relaxation onto the leader's decision space) is as hard as solving the original bilevel problem.

[1]  Martine Labbé,et al.  A study of general and security Stackelberg game formulations , 2019, Eur. J. Oper. Res..

[2]  Daniel Ralph,et al.  Using EPECs to Model Bilevel Games in Restructured Electricity Markets with Locational Prices , 2007, Oper. Res..

[3]  Wayne F. Bialas,et al.  Two-Level Linear Programming , 1984 .

[4]  Sarit Kraus,et al.  Playing games for security: an efficient exact algorithm for solving Bayesian Stackelberg games , 2008, AAMAS.

[5]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[6]  Pierre Hansen,et al.  New Branch-and-Bound Rules for Linear Bilevel Programming , 1989, SIAM J. Sci. Comput..

[7]  Juan Miguel Morales,et al.  Solving Linear Bilevel Problems Using Big-Ms: Not All That Glitters Is Gold , 2018, IEEE Transactions on Power Systems.

[8]  Pierre Hansen,et al.  Links Between Linear Bilevel and Mixed 0–1 Programming Problems , 1995 .

[9]  Richard M. Karp,et al.  On the Computational Complexity of Combinatorial Problems , 1975, Networks.

[10]  Stephan Dempe,et al.  Foundations of Bilevel Programming , 2002 .

[11]  Martin Schmidt,et al.  Global optimization of multilevel electricity market models including network design and graph partitioning , 2019, Discret. Optim..

[12]  José Fortuny-Amat,et al.  A Representation and Economic Interpretation of a Two-Level Programming Problem , 1981 .

[13]  Martine Labbé Bilevel Programming and Price Setting Problems , 2006, OR.

[14]  John L. Klepeis,et al.  Bilevel Programming Problems , 1999 .

[15]  Martin Schmidt,et al.  Optimal price zones of electricity markets: a mixed-integer multilevel model and global solution approaches , 2019, Optim. Methods Softw..

[16]  Ue-Pyng Wen,et al.  Linear Bi-level Programming Problems — A Review , 1991 .

[17]  W. Marsden I and J , 2012 .

[18]  Martin Schmidt,et al.  Endogenous Price Zones and Investment Incentives in Electricity Markets: An Application of Multilevel Optimization With Graph Partitioning , 2018, Energy Economics.

[19]  Thomas M. Liebling,et al.  Analysis of Backtrack Algorithms for Listing All Vertices and All Faces of a Convex Polyhedron , 1997, Comput. Geom..

[20]  Yves Smeers,et al.  The EU regulation on cross-border trade of electricity: A two-stage equilibrium model , 2007, Eur. J. Oper. Res..

[21]  Gerhard J. Woeginger,et al.  Bilevel Knapsack with Interdiction Constraints , 2016, INFORMS J. Comput..

[22]  Peter W. Glynn,et al.  A Nonparametric Approach to Multiproduct Pricing , 2006, Oper. Res..

[23]  Alexander Martin,et al.  Transmission and generation investment in electricity markets: The effects of market splitting and network fee regimes , 2016, Eur. J. Oper. Res..

[24]  Jonathan F. Bard,et al.  A Branch and Bound Algorithm for the Bilevel Programming Problem , 1990, SIAM J. Sci. Comput..

[25]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[26]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[27]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[28]  Lars Schewe,et al.  A multilevel model of the European entry-exit gas market , 2018, Math. Methods Oper. Res..

[29]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[30]  J. Bard Some properties of the bilevel programming problem , 1991 .

[31]  Julia Grübel,et al.  Nonconvex Equilibrium Models for Gas Market Analysis: Failure of Standard Techniques and Alternative Modeling Approaches , 2017, Eur. J. Oper. Res..

[32]  T. Ralphs,et al.  Interdiction and discrete bilevel linear programming , 2011 .

[33]  A. Williams,et al.  Boundedness relations for linear constraint sets , 1970 .

[34]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .