Pure characteristics demand models and distributionally robust mathematical programs with stochastic complementarity constraints

We formulate pure characteristics demand models under uncertainties of probability distributions as distributionally robust mathematical programs with stochastic complementarity constraints (DRMP-SCC). For any fixed first-stage variable and a random realization, the second-stage problem of DRMP-SCC is a monotone linear complementarity problem (LCP). To deal with uncertainties of probability distributions of the involved random variables in the stochastic LCP, we use the distributionally robust approach. Moreover, we propose an approximation problem with regularization and discretization to solve DRMP-SCC, which is a two-stage nonconvex-nonconcave minimax optimization problem. We prove the convergence of the approximation problem to DRMP-SCC regarding the optimal solution sets, optimal values and stationary points as the regularization parameter goes to zero and the sample size goes to infinity. Finally, preliminary numerical results for investigating distributional robustness of pure characteristics demand models are reported to illustrate the effectiveness and efficiency of our approaches.

[1]  M. Fukushima,et al.  Solving stochastic mathematical programs with equilibrium constraints via approximation and smoothing implicit programming with penalization , 2008, Math. Program..

[2]  G. Pflug,et al.  Multistage Stochastic Optimization , 2014 .

[3]  Benjamin Pfaff,et al.  Perturbation Analysis Of Optimization Problems , 2016 .

[4]  A. Shapiro,et al.  Stochastic mathematical programs with equilibrium constraints, modelling and sample average approximation , 2008 .

[5]  Wotao Yin,et al.  A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion , 2013, SIAM J. Imaging Sci..

[6]  Gui-Hua Lin,et al.  Stochastic Equilibrium Problems and Stochastic Mathematical Programs with Equilibrium Constraints: A Survey 1 , 2009 .

[7]  Weijun Xie,et al.  On distributionally robust chance constrained programs with Wasserstein distance , 2018, Mathematical Programming.

[8]  Daniel Kuhn,et al.  Ambiguous Joint Chance Constraints Under Mean and Dispersion Information , 2017, Oper. Res..

[9]  Jane J. Ye,et al.  Exact Penalization and Necessary Optimality Conditions for Generalized Bilevel Programming Problems , 1997, SIAM J. Optim..

[10]  Yinyu Ye,et al.  On affine scaling algorithms for nonconvex quadratic programming , 1992, Math. Program..

[11]  Jane J. Ye,et al.  A Class of Quadratic Programs with Linear Complementarity Constraints , 2009 .

[12]  R. Aumann INTEGRALS OF SET-VALUED FUNCTIONS , 1965 .

[13]  Mingyi Hong,et al.  Nonconvex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances , 2020, IEEE Signal Processing Magazine.

[14]  Michael I. Jordan,et al.  What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization? , 2019, ICML.

[15]  Jane J. Ye,et al.  Approximating Stationary Points of Stochastic Mathematical Programs with Equilibrium Constraints via Sample Averaging , 2011 .

[16]  Olvi L. Mangasarian,et al.  Error bounds for monotone linear complementarity problems , 1986, Math. Program..

[17]  O. Mangasarian,et al.  The Fritz John Necessary Optimality Conditions in the Presence of Equality and Inequality Constraints , 1967 .

[18]  Claudia A. Sagastizábal,et al.  An approximation scheme for a class of risk-averse stochastic equilibrium problems , 2016, Math. Program..

[19]  Alois Pichler,et al.  Discrete Approximation and Quantification in Distributionally Robust Optimization , 2018, Math. Oper. Res..

[20]  J. Pang,et al.  Exact penalty for mathematical programs with linear complementarity constraints , 1997 .

[21]  Jong-Shi Pang,et al.  Nonconvex Games with Side Constraints , 2011, SIAM J. Optim..

[22]  Xiaojun Chen,et al.  Perturbation Bounds of P-Matrix Linear Complementarity Problems , 2007, SIAM J. Optim..

[23]  Olvi L. Mangasarian,et al.  Error bounds for nondegenerate monotone linear complementarity problems , 1990, Math. Program..

[24]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[25]  Bethany L. Nicholson,et al.  Mathematical Programs with Equilibrium Constraints , 2021, Pyomo — Optimization Modeling in Python.

[26]  Stefan Scholtes,et al.  Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity , 2000, Math. Oper. Res..

[27]  Xiaojun Chen,et al.  Regularized Mathematical Programs with Stochastic Equilibrium Constraints: Estimating Structural Demand Models , 2015, SIAM J. Optim..

[28]  Jong-Shi Pang,et al.  A Constructive Approach to Estimating Pure Characteristics Demand Models with Pricing , 2015, Oper. Res..

[29]  Steven Berry,et al.  The Pure Characteristics Demand Model , 2007 .

[30]  C. Villani Topics in Optimal Transportation , 2003 .

[31]  Alexander Shapiro,et al.  Lectures on Stochastic Programming - Modeling and Theory, Second Edition , 2014, MOS-SIAM Series on Optimization.

[32]  Yongchao Liu,et al.  Distributionally robust optimization with matrix moment constraints: Lagrange duality and cutting plane methods , 2017, Mathematical Programming.

[33]  Alexey F. Izmailov,et al.  An Active-Set Newton Method for Mathematical Programs with Complementarity Constraints , 2008, SIAM J. Optim..

[34]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[35]  Che-Lin Su,et al.  Constrained Optimization Approaches to Estimation of Structural Models , 2011 .

[36]  Olvi L. Mangasarian,et al.  New improved error bounds for the linear complementarity problem , 1994, Math. Program..

[37]  Constrained Optimization Approaches to Estimation of Structural Models , 2012 .

[38]  Shabbir Ahmed,et al.  On Deterministic Reformulations of Distributionally Robust Joint Chance Constrained Optimization Problems , 2018, SIAM J. Optim..

[39]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[40]  Lei Guo,et al.  Notes on Some Constraint Qualifications for Mathematical Programs with Equilibrium Constraints , 2013, J. Optim. Theory Appl..

[41]  Jason D. Lee,et al.  Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods , 2019, NeurIPS.

[42]  Jie Zhang,et al.  Quantitative Stability Analysis for Distributionally Robust Optimization with Moment Constraints , 2016, SIAM J. Optim..

[43]  O. Mangasarian Global error bounds for monotone affine variational inequality problems , 1992 .