On reduced semidefinite programs for second order moment bounds with applications

We show that the complexity of computing the second order moment bound on the expected optimal value of a mixed integer linear program with a random objective coefficient vector is closely related to the complexity of characterizing the convex hull of the points $$\{{1 \atopwithdelims (){\varvec{x}}}{1 \atopwithdelims (){\varvec{x}}}' \ | \ {\varvec{x}} \in {\mathcal {X}}\}$${1x1x′|x∈X} where $${\mathcal {X}}$$X is the feasible region. In fact, we can replace the completely positive programming formulation for the moment bound on $${\mathcal {X}}$$X, with an associated semidefinite program, provided we have a linear or a semidefinite representation of this convex hull. As an application of the result, we identify a new polynomial time solvable semidefinite relaxation of the distributionally robust multi-item newsvendor problem by exploiting results from the Boolean quadric polytope. For $${\mathcal {X}}$$X described explicitly by a finite set of points, our formulation leads to a reduction in the size of the semidefinite program. We illustrate the usefulness of the reduced semidefinite programming bounds in estimating the expected range of random variables with two applications arising in random walks and best–worst choice models.

[1]  B. Arnold,et al.  Bounds on Expectations of Linear Systematic Statistics Based on Dependent Samples , 1979 .

[2]  Expectation bounds on linear estimators from dependent samples , 2001 .

[3]  Stephen P. Boyd,et al.  Generalized Chebyshev Bounds via Semidefinite Programming , 2007, SIAM Rev..

[4]  I. Olkin,et al.  A Multivariate Tchebycheff Inequality , 1958 .

[5]  T. Aven Upper (lower) bounds on the mean of the maximum (minimum) of a number of random variables , 1985, Journal of Applied Probability.

[6]  Karthik Natarajan,et al.  A Convex Optimization Approach for Computing Correlated Choice Probabilities With Many Alternatives , 2019, IEEE Transactions on Automatic Control.

[7]  Kim-Chuan Toh,et al.  Solving semidefinite-quadratic-linear programs using SDPT3 , 2003, Math. Program..

[8]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[9]  J. Lasserre Bounds on measures satisfying moment conditions , 2002 .

[10]  Karthik Natarajan,et al.  MIXED ZERO-ONE LINEAR PROGRAMS UNDER OBJECTIVE UNCERTAINTY : A COMPLETELY POSITIVE REPRESENTATION , 2010 .

[11]  Xiaobo Li,et al.  Distributionally Robust Mixed Integer Linear Programs: Persistency Models with Applications , 2013, Eur. J. Oper. Res..

[12]  I. Olkin,et al.  A One-Sided Inequality of the Chebyshev Type , 1960 .

[13]  Mark D. Uncles,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1987 .

[14]  Daniel Kuhn,et al.  Distributionally robust joint chance constraints with second-order moment information , 2011, Mathematical Programming.

[15]  B. Praag,et al.  Multichoice Logit: Modeling Incomplete Preference Rankings of Classical Concerts , 1999 .

[16]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[17]  Manfred W. Padberg,et al.  The boolean quadric polytope: Some characteristics, facets and relatives , 1989, Math. Program..

[18]  Yurii Nesterov,et al.  Squared Functional Systems and Optimization Problems , 2000 .

[19]  Michel Deza,et al.  Geometry of cuts and metrics , 2009, Algorithms and combinatorics.

[20]  Ioana Popescu,et al.  Robust Mean-Covariance Solutions for Stochastic Optimization , 2007, Oper. Res..

[21]  Manjunatha K Prasad,et al.  Generalized Inverse of a Matrix and its Applications , 2011 .

[22]  Chung-Piaw Teo,et al.  Mixed 0-1 Linear Programs Under Objective Uncertainty: A Completely Positive Representation , 2009, Oper. Res..

[23]  K. Isii On sharpness of tchebycheff-type inequalities , 1962 .

[24]  Yaoliang Yu,et al.  A General Projection Property for Distribution Families , 2009, NIPS.

[25]  W. Feller The Asymptotic Distribution of the Range of Sums of Independent Random Variables , 1951 .

[26]  Dennis Fok,et al.  A rank-ordered logit model with unobserved heterogeneity in ranking capabilities. , 2007 .

[27]  Daniel Kuhn,et al.  Distributionally robust multi-item newsvendor problems with multimodal demand distributions , 2014, Mathematical Programming.

[28]  Chung-Piaw Teo,et al.  Choice Prediction With Semidefinite Optimization When Utilities are Correlated , 2012, IEEE Transactions on Automatic Control.

[29]  H. O. Hartley,et al.  Universal Bounds for Mean Range and Extreme Observation , 1954 .

[30]  A. Shapiro Extremal Problems on the Set of Nonnegative Definite Matrices , 1985 .

[31]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[32]  Peter J. C. Dickinson,et al.  On the computational complexity of membership problems for the completely positive cone and its dual , 2013, Computational Optimization and Applications.

[33]  W. J. Studden,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics. , 1967 .

[34]  Bounds for the expectation of linear combinations of order statistics with application to pert networks , 1986 .

[35]  Phelim P. Boyle,et al.  Bounds on contingent claims based on several assets , 1997 .

[36]  Germán Poveda,et al.  The Hurst Effect: The scale of fluctuation approach , 1993 .

[37]  John R. Rice,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics (Samuel Karlin and William J. Studden) , 1967 .

[38]  R. Plackett,et al.  Limits of the ratio of mean range to standard deviation. , 1947, Biometrika.

[39]  E. J. Gumbel,et al.  The Maxima of the Mean Largest Value and of the Range , 1954 .

[40]  H. E. Hurst,et al.  Long-Term Storage Capacity of Reservoirs , 1951 .

[41]  Luc Devroye,et al.  Inequalities for the Completion Times of Stochastic PERT Networks , 1979, Math. Oper. Res..

[42]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[43]  J. Louviere,et al.  Some probabilistic models of best, worst, and best–worst choices , 2005 .

[44]  I. Olkin,et al.  Multivariate Chebyshev Inequalities , 1960 .

[45]  Katta G. Murty,et al.  Some NP-complete problems in quadratic and nonlinear programming , 1987, Math. Program..

[46]  Ioana Popescu,et al.  Optimal Inequalities in Probability Theory: A Convex Optimization Approach , 2005, SIAM J. Optim..

[47]  E. H. Lloyd,et al.  ON THE RANGE OF PARTIAL SUMS OF A FINITE NUMBER OF INDEPENDENT NORMAL VARIATES , 1953 .

[48]  Samuel Burer,et al.  On the copositive representation of binary and continuous nonconvex quadratic programs , 2009, Math. Program..

[49]  W. Greene,et al.  Modeling Ordered Choices: A Primer , 2010 .

[50]  H. Nagaraja,et al.  Some finite sample results for the selection differential , 1981 .

[51]  Ioana Popescu,et al.  On the Relation Between Option and Stock Prices: A Convex Optimization Approach , 2002, Oper. Res..

[52]  A. Albert Conditions for Positive and Nonnegative Definiteness in Terms of Pseudoinverses , 1969 .

[53]  Xuan Vinh Doan,et al.  Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion , 2010, Math. Oper. Res..

[54]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[55]  Luigi Salce,et al.  Completely positive matrices and positivity of least squares solutions , 1993 .

[56]  Peter J. C. Dickinson The copositive cone, the completely positive cone and their generalisations , 2013 .

[57]  E. Carlen TRACE INEQUALITIES AND QUANTUM ENTROPY: An introductory course , 2009 .

[58]  A. Palma,et al.  Best and worst choices , 2013 .

[59]  R. Penrose A Generalized inverse for matrices , 1955 .

[60]  A. Berman,et al.  Bipartite completely positive matrices , 1988, Mathematical Proceedings of the Cambridge Philosophical Society.