Data Randomness Makes Optimization Problems Easier to Solve ?

Optimization algorithms have been recently applied to solver problems where data possess certain randomness, partly because data themselves contain randomness in a big-data environment or data are randomly sampled from their populations. It has been shown that data randomness typically makes algorithms run faster in the so-called “average behavior analysis”. In this short note, we give an example to show that a general non-convex quadratically constrained quadratic optimization problem, when data are randomly generated and the variable dimension is relatively higher than the number of constraints, can be globally solved with high probability via convex optimization algorithms. The proof is based on the fact that the semidefinite relaxation of the problem with random data would likely be exact in such cases. This implies that certain randomness in the gradient vectors and/or Hessian matrices may help to solve non-convex optimization problems.

[1]  Amit Singer,et al.  Tightness of the maximum likelihood semidefinite relaxation for angular synchronization , 2014, Math. Program..

[2]  Yinyu Ye,et al.  Conditions for Correct Sensor Network Localization Using SDP Relaxation , 2013 .

[3]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[4]  Zhi-Quan Luo,et al.  Semidefinite Relaxation of Quadratic Optimization Problems , 2010, IEEE Signal Processing Magazine.

[5]  Anthony Man-Cho So,et al.  Probabilistic analysis of the semidefinite relaxation detector in digital communications , 2010, SODA '10.

[6]  Shuzhong Zhang,et al.  New Results on Quadratic Minimization , 2003, SIAM J. Optim..

[7]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[8]  Michael J. Todd,et al.  Characterizations, bounds, and probabilistic analysis of two complexity measures for linear programming problems , 2001, Math. Program..

[9]  Yinyu Ye,et al.  Probabilistic Analysis of an Infeasible-Interior-Point Algorithm for Linear Programming , 1999, Math. Oper. Res..

[10]  Yinyu Ye,et al.  Toward Probabilistic Analysis of Interior-Point Algorithms for Linear Programming , 1994, Math. Oper. Res..

[11]  Michael J. Todd,et al.  Polynomial expected behavior of a pivoting algorithm for linear complementarity and linear programming problems , 1986, Math. Program..

[12]  Nimrod Megiddo,et al.  A simplex algorithm whose average number of steps is bounded between two quadratic functions of the smaller dimension , 1984, STOC '84.

[13]  Stephen Smale,et al.  On the average number of steps of the simplex method of linear programming , 1983, Math. Program..