Alternative Theorems for Quadratic Inequality Systems and Global Quadratic Optimization

We establish alternative theorems for quadratic inequality systems. Consequently, we obtain Lagrange multiplier characterizations of global optimality for classes of nonconvex quadratic optimization problems. We present a generalization of Dine's theorem to a system of two homogeneous quadratic functions with a regular cone. The class of regular cones are cones $K$ for which $(K\cup-K)$ is a subspace. As a consequence, we establish a generalization of the powerful $S$-lemma, which paves the way to obtain a complete characterization of global optimality for a general quadratic optimization model problem involving a system of equality constraints in addition to a single quadratic inequality constraint. We then present an alternative theorem for a system of three nonhomogeneous inequalities by way of establishing the convexity of the joint-range of three homogeneous quadratic functions using a regular cone. This yields Lagrange multiplier characterizations of global optimality for classes of trust-region type problems with two inequality constraints. Finally, we establish an alternative theorem for systems involving an arbitrary finite number of quadratic inequalities involving Z-matrices, which are matrices with nonpositive off diagonal elements, and present necessary and sufficient conditions for global optimality for classes of nonconvex inequality constrained quadratic optimization problems.

[1]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[2]  Leandros Tassiulas,et al.  Convex approximation techniques for joint multiuser downlink beamforming and admission control , 2008, IEEE Transactions on Wireless Communications.

[3]  M. R. Celis A TRUST REGION STRATEGY FOR NONLINEAR EQUALITY CONSTRAINED OPTIMIZATION (NONLINEAR PROGRAMMING, SEQUENTIAL QUADRATIC) , 1985 .

[4]  Zhi-You Wu,et al.  Non-convex quadratic minimization problems with quadratic constraints: global optimality conditions , 2007, Math. Program..

[5]  M. Fiedler Special matrices and their applications in numerical mathematics , 1986 .

[6]  Xin Chen,et al.  A note on quadratic forms , 1999, Math. Program..

[7]  Ya-Xiang Yuan,et al.  A trust region algorithm for equality constrained optimization , 1990, Math. Program..

[8]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[9]  D. Luc,et al.  Nonsmooth vector functions and continuous optimization , 2008 .

[10]  D. Sorensen Newton's method with a model trust region modification , 1982 .

[11]  Shuzhong Zhang,et al.  On Cones of Nonnegative Quadratic Functions , 2003, Math. Oper. Res..

[12]  Yonina C. Eldar,et al.  Strong Duality in Nonconvex Quadratic Optimization with Two Quadratic Constraints , 2006, SIAM J. Optim..

[13]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[14]  Ya-Xiang Yuan,et al.  On a subproblem of trust region algorithms for constrained optimization , 1990, Math. Program..

[15]  Tamás Terlaky,et al.  A Survey of the S-Lemma , 2007, SIAM Rev..

[16]  V. Jeyakumar,et al.  Farkas Lemma: Generalizations , 2009, Encyclopedia of Optimization.

[17]  Amir Beck,et al.  On the convexity of a class of quadratic mappings and its application to the problem of finding the smallest ball enclosing a given intersection of balls , 2007, J. Glob. Optim..

[18]  Shuzhong Zhang,et al.  New Results on Quadratic Minimization , 2003, SIAM J. Optim..

[19]  Boris Polyak Convexity of Quadratic Transformations and Its Use in Control and Optimization , 1998 .

[20]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[21]  J. Martínez-Legaz,et al.  An Alternative Theorem for Quadratic Forms and Extensions , 1995 .

[22]  L. L. Dines On the mapping of quadratic forms , 1941 .

[23]  Nguyen Dong Yen,et al.  Quadratic Programming and Affine Variational Inequalities , 2005 .

[24]  A. Seeger,et al.  Yuan's alternative theorem and the maximization of the minimum eigenvalue function , 1994 .

[25]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[26]  Abdeljelil Baccari,et al.  On the Classical Necessary Second-Order Optimality Conditions in the Presence of Equality and Inequality Constraints , 2005, SIAM J. Optim..

[27]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[28]  L. Brickman ON THE FIELD OF VALUES OF A MATRIX , 1961 .

[29]  Ya-Xiang Yuan,et al.  On Local Solutions of the Celis--Dennis--Tapia Subproblem , 1999, SIAM J. Optim..

[30]  Henry Wolkowicz,et al.  Indefinite Trust Region Subproblems and Nonsymmetric Eigenvalue Perturbations , 1995, SIAM J. Optim..

[31]  Ya-Xiang Yuan,et al.  Optimality Conditions for the Minimization of a Quadratic with Two Quadratic Constraints , 1997, SIAM J. Optim..

[32]  T. Raghavan,et al.  Nonnegative Matrices and Applications , 1997 .

[33]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[34]  Nguyen Dong Yen,et al.  Quadratic Programming and Affine Variational Inequalities: A Qualitative Study , 2005 .