Solving Generalized CDT Problems via Two-Parameter Eigenvalues

We consider solving a nonconvex quadratic minimization problem with two quadratic constraints, one of which being convex. This problem is a generalization of the Celis--Denis--Tapia (CDT) problem and thus we refer to it as GCDT (Generalized CDT). The CDT problem has been widely studied, but no polynomial-time algorithm was known until Bienstock's recent work. His algorithm solves the CDT problem in polynomial time with respect to the number of bits in data and $\log\epsilon^{-1}$ by admitting an $\epsilon$ error in the constraints. The algorithm, however, appears to be difficult to implement. In this paper, we present another algorithm for GCDT, which is guaranteed to find a global solution for almost all GCDT instances (and slightly perturbed ones in some exceptionally rare cases), in exact arithmetic (including eigenvalue computation). Our algorithm is based on the approach proposed by Iwata, Nakatsukasa, and Takeda (2015) for computing the signed distance between overlapping ellipsoids. Our algorithm computes all the Lagrange multipliers of GCDT by solving a two-parameter linear eigenvalue problem, obtains the corresponding KKT points, and finds a global solution as the KKT point with the smallest objective value. In practice, in finite precision arithmetic, our algorithm requires $O(n^6\log\log u^{-1})$ computational time, where $n$ is the number of variables and $u$ is the unit roundoff. Although we derive our algorithm under the unrealistic assumption that exact eigenvalues can be computed, numerical experiments illustrate that our algorithm performs well in finite precision arithmetic.

[1]  Akiko Takeda,et al.  Solving the Trust-Region Subproblem By a Generalized Eigenvalue Problem , 2017, SIAM J. Optim..

[2]  Yuan,et al.  COMPUTE A CELIS-DENNIS-TAPIA STEP , 2005 .

[3]  O. Mangasarian,et al.  The Fritz John Necessary Optimality Conditions in the Presence of Equality and Inequality Constraints , 1967 .

[4]  Nicholas J. Higham,et al.  INVERSE PROBLEMS NEWSLETTER , 1991 .

[5]  Michael L. Overton,et al.  Narrowing the difficulty gap for the Celis–Dennis–Tapia problem , 2015, Math. Program..

[6]  Ya-Xiang Yuan,et al.  On Local Solutions of the Celis--Dennis--Tapia Subproblem , 1999, SIAM J. Optim..

[7]  Samuel Burer,et al.  A Two-Variable Approach to the Two-Trust-Region Subproblem , 2016, SIAM J. Optim..

[8]  Daniel Bienstock,et al.  A Note on Polynomial Solvability of the CDT Problem , 2014, SIAM J. Optim..

[9]  Ya-Xiang Yuan,et al.  A trust region algorithm for equality constrained optimization , 1990, Math. Program..

[10]  Henry Wolkowicz,et al.  Indefinite Trust Region Subproblems and Nonsymmetric Eigenvalue Perturbations , 1995, SIAM J. Optim..

[11]  F. Kirwan Complex Algebraic Curves , 1992 .

[12]  Ya-Xiang Yuan,et al.  Optimality Conditions for the Minimization of a Quadratic with Two Quadratic Constraints , 1997, SIAM J. Optim..

[13]  Alexander I. Barvinok Feasibility testing for systems of real quadratic equations , 1993, Discret. Comput. Geom..

[14]  Alex Townsend,et al.  Computing the common zeros of two bivariate functions via Bézout resultants , 2015, Numerische Mathematik.

[15]  Shuzhong Zhang,et al.  On Cones of Nonnegative Quadratic Functions , 2003, Math. Oper. Res..

[16]  F. John Extremum Problems with Inequalities as Subsidiary Conditions , 2014 .

[17]  M. Tismenetsky,et al.  The Bezoutian and the eigenvalue-separation problem for matrix polynomials , 1982 .

[18]  F. Tisseur Backward error and condition of polynomial eigenvalue problems , 2000 .

[19]  G. Stewart,et al.  An Algorithm for Generalized Matrix Eigenvalue Problems. , 1973 .

[20]  Shuzhong Zhang,et al.  Strong Duality for the CDT Subproblem: A Necessary and Sufficient Condition , 2008, SIAM J. Optim..

[21]  Akiko Takeda,et al.  Computing the Signed Distance Between Overlapping Ellipsoids , 2015, SIAM J. Optim..

[22]  P. A. Browne,et al.  Numerical Methods for Two Parameter Eigenvalue Problems , 2008 .

[23]  Ya-Xiang Yuan,et al.  On a subproblem of trust region algorithms for constrained optimization , 1990, Math. Program..

[24]  Samuel Burer,et al.  Second-Order-Cone Constraints for Extended Trust-Region Subproblems , 2013, SIAM J. Optim..