A Distributed Algorithm for Large-scale Convex Quadratically Constrained Quadratic Programs

We propose a Jacobi-style distributed algorithm to solve convex, quadratically constrained quadratic programs (QCQPs), which arise from a broad range of applications. While small to medium-sized convex QCQPs can be solved efficiently by interior-point algorithms, large-scale problems pose significant challenges to traditional algorithms that are mainly designed to be implemented on a single computing unit. The exploding volume of data (and hence, the problem size), however, may overwhelm any such units. In this paper, we propose a distributed algorithm for general, non-separable, large-scale convex QCQPs, using a novel idea of predictor-corrector primal-dual update with an adaptive step size. The algorithm enables distributed storage of data as well as parallel distributed computing. We establish the conditions for the proposed algorithm to converge to a global optimum, and implement our algorithm on a computer cluster with multiple nodes using Message Passing Interface (MPI). The numerical experiments are conducted on data sets of various scales from different applications, and the results show that our algorithm exhibits favorable scalability for solving large-scale problems.

[1]  Stephen P. Boyd,et al.  Conic Optimization via Operator Splitting and Homogeneous Self-Dual Embedding , 2013, Journal of Optimization Theory and Applications.

[2]  Marc Teboulle,et al.  A proximal-based decomposition method for convex minimization problems , 1994, Math. Program..

[3]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[4]  Shaunak Chatterjee,et al.  Constrained Multi-Slot Optimization for Ranking Recommendations , 2016, 1602.04391.

[5]  Rekha R. Thomas,et al.  A QCQP Approach to Triangulation , 2012, ECCV.

[6]  Nikos D. Sidiropoulos,et al.  Consensus-ADMM for General Quadratically Constrained Quadratic Programming , 2016, IEEE Transactions on Signal Processing.

[7]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[8]  Laurent Savy,et al.  Mismatched filter optimization for radar applications using quadratically constrained quadratic programs , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Kinjal Basu,et al.  Large-Scale Quadratically Constrained Quadratic Program via Low-Discrepancy Sequences , 2017, NIPS.

[10]  Javad Lavaei,et al.  A fast distributed algorithm for decomposable semidefinite programs , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[11]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[12]  K. Mani Chandy,et al.  Quadratically Constrained Quadratic Programs on Acyclic Graphs With Application to Power Flow , 2012, IEEE Transactions on Control of Network Systems.

[13]  Peter Lancaster,et al.  Norms on direct sums and tensor products , 1972 .

[14]  Anders Rantzer,et al.  Distributed Semidefinite Programming With Application to Large-Scale System Analysis , 2015, IEEE Transactions on Automatic Control.

[15]  Daniel Pérez Palomar,et al.  Randomized Algorithms for Optimal Solutions of Double-Sided QCQP With Applications in Signal Processing , 2014, IEEE Transactions on Signal Processing.

[16]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[17]  Stephen P. Boyd,et al.  Applications of second-order cone programming , 1998 .

[18]  Charles R. Johnson,et al.  Matrix Analysis, 2nd Ed , 2012 .

[19]  L. Breiman Arcing classifier (with discussion and a rejoinder by the author) , 1998 .