An improved Distributed Dual Newton-CG method for convex quadratic programming problems

This paper considers the problem of solving Programs (QP) arising in the context of distributed optimization and optimal control. A dual decomposition approach is used, where the QP subproblems are solved locally, while the constraints coupling the different subsystems in the time and space domains are enforced by performing a distributed non-smooth Newton iteration on the dual variables. The iterative linear algebra method Conjugate Gradient (CG) is used to compute the dual Newton step. In this context, it has been observed that the dual Hessian can be singular when a poor initial guess for the dual variables is used, hence leading to a failure of the linear algebra. This paper studies this effect and proposes a constraint relaxation strategy to address the problem. It is both formally and experimentally shown that the relaxation prevents the dual Hessian singularity. Moreover, numerical experiments suggest that the proposed relaxation improves significantly the convergence of the Distributed Dual Newton-CG.

[1]  Janick V. Frasch,et al.  A dual Newton strategy for the efficient solution of sparse quadratic programs arising in SQP-based nonlinear MPC , 2013 .

[2]  J. Suykens,et al.  An Interior-Point Lagrangian Decomposition Method for Separable Convex Optimization , 2013, 1302.3136.

[3]  Moritz Diehl,et al.  Multiple shooting for distributed systems with applications in hydro electricity production , 2011 .

[4]  P. Tseng Dual ascent methods for problems with strictly convex costs and linear constraints: a unified approach , 1990 .

[5]  Moritz Diehl,et al.  A distributed method for convex quadratic programming problems arising in optimal control of distributed systems , 2013, 52nd IEEE Conference on Decision and Control.

[6]  Emmanuel J. Candès,et al.  Adaptive Restart for Accelerated Gradient Schemes , 2012, Foundations of Computational Mathematics.

[7]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[8]  Ion Necoara,et al.  Parallel and distributed optimization methods for estimation and control in networks , 2011, 1302.3103.

[9]  Stephen J. Wright,et al.  Object-oriented software for quadratic programming , 2003, TOMS.

[10]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[11]  Claude Lemaréchal,et al.  Lagrangian Relaxation , 2000, Computational Combinatorial Optimization.

[12]  Manfred Morari,et al.  Towards computational complexity certification for constrained MPC based on Lagrange Relaxation and the fast gradient method , 2011, IEEE Conference on Decision and Control and European Control Conference.

[13]  Bart De Schutter,et al.  Accelerated gradient methods and dual decomposition in distributed model predictive control , 2013, Autom..

[14]  M. Diehl,et al.  A Parallel Active-Set Strategy to Solve Sparse Parametric Quadratic Programs arising in MPC , 2012 .

[15]  R. Cottle,et al.  A Lagrangean relaxation algorithm for the constrained matrix problem , 1986 .

[16]  Wu Li,et al.  A New Algorithm for Solving Strictly Convex Quadratic Programs , 1997, SIAM J. Optim..

[17]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[18]  Michael Jünger,et al.  Computational Combinatorial Optimization , 2001, Lecture Notes in Computer Science.

[19]  Anders Rantzer,et al.  Distributed Model Predictive Control with suboptimality and stability guarantees , 2010, 49th IEEE Conference on Decision and Control (CDC).

[20]  M. J. D. Powell,et al.  Algorithms for nonlinear constraints that use lagrangian functions , 1978, Math. Program..

[21]  H. Bock,et al.  A Multiple Shooting Algorithm for Direct Solution of Optimal Control Problems , 1984 .

[22]  J. G. Lewis,et al.  Distributed memory matrix-vector multiplication and conjugate gradient algorithms , 1993, Supercomputing '93.

[23]  F. Clarke Optimization And Nonsmooth Analysis , 1983 .

[24]  Matthias Gerdts,et al.  Hamburger Beiträge zur Angewandten Mathematik A nonsmooth Newton ’ s method for discretized optimal control problems with state and control constraints , 2007 .

[25]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .