Alternating direction method of multipliers for strictly convex quadratic programs: Optimal parameter selection

We consider an approach for solving strictly convex quadratic programs (QPs) with general linear inequalities by the alternating direction method of multipliers (ADMM). In particular, we focus on the application of ADMM to the QPs of constrained Model Predictive Control (MPC). After introducing our ADMM iteration, we provide a proof of convergence closely related to the theory of maximal monotone operators. The proof relies on a general measure to monitor the rate of convergence and hence to characterize the optimal step size for the iterations. We show that the identified measure converges at a Q-linear rate while the iterates converge at a 2-step Q-linear rate. This result allows us to relax some of the existing assumptions in optimal step size selection, that currently limit the applicability to the QPs of MPC. The results are validated through a large public benchmark set of QPs of MPC for controlling a four tank process.

[1]  Karl Henrik Johansson,et al.  The quadruple-tank process: a multivariable laboratory process with an adjustable zero , 2000, IEEE Trans. Control. Syst. Technol..

[2]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[3]  R. Monteiro,et al.  Iteration-complexity of block-decomposition algorithms and the alternating minimization augmented Lagrangian method , 2010 .

[4]  Stephen P. Boyd,et al.  A Splitting Method for Optimal Control , 2013, IEEE Transactions on Control Systems Technology.

[5]  Daniel Boley,et al.  Local Linear Convergence of the Alternating Direction Method of Multipliers on Quadratic or Linear Programs , 2013, SIAM J. Optim..

[6]  Alberto Bemporad,et al.  Model Predictive Control Tuning by Controller Matching , 2010, IEEE Transactions on Automatic Control.

[7]  Stefano Di Cairano,et al.  An Industry Perspective on MPC in Large Volumes Applications: Potential Benefits and Open Challenges , 2012 .

[8]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[9]  Stefano Di Cairano,et al.  Projection-free parallel quadratic programming for linear model predictive control , 2013, Int. J. Control.

[10]  Manfred Morari,et al.  Real-time input-constrained MPC using fast gradient methods , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[11]  Johan A. K. Suykens,et al.  Application of a Smoothing Technique to Decomposition in Convex Optimization , 2008, IEEE Transactions on Automatic Control.

[12]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[13]  Yang Wang,et al.  A hierarchical time-splitting approach for solving finite-time optimal control problems , 2013, 2013 European Control Conference (ECC).

[14]  Alberto Bemporad,et al.  Vehicle Yaw Stability Control by Coordinated Active Front Steering and Differential Braking in the Tire Sideslip Angles Domain , 2013, IEEE Transactions on Control Systems Technology.

[15]  Ilya Kolmanovsky,et al.  Model Predictive Control approach for guidance of spacecraft rendezvous and proximity maneuvering , 2012 .

[16]  Euhanna Ghadimi,et al.  Optimal Parameter Selection for the Alternating Direction Method of Multipliers (ADMM): Quadratic Problems , 2013, IEEE Transactions on Automatic Control.

[17]  Renato D. C. Monteiro,et al.  Iteration-Complexity of Block-Decomposition Algorithms and the Alternating Direction Method of Multipliers , 2013, SIAM J. Optim..