Rate analysis of inexact dual first order methods: Application to distributed MPC for network systems

In this paper we propose and analyze two dual methods based on inexact gradient information and averaging that generate approximate primal solutions for smooth convex optimization problems. The complicating constraints are moved into the cost using the Lagrange multipliers. The dual problem is solved by inexact first order methods based on approximate gradients and we prove sublinear rate of convergence for these methods. In particular, we provide, for the first time, estimates on the primal feasibility violation and primal and dual suboptimality of the generated approximate primal and dual solutions. Moreover, we solve approximately the inner problems with a parallel coordinate descent algorithm and we show that it has linear convergence rate. In our analysis we rely on the Lipschitz property of the dual function and inexact dual gradients. Further, we apply these methods to distributed model predictive control for network systems. By tightening the complicating constraints we are also able to ensure the primal feasibility of the approximate solutions generated by the proposed algorithms. We obtain a distributed control strategy that has the following features: state and input constraints are satisfied, stability of the plant is guaranteed, whilst the number of iterations for the suboptimal solution can be precisely determined.

[1]  Hanif D. Sherali,et al.  A class of convergent primal-dual subgradient algorithms for decomposable convex programs , 1986, Math. Program..

[2]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[3]  M. Patriksson,et al.  Ergodic convergence in subgradient optimization , 1998 .

[4]  D. Q. Mayne,et al.  Suboptimal model predictive control (feasibility implies stability) , 1999, IEEE Trans. Autom. Control..

[5]  Eduardo Camponogara,et al.  Distributed model predictive control , 2002 .

[6]  William B. Dunbar,et al.  Distributed Receding Horizon Control With Application to Multi-Vehicle Formation Stabilization , 2004 .

[7]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[8]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[9]  Jonathan P. How,et al.  Robust distributed model predictive control , 2007, Int. J. Control.

[10]  Torbjörn Larsson,et al.  Lagrangian Relaxation via Ballstep Subgradient Methods , 2007, Math. Oper. Res..

[11]  Jonathan P. How,et al.  Distributed Robust Receding Horizon Control for Multivehicle Guidance , 2007, IEEE Transactions on Control Systems Technology.

[12]  Johan A. K. Suykens,et al.  Application of a Smoothing Technique to Decomposition in Convex Optimization , 2008, IEEE Transactions on Automatic Control.

[13]  Lucas Barcelos de Oliveira,et al.  Distributed Optimization for Model Predictive Control of Linear-Dynamic Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Riccardo Scattolini,et al.  Architectures for distributed and hierarchical Model Predictive Control - A review , 2009 .

[15]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[16]  Stephen J. Wright,et al.  Cooperative distributed model predictive control , 2010, Syst. Control. Lett..

[17]  Eduardo F. Camacho,et al.  Distributed model predictive control based on agent negotiation , 2011 .

[18]  Eduardo Camponogara,et al.  Distributed Optimization for Model Predictive Control of Linear Dynamic Networks With Control-Input and Output Constraints , 2011, IEEE Transactions on Automation Science and Engineering.

[19]  Bart De Schutter,et al.  A distributed optimization-based approach for hierarchical model predictive control of large-scale systems with coupled dynamics and constraints , 2011, ArXiv.

[20]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[21]  Ion Necoara,et al.  Parallel and distributed optimization methods for estimation and control in networks , 2011, 1302.3103.

[22]  Jairo Espinosa,et al.  A comparative analysis of distributed MPC techniques applied to the HD-MPC four-tank benchmark , 2011 .

[23]  Yurii Nesterov,et al.  Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems , 2012, SIAM J. Optim..

[24]  Marcello Farina,et al.  Distributed predictive control: A non-cooperative algorithm with neighbor-to-neighbor communication for linear systems , 2012, Autom..

[25]  Panagiotis D. Christofides,et al.  Distributed model predictive control: A tutorial review and future research directions , 2013, Comput. Chem. Eng..

[26]  Ion Necoara,et al.  Efficient parallel coordinate descent algorithm for convex optimization problems with separable constraints: Application to distributed MPC , 2013, 1302.3092.

[27]  Alberto Bemporad,et al.  An Accelerated Dual Gradient-Projection Algorithm for Embedded Linear Model Predictive Control , 2014, IEEE Transactions on Automatic Control.

[28]  Yurii Nesterov,et al.  First-order methods of smooth convex optimization with inexact oracle , 2013, Mathematical Programming.