Exact Complexity Certification of Active-Set Methods for Quadratic Programming

Active-set methods are recognized to often outperform other methods in terms of speed and solution accuracy when solving small-size quadratic programming (QP) problems, making them very attractive in embedded linear model predictive control (MPC) applications. A drawback of active-set methods is the lack of tight bounds on the worst-case number of iterations, a fundamental requirement for their implementation in a real-time system. Extensive simulation campaigns provide an indication of the expected worst-case computation load, but not a complete guarantee. This paper solves such a certification problem by proposing an algorithm to compute the exact bound on the maximum number of iterations and floating point operations required by a state-of-the-art dual active-set QP solver. The algorithm is applicable to a given QP problem whose linear term of the cost function and right-hand side of the constraints depend linearly on a vector of parameters, as in the case of linear MPC. In addition, a new solver is presented that combines explicit and implicit MPC ideas, guaranteeing improvements of the worst-case computation time. The ability of the approach to exactly quantify memory and worst-case computation requirements is tested on a few MPC examples, also highlighting when online optimization should be preferred to explicit MPC.

[1]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[2]  Michael J. Best,et al.  Active set algorithms for isotonic regression; A unifying framework , 1990, Math. Program..

[3]  Anders Forsgren,et al.  Primal and dual active-set methods for convex quadratic programming , 2015, Mathematical Programming.

[4]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[5]  Alberto Bemporad,et al.  Model Predictive Idle Speed Control: Design, Analysis, and Experimental Evaluation , 2012, IEEE Transactions on Control Systems Technology.

[6]  Manfred Morari,et al.  Real-time suboptimal model predictive control using a combination of explicit MPC and online optimization , 2008, 2008 47th IEEE Conference on Decision and Control.

[7]  H. J. Ferreau,et al.  An online active set strategy to overcome the limitations of explicit MPC , 2008 .

[8]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[9]  Luigi del Re,et al.  Predictive control of a real-world Diesel engine using an extended online active set strategy , 2007, Annu. Rev. Control..

[10]  Sven Leyffer,et al.  Numerical Experience with Lower Bounds for MIQP Branch-And-Bound , 1998, SIAM J. Optim..

[11]  Martin Mönnigmann,et al.  Accelerating model predictive control by online constraint removal , 2013, 52nd IEEE Conference on Decision and Control.

[12]  A. Bemporad,et al.  Efficient on-line computation of constrained optimal control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[13]  E. Davison,et al.  A Fast MPC Algorithm Using Nonfeasible Active Set Methods , 2008 .

[14]  C. E. Lemke,et al.  A Method of Solution for Quadratic Programs , 1962 .

[15]  Donald Goldfarb,et al.  A numerically stable dual method for solving strictly convex quadratic programs , 1983, Math. Program..

[16]  Ion Necoara Computational complexity certification for dual gradient method: Application to embedded MPC , 2015, Syst. Control. Lett..

[17]  Stephen P. Boyd,et al.  Fast Model Predictive Control Using Online Optimization , 2010, IEEE Transactions on Control Systems Technology.

[18]  Stephen J. Wright,et al.  Fast, large-scale model predictive control by partial enumeration , 2007, Autom..

[19]  T. Gál,et al.  Multiparametric Linear Programming , 1972 .

[20]  Alberto Bemporad,et al.  Vehicle Yaw Stability Control by Coordinated Active Front Steering and Differential Braking in the Tire Sideslip Angles Domain , 2013, IEEE Transactions on Control Systems Technology.

[21]  Martin Mönnigmann,et al.  Online constraint removal: Accelerating MPC with a Lyapunov function , 2015, Autom..

[22]  Alberto Bemporad,et al.  Online model predictive torque control for Permanent Magnet Synchronous Motors , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[23]  Manfred Morari,et al.  Computational Complexity Certification for Real-Time MPC With Input Constraints Based on the Fast Gradient Method , 2012, IEEE Transactions on Automatic Control.

[24]  K. Borgwardt A probabilistic analysis of the simplex method , 1986 .

[25]  L. Biegler,et al.  QPSchur: A dual, active-set, Schur-complement method for large-scale and structured convex quadratic programming , 2006 .

[26]  Alberto Bemporad,et al.  Fulfilling Hard Constraints in Uncertain Linear Systems by Reference Managing , 1998, Autom..

[27]  Stephen P. Boyd,et al.  Metric selection in fast dual forward-backward splitting , 2015, Autom..

[28]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[29]  John Fearnley,et al.  The Complexity of the Simplex Method , 2015, STOC.

[30]  E. Mosca,et al.  Nonlinear control of constrained linear systems via predictive reference management , 1997, IEEE Trans. Autom. Control..

[31]  Donald Goldfarb,et al.  On the Complexity of the Simplex Method , 1994 .

[32]  Edward N. Hartley,et al.  Field programmable gate array based predictive control system for spacecraft rendezvous in elliptical orbits , 2015 .

[33]  Mato Baotić,et al.  Optimal control of piecewise affine systems - a multi-parametric approach , 2005 .

[34]  Alberto Bemporad,et al.  A survey on explicit model predictive control , 2009 .

[35]  Alberto Bemporad,et al.  A Multiparametric Quadratic Programming Algorithm With Polyhedral Computations Based on Nonnegative Least Squares , 2015, IEEE Transactions on Automatic Control.

[36]  Nicholas I. M. Gould,et al.  A weighted gram-schmidt method for convex quadratic programming , 1984, Math. Program..

[37]  Alberto Bemporad,et al.  An Accelerated Dual Gradient-Projection Algorithm for Embedded Linear Model Predictive Control , 2014, IEEE Transactions on Automatic Control.

[38]  Alberto Bemporad,et al.  A Quadratic Programming Algorithm Based on Nonnegative Least Squares With Applications to Embedded Model Predictive Control , 2016, IEEE Transactions on Automatic Control.

[39]  Leopoldo G. Franquelo,et al.  Model Predictive Control: A Review of Its Applications in Power Electronics , 2014, IEEE Industrial Electronics Magazine.

[40]  Stephen J. Wright,et al.  Application of Interior-Point Methods to Model Predictive Control , 1998 .