A parallel quadratic programming method for dynamic optimization problems

Quadratic programming problems (QPs) that arise from dynamic optimization problems typically exhibit a very particular structure. We address the ubiquitous case where these QPs are strictly convex and propose a dual Newton strategy that exploits the block-bandedness similarly to an interior-point method. Still, the proposed method features warmstarting capabilities of active-set methods. We give details for an efficient implementation, including tailored numerical linear algebra, step size computation, parallelization, and infeasibility handling. We prove convergence of the algorithm for the considered problem class. A numerical study based on the open-source implementation qpDUNES shows that the algorithm outperforms both well-established general purpose QP solvers as well as state-of-the-art tailored control QP solvers significantly on the considered benchmark problems.

[1]  Manfred Morari,et al.  Efficient interior point methods for multistage problems arising in receding horizon control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[2]  L. Biegler Advances in nonlinear programming concepts for process control , 1997 .

[3]  M. Diehl,et al.  A Parallel Active-Set Strategy to Solve Sparse Parametric Quadratic Programs arising in MPC , 2012 .

[4]  Christian Kirches,et al.  qpOASES: a parametric active-set algorithm for quadratic programming , 2014, Mathematical Programming Computation.

[5]  Stephen J. Wright Partitioned Dynamic Programming for Optimal Control , 1991, SIAM J. Optim..

[6]  R. Fletcher Practical Methods of Optimization , 1988 .

[7]  Philip E. Gill,et al.  Practical optimization , 1981 .

[8]  John M. Wilson,et al.  Advances in Sensitivity Analysis and Parametric Programming , 1998, J. Oper. Res. Soc..

[9]  Evanghelos Zafiriou,et al.  Robust Model Predictive Control of Processes with Hard Constraints. , 1990 .

[10]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[11]  John Bagterp Jørgensen,et al.  A fast condensing method for solution of linear-quadratic control problems , 2013, 52nd IEEE Conference on Decision and Control.

[12]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[13]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[14]  Manfred Morari,et al.  Real-time input-constrained MPC using fast gradient methods , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[15]  Johannes P. Schlöder,et al.  A real-time algorithm for moving horizon state and parameter estimation , 2011, Comput. Chem. Eng..

[16]  Alberto Bemporad,et al.  Simple and Certifiable Quadratic Programming Algorithms for Embedded Linear Model Predictive Control , 2012 .

[17]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[18]  Stephen J. Wright,et al.  Application of Interior-Point Methods to Model Predictive Control , 1998 .

[19]  T. Terlaky,et al.  The Optimal Set and Optimal Partition Approach to Linear and Quadratic Programming , 1996 .

[20]  M. Diehl,et al.  Real-time optimization and nonlinear model predictive control of processes governed by differential-algebraic equations , 2000 .

[21]  Jan Swevers,et al.  ENERGY OPTIMAL POINT-TO-POINT MOTION USING MODEL PREDICTIVE CONTROL , 2012 .

[22]  L. Chambers Practical methods of optimization (2nd edn) , by R. Fletcher. Pp. 436. £34.95. 2000. ISBN 0 471 49463 1 (Wiley). , 2001, The Mathematical Gazette.

[23]  M. Best An Algorithm for the Solution of the Parametric Quadratic Programming Problem , 1996 .

[24]  Wu Li,et al.  A New Algorithm for Solving Strictly Convex Quadratic Programs , 1997, SIAM J. Optim..

[25]  Janick V. Frasch,et al.  A new quadratic programming strategy for efficient sparsity exploitation in SQP-based nonlinear MPC and MHE , 2014 .

[26]  M. Diehl,et al.  Fast NMPC of a chain of masses connected by springs , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[27]  Johannes P. Schlöder,et al.  Block-structured quadratic programming for the direct multiple shooting method for optimal control , 2011, Optim. Methods Softw..

[28]  Joel Andersson,et al.  A General-Purpose Software Framework for Dynamic Optimization (Een algemene softwareomgeving voor dynamische optimalisatie) , 2013 .

[29]  Peter Deuflhard,et al.  Numerical Treatment of Inverse Problems in Differential and Integral Equations: Proceedings of an International Workshop, Heidelberg, Fed. Rep. of Germany, August 30 - September 3, 1982 , 2012 .

[30]  Roger Fletcher,et al.  New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds , 2006, Math. Program..

[31]  Moritz Diehl,et al.  An auto-generated real-time iteration algorithm for nonlinear MPC in the microsecond range , 2011, Autom..

[32]  J. Danskin The Theory of Max-Min and its Application to Weapons Allocation Problems , 1967 .

[33]  Stefan Schäffler,et al.  Applied Mathematics and Parallel Computing , 1996 .

[34]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[35]  Anthony V. Fiacco,et al.  Introduction to Sensitivity and Stability Analysis in Nonlinear Programming , 2012 .

[36]  H. J. Ferreau,et al.  An online active set strategy to overcome the limitations of explicit MPC , 2008 .

[37]  Stephen P. Boyd,et al.  Fast Model Predictive Control Using Online Optimization , 2010, IEEE Transactions on Control Systems Technology.

[38]  Stephen P. Boyd,et al.  Automatic code generation for real-time convex optimization , 2010, Convex Optimization in Signal Processing and Communications.

[39]  Matthias Gerdts,et al.  Hamburger Beiträge zur Angewandten Mathematik A nonsmooth Newton ’ s method for discretized optimal control problems with state and control constraints , 2007 .

[40]  H. Bock,et al.  Efficient direct multiple shooting for nonlinear model predictive control on long horizons , 2012 .

[41]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[42]  Manfred Morari,et al.  Auto-generated algorithms for nonlinear model predictive control on long and on short horizons , 2013, 52nd IEEE Conference on Decision and Control.

[43]  Philip E. Gill,et al.  Numerically stable methods for quadratic programming , 1978, Math. Program..