Horizon-independent Preconditioner Design for Linear Predictive Control

First-order optimization solvers, such as the Fast Gradient Method, are increasingly being used to solve Model Predictive Control problems in resource-constrained environments. Unfortunately, the convergence rate of these solvers is significantly affected by the conditioning of the problem data, with ill-conditioned problems requiring a large number of iterations. To reduce the number of iterations required, we present a simple method for computing a horizon-independent preconditioning matrix for the Hessian of the condensed problem. The preconditioner is based on the block Toeplitz structure of the Hessian. Horizon-independence allows one to use only the predicted system and cost matrices to compute the preconditioner, instead of the full Hessian. The proposed preconditioner has equivalent performance to an optimal preconditioner, producing up to a 6x speedup for the Fast Gradient Method in our numerical examples. Additionally, we derive horizon-independent spectral bounds for the Hessian in terms of the transfer function of the predicted system, and show how these can be used to compute a novel horizon-independent bound on the condition number for the preconditioned Hessian.

[1]  Mark Rice,et al.  A numerically robust state-space approach to stable-predictive control strategies , 1998, Autom..

[2]  Pedro M. Crespo,et al.  Block Toeplitz Matrices: Asymptotic Results and Applications , 2012, Found. Trends Commun. Inf. Theory.

[3]  Manfred Morari,et al.  Embedded Online Optimization for Model Predictive Control at Megahertz Rates , 2013, IEEE Transactions on Automatic Control.

[4]  Daniel E. Quevedo,et al.  Predictive control, embedded cyberphysical systems and systems of systems - A perspective , 2016, Annu. Rev. Control..

[5]  R. Mathar,et al.  A cyclic projection algorithm via duality , 1989 .

[6]  Andrew Knyazev,et al.  Preconditioning of conjugate gradient iterations in interior point MPC method , 2018 .

[7]  Rolf Findeisen,et al.  Implementation aspects of model predictive control for embedded systems , 2012, 2012 American Control Conference (ACC).

[8]  Manfred Morari,et al.  The double description method for the approximation of explicit MPC control laws , 2008, 2008 47th IEEE Conference on Decision and Control.

[9]  Stephen P. Boyd,et al.  Preconditioning in fast dual gradient methods , 2014, 53rd IEEE Conference on Decision and Control.

[10]  Alexander Domahidi,et al.  Circuit generation for efficient projection onto polyhedral sets in first-order methods , 2015, 2015 European Control Conference (ECC).

[11]  Stefano Di Cairano,et al.  Block Structured Preconditioning within an Active-Set Method for Real-Time Optimal Control , 2018, 2018 European Control Conference (ECC).

[12]  Alberto Bemporad,et al.  Fixed-Point Implementation of a Proximal Newton Method for Embedded Model Predictive Control , 2014 .

[13]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[14]  G. Strang A proposal for toeplitz matrix calculations , 1986 .

[15]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[16]  Charles R. Johnson,et al.  Matrix Analysis, 2nd Ed , 2012 .

[17]  Manfred Morari,et al.  Computational Complexity Certification for Real-Time MPC With Input Constraints Based on the Fast Gradient Method , 2012, IEEE Transactions on Automatic Control.

[18]  Osvaldo J. Rojas,et al.  On the asymptotic properties of the Hessian in discrete-time linear quadratic control , 2004, Proceedings of the 2004 American Control Conference.

[19]  Daniel B. Szyld,et al.  An introduction to iterative Toeplitz solvers , 2009, Math. Comput..

[20]  Stefan Richter,et al.  Computational complexity certification of gradient methods for real-time model predictive control , 2012 .

[21]  Paolo Tilli,et al.  Asymptotic Spectra of Hermitian Block Toeplitz Matrices and Preconditioning Results , 2000, SIAM J. Matrix Anal. Appl..