On the Stability of Nonlinear Receding Horizon Control: A Geometric Perspective

The widespread adoption of nonlinear Receding Horizon Control (RHC) strategies by industry has led to more than 30 years of intense research efforts to provide stability guarantees for these methods. However, current theoretical guarantees require that each (generally nonconvex) planning problem can be solved to (approximate) global optimality, which is an unrealistic requirement for the derivative-based local optimization methods generally used in practical implementations of RHC. This paper takes the first step towards understanding stability guarantees for nonlinear RHC when the inner planning problem is solved to first-order stationary points, but not necessarily global optima. Special attention is given to feedback linearizable systems, and a mixture of positive and negative results are provided. We establish that, under certain strong conditions, first-order solutions to RHC exponentially stabilize linearizable systems. Crucially, this guarantee requires that state costs applied to the planning problems are in a certain sense ‘compatible’ with the global geometry of the system, and a simple counterexample demonstrates the necessity of this condition. These results highlight the need to rethink the role of global geometry in the context of optimization-based control.

[1]  Hans Bock,et al.  Efficient direct multiple shooting in nonlinear model predictive control , 1999 .

[2]  Sham M. Kakade,et al.  Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulator , 2018, ICML.

[3]  Barnabás Póczos,et al.  Gradient Descent Provably Optimizes Over-parameterized Neural Networks , 2018, ICLR.

[4]  Hongyang Zhang,et al.  Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations , 2017, COLT.

[5]  Eduardo Sontag A universal construction of Artstein's theorem on nonlinear stabilization , 1989 .

[6]  Mrdjan J. Jankovic,et al.  Constructive Nonlinear Control , 2011 .

[7]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[8]  Tengyu Ma,et al.  Matrix Completion has No Spurious Local Minimum , 2016, NIPS.

[9]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[10]  Furong Huang,et al.  Escaping From Saddle Points - Online Stochastic Gradient for Tensor Decomposition , 2015, COLT.

[11]  Sanjeev Arora,et al.  Simple, Efficient, and Neural Algorithms for Sparse Coding , 2015, COLT.

[12]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[13]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[14]  Tengyu Ma,et al.  Gradient Descent Learns Linear Dynamical Systems , 2016, J. Mach. Learn. Res..

[15]  A. Isidori,et al.  Output regulation of nonlinear systems , 1990 .

[16]  John R. Hauser,et al.  On the stability of unconstrained receding horizon control with a general terminal cost , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[17]  A. Isidori,et al.  Adaptive control of linearizable systems , 1989 .

[18]  Daniel Liberzon,et al.  Calculus of Variations and Optimal Control Theory: A Concise Introduction , 2012 .

[19]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[20]  J. Doyle,et al.  NONLINEAR OPTIMAL CONTROL: A CONTROL LYAPUNOV FUNCTION AND RECEDING HORIZON PERSPECTIVE , 1999 .

[21]  P.V. Kokotovic,et al.  The joy of feedback: nonlinear and adaptive , 1992, IEEE Control Systems.

[22]  Siddhartha S. Srinivasa,et al.  Iterative Linearized Control: Stable Algorithms and Complexity Guarantees , 2019, ICML.

[23]  Michael I. Jordan,et al.  How to Escape Saddle Points Efficiently , 2017, ICML.

[24]  Jie Yu,et al.  Unconstrained receding-horizon control of nonlinear systems , 2001, IEEE Trans. Autom. Control..

[25]  D. Q. Mayne,et al.  Suboptimal model predictive control (feasibility implies stability) , 1999, IEEE Trans. Autom. Control..

[26]  S. Sastry Nonlinear Systems: Analysis, Stability, and Control , 1999 .

[27]  Michael I. Jordan,et al.  Gradient Descent Only Converges to Minimizers , 2016, COLT.

[28]  D. Mayne,et al.  Robust receding horizon control of constrained nonlinear systems , 1993, IEEE Trans. Autom. Control..

[29]  H. Michalska,et al.  Receding horizon control of nonlinear systems , 1988, Proceedings of the 28th IEEE Conference on Decision and Control,.