Dynamic Optimization with Convergence Guarantees

We present a novel direct transcription method to solve optimization problems subject to nonlinear differential and inequality constraints. In order to provide numerical convergence guarantees, it is sufficient for the functions that define the problem to satisfy boundedness and Lipschitz conditions. Our assumptions are the most general to date; we do not require uniqueness, differentiability or constraint qualifications to hold and we avoid the use of Lagrange multipliers. Our approach differs fundamentally from state-of-the-art methods based on collocation. We follow a least-squares approach to finding approximate solutions to the differential equations. The objective is augmented with the integral of a quadratic penalty on the differential equation residual and a logarithmic barrier for the inequality constraints, as well as a quadratic penalty on the point constraint residual. The resulting unconstrained infinite-dimensional optimization problem is discretized using finite elements, while integrals are replaced by quadrature approximations if they cannot be evaluated analytically. Order of convergence results are derived, even if components of solutions are discontinuous.

[1]  E. Polak,et al.  Consistent Approximations for Optimal Control Problems Based on Runge--Kutta Integration , 1996 .

[2]  John T. Betts,et al.  Practical Methods for Optimal Control and Estimation Using Nonlinear Programming , 2009 .

[3]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[4]  Arpan Seth,et al.  An augmented Lagrangian interior-point approach for large-scale NLP problems on graphics processing units , 2016, Comput. Chem. Eng..

[5]  David Q. Mayne,et al.  Whither Discrete Time Model Predictive Control? , 2015, IEEE Transactions on Automatic Control.

[6]  Anders Forsgren,et al.  Primal-Dual Interior Methods for Nonconvex Nonlinear Programming , 1998, SIAM J. Optim..

[7]  H. Maurer,et al.  Convergence of Approximations to Nonlinear Optimal Control Problems , 2020 .

[8]  E. Hairer,et al.  Solving Ordinary Differential Equations I , 1987 .

[9]  Qi Gong,et al.  Connections between the covector mapping theorem and convergence of pseudospectral methods for optimal control , 2008, Comput. Optim. Appl..

[10]  J. Bramble,et al.  Estimation of Linear Functionals on Sobolev Spaces with Application to Fourier Transforms and Spline Interpolation , 1970 .

[11]  Anil V. Rao,et al.  Practical Methods for Optimal Control Using Nonlinear Programming , 1987 .

[12]  William W. Hager,et al.  Convergence Rate for a Gauss Collocation Method Applied to Unconstrained Optimal Control , 2016, Journal of Optimization Theory and Applications.

[13]  C. Führer,et al.  A collocation formulation of multistep methods for variable step-size extensions , 2002 .

[14]  David Q. Mayne,et al.  On Computing Solutions to the Continuous Time Constrained Linear Quadratic Regulator $ $ , 2010, IEEE Transactions on Automatic Control.

[15]  Philippe G. Ciarlet,et al.  The finite element method for elliptic problems , 2002, Classics in applied mathematics.

[16]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[17]  Lorenz T. Biegler,et al.  Simultaneous dynamic optimization strategies: Recent advances and challenges , 2006, Comput. Chem. Eng..

[18]  Vincent Pateloup,et al.  Study of a primal-dual algorithm for equality constrained minimization , 2011, Comput. Optim. Appl..

[19]  Christof Büskens,et al.  A primal–dual augmented Lagrangian penalty-interior-point filter line search algorithm , 2018, Math. Methods Oper. Res..

[20]  Omar J. Faqir,et al.  ICLOCS2: Solve your optimal control problems with less pain , 2018 .

[21]  A. Fuller Study of an Optimum Non-linear Control System† , 1963 .

[22]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[23]  I. Michael Ross,et al.  A pseudospectral method for the optimal control of constrained feedback linearizable systems , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[24]  Bruce A. Conway,et al.  A Survey of Methods Available for the Numerical Optimization of Continuous Dynamic Systems , 2011, Journal of Optimization Theory and Applications.

[25]  Graham C. Goodwin,et al.  Control of constrained linear systems using fast sampling rates , 2005, Syst. Control. Lett..

[26]  William W. Hager,et al.  Runge-Kutta methods in optimal control and the transformed adjoint system , 2000, Numerische Mathematik.

[27]  Matthew Kelly,et al.  An Introduction to Trajectory Optimization: How to Do Your Own Direct Collocation , 2017, SIAM Rev..

[28]  Anders Forsgren,et al.  Interior Methods for Nonlinear Optimization , 2002, SIAM Rev..

[29]  Lorenz T. Biegler,et al.  Convergence rates for direct transcription of optimal control problems using collocation at Radau points , 2008, Comput. Optim. Appl..

[30]  P. M. Prenter,et al.  Optimal $L^2$ and $L^\infty;$ Error Estimates for Continuous and Discrete Least Squares Methods for Boundary Value Problems , 1978 .

[31]  Anil V. Rao,et al.  ( Preprint ) AAS 09-334 A SURVEY OF NUMERICAL METHODS FOR OPTIMAL CONTROL , 2009 .

[32]  I. Michael Ross,et al.  On the convergence of nonlinear optimal control using pseudospectral methods for feedback linearizable systems , 2007 .

[33]  W. Chan,et al.  Application of a modified quasilinearization technique to totally singular optimal control problems , 1973 .

[34]  J. Frédéric Bonnans,et al.  A Shooting Algorithm for Optimal Control Problems with Singular Arcs , 2012, J. Optim. Theory Appl..

[35]  Anil V. Rao,et al.  GPOPS-II , 2014, ACM Trans. Math. Softw..

[36]  Zhonghai Ding,et al.  A proof of the trace theorem of Sobolev spaces on Lipschitz domains , 1996 .

[37]  Uri M. Ascher,et al.  DISCRETE LEAST SQUARES APPROXIMATIONS FOR ORDINARY DIFFERENTIAL EQUATIONS , 1978 .

[38]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[39]  Martin P. Neuenhofen High-order convergent Finite-Elements Direct Transcription Method for Constrained Optimal Control Problems , 2017, 1712.07761.