Limits of MPCC Formulations in Direct Optimal Control with Nonsmooth Differential Equations

In this work we discuss the limits of direct methods for Optimal Control Problems (OCPs) for some classes of nonsmooth dynamic systems. We highlight the equivalence between Filippov systems and a subclass of Differential Complementarity Systems (DCSs). Direct methods for optimal control with DCSs yield Mathematical Programs with Complementarity Constraints (MPCC), which are often solved with relaxation or smoothing methods. Due to the equivalence, results from the first class transfer to the DCSs. Therefore, to get the right numerical sensitivities one has to have a step-size of h = o(σ), where σ is the relaxation or smoothing parameter in the MPCC. A possible consequence of wrong numerical sensitivities is the appearance of spurious local solutions of the discretized OCP. We demonstrate and highlight the limits of MPCC approaches in direct optimal control on a simple counterexample.

[1]  Tyler Westenbroek,et al.  Technichal Report: Optimal Control of Piecewise-Smooth Control Systems via Singular Perturbations , 2019 .

[2]  Paul I. Barton,et al.  Hidden Discontinuities and Parametric Sensitivity Calculations , 2001, SIAM J. Sci. Comput..

[3]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[4]  B. T. Baumrucker,et al.  MPEC strategies for optimization of a class of hybrid dynamic systems , 2009 .

[5]  Christian Kanzow,et al.  Theoretical and numerical comparison of relaxation methods for mathematical programs with complementarity constraints , 2011, Mathematical Programming.

[6]  M. Florian,et al.  THE NONLINEAR BILEVEL PROGRAMMING PROBLEM: FORMULATIONS, REGULARITY AND OPTIMALITY CONDITIONS , 1993 .

[7]  Stephen J. Wright,et al.  Some properties of regularization and penalization schemes for MPECs , 2004, Optim. Methods Softw..

[8]  Ulrich Brandt-Pollmann,et al.  Numerical solution of optimal control problems with implicitly defined discontinuities with applications in engineering , 2004 .

[9]  B. Brogliato,et al.  Numerical Methods for Nonsmooth Dynamical Systems: Applications in Mechanics and Electronics , 2008 .

[10]  Pu Li,et al.  Smoothing and regularization strategies for optimization of hybrid dynamic systems , 2014, Optimization and Engineering.

[11]  Christian Kirches,et al.  Numerical solution of optimal control problems with explicit and implicit switches , 2018, Optim. Methods Softw..

[12]  D. Stewart.  Dynamics with Inequalities: Impacts and Hard Constraints , 2011 .

[13]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[14]  Stefan Scholtes,et al.  Convergence Properties of a Regularization Scheme for Mathematical Programs with Complementarity Constraints , 2000, SIAM J. Optim..

[15]  Lorenz T. Biegler,et al.  Contact-Implicit Trajectory Optimization Using Orthogonal Collocation , 2018, IEEE Robotics and Automation Letters.

[16]  H. Bock,et al.  A Multiple Shooting Algorithm for Direct Solution of Optimal Control Problems , 1984 .

[17]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[18]  Mihai Anitescu,et al.  Optimal control of systems with discontinuous differential equations , 2010, Numerische Mathematik.

[19]  Jong-Shi Pang,et al.  Differential variational inequalities , 2008, Math. Program..

[20]  W. Marquardt,et al.  Mixed‐logic dynamic optimization applied to batch distillation process design , 2003 .

[21]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[22]  Marco Hutter,et al.  Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector Parameterization , 2018, IEEE Robotics and Automation Letters.

[23]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[25]  Vincent Acary,et al.  On the equivalence between complementarity systems, projected systems and differential inclusions , 2006, Syst. Control. Lett..

[26]  Vincent Acary,et al.  Nonsmooth Modeling and Simulation for Switched Circuits , 2010, Lecture Notes in Electrical Engineering.

[27]  Lorenz T. Biegler,et al.  MPEC problem formulations and solution strategies with chemical engineering applications , 2008, Comput. Chem. Eng..

[28]  Christian Kirches,et al.  Numerical Solution of Optimal Control Problems with Switches, Switching Costs and Jumps , 2019 .