The Time-Freezing Reformulation for Numerical Optimal Control of Complementarity Lagrangian Systems with State Jumps

This paper introduces a novel reformulation and numerical methods for optimal control of complementarity Lagrangian systems with state jumps. The solutions of the reformulated system have jump discontinuities in the first time derivative instead of the trajectory itself, which is easier to handle theoretically and numerically. We cover not only the easier case of elastic impacts, but also the difficult case, when after the state jump the system evolves on the boundary of the dynamic’s feasible set. In nonsmooth mechanics this corresponds to inelastic impacts. The main idea of the time-freezing reformulation is to introduce a clock state and an auxiliary dynamic system whose trajectory endpoints satisfy the state jump law. When the auxiliary system is active, the clock state is not evolving, hence by taking only the parts of the trajectory when the clock state was active, we can recover the original solution. We detail how to recover the solution of the original system, show how to select appropriate auxiliary dynamics and give practical numerical methods to handle discontinuous ODEs with nonunique sliding motions. Moreover, we introduce a novel auxiliary ODE for time-freezing for elastic impacts and overcome some drawbacks of [22]. The theoretical findings are illustrated on the nontrivial numerical optimal control example of a hopping one-legged robot.

[1]  Vincent Acary,et al.  Numerical simulation of piecewise-linear models of gene regulatory networks using complementarity systems , 2012 .

[2]  Stephen J. Wright,et al.  Elastic-mode algorithms for mathematical programs with equilibrium constraints: global convergence and stationarity properties , 2007, Math. Program..

[3]  Moritz Diehl,et al.  Limits of MPCC Formulations in Direct Optimal Control with Nonsmooth Differential Equations , 2020, 2020 European Control Conference (ECC).

[4]  Stephen J. Wright,et al.  Some properties of regularization and penalization schemes for MPECs , 2004, Optim. Methods Softw..

[5]  Arcady Ponosov,et al.  Filippov solutions in the analysis of piecewise linear models describing gene regulatory networks , 2011 .

[6]  Moritz Diehl,et al.  A Time-Freezing Approach for Numerical Optimal Control of Nonsmooth Differential Equations With State Jumps , 2021, IEEE Control Systems Letters.

[7]  Jorge Nocedal,et al.  A line search exact penalty method using steering rules , 2010, Mathematical Programming.

[8]  K. Mombaur,et al.  Modeling and Optimal Control of Human-Like Running , 2010, IEEE/ASME Transactions on Mechatronics.

[9]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[10]  Christian Gehring,et al.  Operational Space Control of Single Legged Hopping , 2011 .

[11]  Marco Hutter,et al.  Trajectory Optimization With Implicit Hard Contacts , 2018, IEEE Robotics and Automation Letters.

[12]  B. T. Baumrucker,et al.  MPEC strategies for optimization of a class of hybrid dynamic systems , 2009 .

[13]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[14]  Luca Dieci,et al.  Sliding motion on discontinuity surfaces of high co-dimension. A construction for selecting a Filippov vector field , 2011, Numerische Mathematik.

[15]  B. Brogliato,et al.  Numerical Methods for Nonsmooth Dynamical Systems: Applications in Mechanics and Electronics , 2008 .

[16]  D. Stewart Dynamics with Inequalities: Impacts and Hard Constraints , 2011 .

[17]  P. Panagiotopoulos,et al.  Nonsmooth Mechanics I , 1996 .

[18]  Vincent Acary,et al.  Implicit Euler numerical scheme and chattering-free implementation of sliding mode systems , 2010, Syst. Control. Lett..

[19]  D. Stewart A high accuracy method for solving ODEs with discontinuous right-hand side , 1990 .

[20]  Bernard Brogliato,et al.  Dynamical Systems Coupled with Monotone Set-Valued Operators: Formalisms, Applications, Well-Posedness, and Stability , 2020, SIAM Rev..

[21]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[22]  Mihai Anitescu,et al.  Optimal control of systems with discontinuous differential equations , 2010, Numerische Mathematik.

[23]  Moritz Diehl,et al.  The Lifted Newton Method and Its Application in Optimization , 2009, SIAM J. Optim..

[24]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Moritz Diehl,et al.  A Sequential Convex Programming Approach to Solving Quadratic Programs and Optimal Control Problems With Linear Complementarity Constraints , 2021, IEEE Control Systems Letters.

[26]  Katja D. Mombaur,et al.  Using optimization to create self-stable human-like running , 2009, Robotica.

[27]  Hyungbo Shim,et al.  State estimation strategy without jump detection for hybrid systems using gluing function , 2014, 53rd IEEE Conference on Decision and Control.

[28]  David E. Stewart,et al.  Rigid-Body Dynamics with Friction and Impact , 2000, SIAM Rev..

[29]  Hendrik Kolvenbach,et al.  Cable-Driven Actuation for Highly Dynamic Robotic Systems , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Jorge Nocedal,et al.  Interior Methods for Mathematical Programs with Complementarity Constraints , 2006, SIAM J. Optim..