Differential Dynamic Programming for Multi-Phase Rigid Contact Dynamics

A common strategy to generate efficient locomotion movements is to split the problem into two consecutive steps: the first one generates the contact sequence together with the centroidal trajectory, while the second step computes the whole-body trajectory that follows the centroidal pattern. While the second step is generally handled by a simple program such as an inverse kinematics solver, we propose in this paper to compute the whole-body trajectory by using a local optimal control solver, namely Differential Dynamic Programming (DDP). Our method produces more efficient motions, with lower forces and smaller impacts, by exploiting the Angular Momentum (AM). With this aim, we propose an original DDP formulation exploiting the Karush- Kuhn-Tucker constraint of the rigid contact model. We experimentally show the importance of this approach by executing large steps walking on the real HRP-2 robot, and by solving the problem of attitude control under the absence of external contact forces.

[1]  R. Kalaba,et al.  A new perspective on constrained motion , 1992, Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences.

[2]  Olivier Stasse,et al.  Multi-contact Locomotion of Legged Robots in Complex Environments – The Loco3D project , 2017 .

[3]  Yuval Tassa,et al.  Control-limited differential dynamic programming , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Kourosh Naderi,et al.  Sampled differential dynamic programming , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  François Keith,et al.  Dynamic Whole-Body Motion Generation Under Rigid Contacts and Other Unilateral Constraints , 2013, IEEE Transactions on Robotics.

[6]  David Q. Mayne,et al.  Differential Dynamic Programming–A Unified Approach to the Optimization of Dynamic Systems , 1973 .

[7]  Pierre-Brice Wieber,et al.  Holonomy and Nonholonomy in the Dynamics of Articulated Motion , 2006 .

[8]  Olivier Stasse,et al.  A versatile and efficient pattern generator for generalized legged locomotion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Eiichi Yoshida,et al.  Generation of whole-body optimal dynamic multi-contact motions , 2013, Int. J. Robotics Res..

[10]  Eiichi Yoshida,et al.  Multi-contact vertical ladder climbing with an HRP-2 humanoid , 2016, Auton. Robots.

[11]  Shuuji Kajita,et al.  OpenHRP: Open Architecture Humanoid Robotics Platform , 2004, Int. J. Robotics Res..

[12]  Michel Taïx,et al.  CROC: Convex Resolution of Centroidal Dynamics Trajectories to Provide a Feasibility Criterion for the Multi Contact Planning Problem , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Darwin G. Caldwell,et al.  Trajectory and foothold optimization using low-dimensional models for rough terrain locomotion , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Nicolas Mansard,et al.  Analytical Derivatives of Rigid Body Dynamics Algorithms , 2018, Robotics: Science and Systems.

[15]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[16]  Darwin G. Caldwell,et al.  Motion Planning for Quadrupedal Locomotion: Coupled Planning, Terrain Mapping, and Whole-Body Control , 2020, IEEE Transactions on Robotics.

[17]  Darwin G. Caldwell,et al.  Planning and execution of dynamic whole-body locomotion for a hydraulic quadruped on challenging terrain , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Alexander Herzog,et al.  Momentum control with hierarchical inverse dynamics on a torque-controlled humanoid , 2014, Autonomous Robots.

[19]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Marc Toussaint A Tutorial on Newton Methods for Constrained Trajectory Optimization and Relations to SLAM, Gaussian Process Smoothing, Optimal Control, and Probabilistic Inference , 2017, Geometric and Numerical Foundations of Movements.

[21]  Marco Hutter,et al.  Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector Parameterization , 2018, IEEE Robotics and Automation Letters.

[22]  K. Mombaur,et al.  Modeling and Optimal Control of Human-Like Running , 2010, IEEE/ASME Transactions on Mechatronics.

[23]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Alexander Herzog,et al.  Trajectory generation for multi-contact momentum control , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[25]  Nicolas Mansard,et al.  Learning Feasibility Constraints for Multicontact Locomotion of Legged Robots , 2017, Robotics: Science and Systems.

[26]  R. W. Brockett,et al.  Asymptotic stability and feedback stabilization , 1982 .

[27]  Carlos Mastalli,et al.  Simultaneous Contact, Gait, and Motion Planning for Robust Multilegged Locomotion via Mixed-Integer Convex Optimization , 2017, IEEE Robotics and Automation Letters.

[28]  Chonhyon Park,et al.  An Efficient Acyclic Contact Planner for Multiped Robots , 2018, IEEE Transactions on Robotics.

[29]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  David E. Orin,et al.  Centroidal dynamics of a humanoid robot , 2013, Auton. Robots.

[31]  Marco Hutter,et al.  Whole-Body Nonlinear Model Predictive Control Through Contacts for Quadrupeds , 2017, IEEE Robotics and Automation Letters.

[32]  N. Mansard Multi-contact Locomotion of Legged Robots Justin Carpentier , 2018 .