Contact-Implicit Trajectory Optimization With Learned Deformable Contacts Using Bilevel Optimization

We present a bilevel, contact-implicit trajectory optimization (TO) formulation that searches for robot trajectories with learned soft contact models. On the lower-level, contact forces are solved via a quadratic program (QP) with the maximum dissipation principle (MDP), based on which the dynamics constraints are formulated in the upper-level TO problem that uses direct transcription. Our method uses a contact model for granular media that is learned from physical experiments, but is general to any contact model that is stick-slip, convex, and smooth. We employ a primal interior-point method with a pre-specified duality gap to solve the lower-level problem, which provides robust gradient information to the upper-level problem. We evaluate our method by optimizing locomotion trajectories of a quadruped robot on various granular terrains offline, and show that we can obtain long-horizon walking gaits of high qualities.

[1]  Kris Hauser,et al.  A Data-driven Approach for Fast Simulation of Robot Locomotion on Granular Media , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[2]  Dylan A. Shell,et al.  Modeling Contact Friction and Joint Friction in Dynamic Robotic Simulation Using the Principle of Maximum Dissipation , 2010, WAFR.

[3]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[4]  A. Takanishi,et al.  Biped walking stabilization on soft ground based on gait analysis , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[5]  Stephen P. Boyd,et al.  Differentiable Convex Optimization Layers , 2019, NeurIPS.

[6]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[7]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  K. Mombaur,et al.  Modeling and Optimal Control of Human-Like Running , 2010, IEEE/ASME Transactions on Mechatronics.

[9]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[10]  P. Willems,et al.  Mechanics and energetics of human locomotion on sand. , 1998, The Journal of experimental biology.

[11]  Jonas Buchli,et al.  An efficient optimal planning and control framework for quadrupedal locomotion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[13]  Claudio Semini,et al.  STANCE: Locomotion Adaptation Over Soft Terrain , 2019, IEEE Transactions on Robotics.

[14]  Kalyanmoy Deb,et al.  A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications , 2017, IEEE Transactions on Evolutionary Computation.

[15]  Marco Hutter,et al.  Trajectory Optimization With Implicit Hard Contacts , 2018, IEEE Robotics and Automation Letters.

[16]  Marco Pavone,et al.  Bilevel Optimization for Planning through Contact: A Semidirect Method , 2019, ISRR.

[17]  Iordanis Chatzinikolaidis,et al.  Contact-Implicit Trajectory Optimization Using an Analytically Solvable Contact Model for Locomotion on Variable Ground , 2020, IEEE Robotics and Automation Letters.

[18]  Lorenz T. Biegler,et al.  Contact-Implicit Trajectory Optimization Using Orthogonal Collocation , 2018, IEEE Robotics and Automation Letters.

[19]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[20]  Kris Hauser,et al.  Time-Optimal Trajectory Generation for Dynamic Vehicles: A Bilevel Optimization Approach , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Vasileios Vasilopoulos,et al.  Compliant terrain legged locomotion using a viscoplastic approach , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Scott Kuindersma,et al.  Optimization and stabilization of trajectories for constrained dynamical systems , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[24]  Anthony V. Fiacco,et al.  Introduction to Sensitivity and Stability Analysis in Nonlinear Programming , 2012 .