Whole-body trajectory optimization for non-periodic dynamic motions on quadrupedal systems

Autonomous legged robots will be required to handle a wide range of tasks in complex environments. While a lot of research has focused on developing their abilities for periodic locomotion tasks, less effort has been invested in devising generalized strategies for dynamic, non-periodic movements. Motion design approaches are frequently enlisted in the form of teleoperation or predefined heuristics in such scenarios. We employ a realistic simulation of the hydraulically actuated HyQ2Max quadrupedal system for investigations on two distinctive tasks: rearing and posture recovery. We present a whole-body optimization methodology for non-periodic tasks on quadrupedal systems. This approach delivers solutions involving multiple contacts without the need for predefined feet placements. The results obtained show the potential of optimization approaches for motion synthesis in the context of complex tasks.

[1]  Darwin G. Caldwell,et al.  Planning and execution of dynamic whole-body locomotion for a hydraulic quadruped on challenging terrain , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Kai Henning Koch,et al.  A novel approach for the generation of complex humanoid walking sequences based on a combination of optimal control and learning of movement primitives , 2016, Robotics Auton. Syst..

[3]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[4]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jonas Buchli,et al.  Trajectory Optimization Through Contacts and Automatic Gait Discovery for Quadrupeds , 2016, IEEE Robotics and Automation Letters.

[6]  Stefan Schaal,et al.  A Generalized Path Integral Control Approach to Reinforcement Learning , 2010, J. Mach. Learn. Res..

[7]  Yuval Tassa,et al.  Infinite-Horizon Model Predictive Control for Periodic Tasks with Contacts , 2011, Robotics: Science and Systems.

[8]  Stefan Schaal,et al.  Learning force control policies for compliant manipulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[10]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  D. Caldwell,et al.  Optimization for non-periodic dynamic motions of legged systems , 2016 .

[13]  Emanuel Todorov,et al.  First-exit model predictive control of fast discontinuous dynamics: Application to ball bouncing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Daniel E. Koditschek,et al.  Model-Based Dynamic Self-Righting Maneuvers for a Hexapedal Robot , 2004, Int. J. Robotics Res..

[15]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[16]  Darwin G. Caldwell,et al.  Design of the Hydraulically Actuated, Torque-Controlled Quadruped Robot HyQ2Max , 2017, IEEE/ASME Transactions on Mechatronics.

[17]  Emanuel Todorov,et al.  Combining the benefits of function approximation and trajectory optimization , 2014, Robotics: Science and Systems.

[18]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[19]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[20]  Chad C. Kessens,et al.  A metric for self-rightability and understanding its relationship to simple morphologies , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Andrew A. Goldenberg,et al.  Design, simulations and optimization of a tracked mobile robot manipulator with hybrid locomotion and manipulation capabilities , 2008, 2008 IEEE International Conference on Robotics and Automation.

[22]  Roland Siegwart,et al.  Practice Makes Perfect: An Optimization-Based Approach to Controlling Agile Motions for a Quadruped Robot , 2016, IEEE Robotics & Automation Magazine.

[23]  Luís Paulo Reis,et al.  Learning to Walk Fast: Optimized Hip Height Movement for Simulated and Real Humanoid Robots , 2015, J. Intell. Robotic Syst..

[24]  Roland Siegwart,et al.  Reinforcement learning of single legged locomotion , 2013, IROS 2013.

[25]  Kristin P. Bennett,et al.  The Interplay of Optimization and Machine Learning Research , 2006, J. Mach. Learn. Res..