A Dynamical System Approach for Adaptive Grasping, Navigation and Co-Manipulation with Humanoid Robots

In this paper, we present an integrated approach that provides compliant control of an iCub humanoid robot and adaptive reaching, grasping, navigating and co-manipulating capabilities. We use state-dependent dynamical systems (DS) to (i) coordinate and drive the robots hands (in both position and orientation) to grasp an object using an intermediate virtual object, and (ii) drive the robot's base while walking/navigating. The use of DS as motion generators allows us to adapt smoothly as the object moves and to re-plan on-line motion of the arms and body to reach the object's new location. The desired motion generated by the DS are used in combination with a whole-body compliant control strategy that absorbs perturbations while walking and offers compliant behaviors for grasping and manipulation tasks. Further, the desired dynamics for the arm and body can be learned from demonstrations. By integrating these components, we achieve unprecedented adaptive behaviors for whole body manipulation. We showcase this in simulations and real-world experiments where iCub robots (i) walk-to-grasp objects, (ii) follow a human (or another iCub) through interaction and (iii) learn to navigate or comanipulate an object from human guided demonstrations; whilst being robust to changing targets and perturbations.

[1]  Jerry Pratt,et al.  Design of a bipedal walking robot , 2008, SPIE Defense + Commercial Sensing.

[2]  Auke Jan Ijspeert,et al.  3LP: A linear 3D-walking model including torso and swing dynamics , 2016, Int. J. Robotics Res..

[3]  Figueroa Fernandez,et al.  From High-Level to Low-Level Robot Learning of Complex Tasks: Leveraging Priors, Metrics and Dynamical Systems , 2019 .

[4]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[6]  Aghil Yousefi-Koma,et al.  Push recovery of a humanoid robot based on model predictive control and capture point , 2016, 2016 4th International Conference on Robotics and Mechatronics (ICROM).

[7]  Dinesh Manocha,et al.  FCL: A general purpose library for collision and proximity queries , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Auke Jan Ijspeert,et al.  Imprecise dynamic walking with time-projection control , 2018, ArXiv.

[9]  Abderrahmane Kheddar,et al.  Quadratic Programming for Multirobot and Task-Space Force Control , 2019, IEEE Transactions on Robotics.

[10]  Aude Billard,et al.  Passive Interaction Control With Dynamical Systems , 2016, IEEE Robotics and Automation Letters.

[11]  Ashwin P. Dani,et al.  Learning Partially Contracting Dynamical Systems from Demonstrations , 2017, CoRL.

[12]  Aude Billard,et al.  A Physically-Consistent Bayesian Non-Parametric Mixture Model for Dynamical System Learning , 2018, CoRL.

[13]  Olivier Stasse,et al.  A versatile and efficient pattern generator for generalized legged locomotion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Twan Koolen,et al.  Capturability-based analysis and control of legged locomotion, Part 1: Theory and application to three simple gait models , 2011, Int. J. Robotics Res..

[15]  Twan Koolen,et al.  Capturability-based analysis and control of legged locomotion, Part 2: Application to M2V2, a lower-body humanoid , 2012, Int. J. Robotics Res..

[16]  Nikolaos G. Tsagarakis,et al.  Stabilization of bipedal walking based on compliance control , 2016, Auton. Robots.

[17]  Matteo Saveriano,et al.  Merging Position and orientation Motion Primitives , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[18]  S. Shankar Sastry,et al.  Provably safe and robust learning-based model predictive control , 2011, Autom..

[19]  Oussama Khatib,et al.  Compliant Control of Multicontact and Center-of-Mass Behaviors in Humanoid Robots , 2010, IEEE Transactions on Robotics.

[20]  Daniel E. Koditschek,et al.  Exact robot navigation using artificial potential functions , 1992, IEEE Trans. Robotics Autom..

[21]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[22]  Auke Jan Ijspeert,et al.  Singularity-Tolerant Inverse Kinematics for Bipedal Robots: An Efficient Use of Computational Power to Reduce Energy Consumption , 2017, IEEE Robotics and Automation Letters.

[23]  Aude Billard,et al.  A unified framework for coordinated multi-arm motion planning , 2018, Int. J. Robotics Res..

[24]  Aude Billard,et al.  A dynamical system approach to task-adaptation in physical human–robot interaction , 2019, Auton. Robots.

[25]  Caroline Blocher,et al.  Learning stable dynamical systems using contraction theory , 2017, 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[26]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[27]  Nikolaos G. Tsagarakis,et al.  COMpliant huMANoid COMAN: Optimal joint stiffness tuning for modal frequency control , 2013, 2013 IEEE International Conference on Robotics and Automation.

[28]  Aude Billard,et al.  Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty , 2016, Robotics: Science and Systems.

[29]  Takahiro Kagawa,et al.  Whole-Body Motion Planning for Humanoid Robots by Specifying Via-Points , 2013 .

[30]  Nikolaos G. Tsagarakis,et al.  Online regeneration of bipedal walking gait pattern optimizing footstep placement and timing , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Ales Ude,et al.  Filtering in a unit quaternion space for model-based object tracking , 1999, Robotics Auton. Syst..

[32]  Tamim Asfour,et al.  Adaptive motion planning for humanoid robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Jean-Jacques E. Slotine,et al.  Real-time path planning using harmonic potentials in dynamic environments , 1997, Proceedings of International Conference on Robotics and Automation.

[34]  Auke Jan Ijspeert,et al.  Bipedal walking and push recovery with a stepping strategy based on time-projection control , 2019, Int. J. Robotics Res..

[35]  Francesco Nori,et al.  Torque-controlled stepping-strategy push recovery: Design and implementation on the iCub humanoid robot , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).