Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

Learning from Demonstration (LfD) provides an intuitive and fast approach to program robotic manipulators. Task parameterized representations allow easy adaptation to new scenes and online observations. However, this approach has been limited to pose-only demonstrations and thus only skills with spatial and temporal features. In this work, we extend the LfD framework to address forceful manipulation skills, which are of great importance for industrial processes such as assembly. For such skills, multi-modal demonstrations including robot end-effector poses, force and torque readings, and operation scene are essential. Our objective is to reproduce such skills reliably according to the demonstrated pose and force profiles within different scenes. The proposed method combines our previous work on task-parameterized optimization and attractor-based impedance control. The learned skill model consists of (i) the attractor model that unifies the pose and force features, and (ii) the stiffness model that optimizes the stiffness for different stages of the skill. Furthermore, an online execution algorithm is proposed to adapt the skill execution to real-time observations of robot poses, measured forces, and changed scenes. We validate this method rigorously on a 7-DoF robot arm over several steps of an E-bike motor assembly process, which require different types of forceful interaction such as insertion, sliding and twisting.

[1]  Meng Guo,et al.  Learning and Sequencing of Object-Centric Manipulation Skills for Industrial Tasks , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Tucker Hermans,et al.  Learning Task Constraints from Demonstration for Hybrid Force/Position Control , 2018, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[3]  Matteo Saveriano,et al.  Variable Impedance Control and Learning—A Review , 2020, Frontiers in Robotics and AI.

[4]  Meng Guo,et al.  Optimizing Sequences of Probabilistic Manipulation Skills Learned from Demonstration , 2019, CoRL.

[5]  Jochen J. Steil,et al.  Learning movement primitives for force interaction tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[7]  Carme Torras,et al.  Learning Physical Collaborative Robot Behaviors From Human Demonstrations , 2016, IEEE Transactions on Robotics.

[8]  Pieter Abbeel,et al.  An Algorithmic Perspective on Imitation Learning , 2018, Found. Trends Robotics.

[9]  Sami Haddadin,et al.  A Framework for Robot Manipulation: Skill Formalism, Meta Learning and Adaptive Control , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[10]  Shunzheng Yu,et al.  A hidden semi-Markov model with missing data and multiple observation sequences for mobility tracking , 2003, Signal Process..

[11]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[12]  Jitendra Malik,et al.  Zero-Shot Visual Imitation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Silvio Savarese,et al.  Neural Task Graphs: Generalizing to Unseen Tasks From a Single Video Demonstration , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[15]  Scott Niekum,et al.  Learning grounded finite-state representations from unstructured demonstrations , 2015, Int. J. Robotics Res..

[16]  Danica Kragic,et al.  Data-Efficient Model Learning and Prediction for Contact-Rich Manipulation Tasks , 2020, IEEE Robotics and Automation Letters.

[17]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[18]  Darwin G. Caldwell,et al.  Force-based variable impedance learning for robotic manipulation , 2018, Robotics Auton. Syst..

[19]  Sonia Chernova,et al.  Recent Advances in Robot Learning from Demonstration , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[20]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[21]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2015, Intelligent Service Robotics.

[22]  Robert Bogue,et al.  Europe continues to lead the way in the collaborative robot business , 2016, Ind. Robot.

[23]  Ludovic Righetti,et al.  Learning Variable Impedance Control for Contact Sensitive Tasks , 2019, IEEE Robotics and Automation Letters.