Dynamic Skill Learning From Human Demonstration Based on the Human Arm Stiffness Estimation Model and Riemannian DMP

Traditional skill transfer frameworks mainly focus on kinematics, while there has been a lack of studies on dynamics. This article develops a Riemannian-based dynamic movement primitive (DMP) framework for learning and generalizing multispace data, including position, orientation, and stiffness from human demonstration. A simplified geometric configuration of the human arm skeleton is adopted to extract its endpoint stiffness. The dynamic skills of a variable stiffness are obtained in real time and then transferred to robots. The effectiveness of the presented approach is verified by two experiments in real scenarios on the Franka Emika Panda robot. The experimental results indicate that both kinematic and dynamic skills can be learned and generalized by the extended DMP framework with high accuracy and strong correlation. The human-like variable impedance control of a robot can be successfully realized by using the proposed approach. Thus, the proposed approach, including the stiffness estimation model and the skill learning and generalization framework, is suitable for applications of human–robot collaboration, contact operation, and teleoperation, where the position, orientation, and stiffness need to be considered simultaneously.

[1]  W. He,et al.  Human-in-the-Loop Control of Soft Exosuits Using Impedance Learning on Different Terrains , 2022, IEEE Transactions on Robotics.

[2]  Zhenyu Lu,et al.  A Constrained DMPs Framework for Robot Skills Learning and Generalization From Human Demonstrations , 2021, IEEE/ASME Transactions on Mechatronics.

[3]  Fares J. Abu-Dakka,et al.  Dynamic movement primitives in robotics: A tutorial survey , 2021, The International Journal of Robotics Research.

[4]  Yuqiang Wu,et al.  An Intuitive Formulation of the Human Arm Active Endpoint Stiffness , 2020, Sensors.

[5]  Sonia Chernova,et al.  Recent Advances in Robot Learning from Demonstration , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[6]  Fares J. Abu-Dakka,et al.  Geometry-aware Dynamic Movement Primitives , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[7]  S. Calinon Gaussians on Riemannian Manifolds: Applications for Robot Learning and Adaptive Control , 2019, IEEE Robotics & Automation Magazine.

[8]  Paolo Fiorini,et al.  DMP++: Overcoming Some Drawbacks of Dynamic Movement Primitives , 2019, Robotics Auton. Syst..

[9]  Sylvain Calinon,et al.  Mixture Models for the Analysis, Edition, and Synthesis of Continuous Time Series , 2019, Unsupervised and Semi-Supervised Learning.

[10]  Zhijun Li,et al.  Adaptive Fuzzy Control for Coordinated Multiple Robots With Constraint Using Impedance Learning , 2019, IEEE Transactions on Cybernetics.

[11]  Andrej Gams,et al.  Human robot cooperation with compliance adaptation along the motion trajectory , 2018, Auton. Robots.

[12]  Sami Haddadin,et al.  Force, Impedance, and Trajectory Learning for Contact Tooling and Haptic Identification , 2018, IEEE Transactions on Robotics.

[13]  Cheng Fang,et al.  A DMPs-Based Framework for Robot Learning and Generalization of Humanlike Variable Impedance Skills , 2018, IEEE/ASME Transactions on Mechatronics.

[14]  Darwin G. Caldwell,et al.  Kernelized movement primitives , 2017, Int. J. Robotics Res..

[15]  Jimmy A. Jørgensen,et al.  Adaptation of manipulation skills in physical contact with the environment to reference force profiles , 2015, Auton. Robots.

[16]  Aude Billard,et al.  Hand Impedance Measurements During Interactive Manual Welding With a Robot , 2015, IEEE Transactions on Robotics.

[17]  David W. Jacobs,et al.  Riemannian Metric Learning for Symmetric Positive Definite Matrices , 2015, ArXiv.

[18]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[20]  S. Schaal,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[21]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Towards transferring human impedance regulation skills to robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[23]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[24]  Alin Albu-Schäffer,et al.  Biomimetic motor behavior for simultaneous adaptation of force, impedance and trajectory in interaction tasks , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  Imin Kao,et al.  Conservative Congruence Transformation for Joint and Cartesian Stiffness Matrices of Robotic Hands and Fingers , 2000, Int. J. Robotics Res..

[26]  S. Schaal,et al.  Robot juggling: implementation of memory-based learning , 1994, IEEE Control Systems.

[27]  Antonio Bicchi,et al.  Reduced-complexity representation of the human arm active endpoint stiffness for supervisory control of remote manipulation , 2018, Int. J. Robotics Res..

[28]  Nikolaos G. Tsagarakis,et al.  Online Model Based Estimation of Complete Joint Stiffness of Human Arm , 2018, IEEE Robotics and Automation Letters.

[29]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2016, Intell. Serv. Robotics.

[30]  Robert F. Kirsch,et al.  Multiple-input, multiple-output system identification for characterization of limb stiffness dynamics , 1999, Biological Cybernetics.