Force-Based Learning of Variable Impedance Skills for Robotic Manipulation

Numerous robotics tasks involve complex physical interactions with the environment, where the role of variable impedance skills and the information of contact forces are crucial for successful performance. The dynamicity of our environments demands robots to adapt their manipulation skills to a large variety of situations, where learning capabilities are necessary. In this context, we propose a framework to teach a robot to perform manipulation tasks by integrating force sensing and variable impedance control. This framework endows robots with force-based variable stiffness skills that become relevant when vision information is unavailable or uninformative. Such skills are built on stiffness estimations that are computed from human demonstrations, which are then used along with sensed forces, to encode a probabilistic model of the robot skill. The resulting model is later used to retrieve time-varying stiffness profiles. We study two different stiffness representations based on (i) Cholesky decomposition, and (ii) Riemannian manifolds. For validation, we use a simulation of a 2D mass-spring-damper system subject to external forces, and a real experiment where a 7- DoF robot learns to perform a valve-turning task by varying its Cartesian stiffness.

[1]  Carme Torras,et al.  Learning Physical Collaborative Robot Behaviors From Human Demonstrations , 2016, IEEE Transactions on Robotics.

[2]  Aude Billard,et al.  Learning motions from demonstrations and rewards with time-invariant dynamical systems based policies , 2018, Auton. Robots.

[3]  Darwin G. Caldwell,et al.  Learning manipulability ellipsoids for task compatibility in robot manipulation , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[5]  Stefan Schaal,et al.  Learning variable impedance control , 2011, Int. J. Robotics Res..

[6]  Darwin G. Caldwell,et al.  Learning-based control strategy for safe human-robot interaction exploiting task and robot redundancies , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Hongtu Zhu,et al.  Intrinsic Regression Models for Positive-Definite Matrices With Applications to Diffusion Tensor Imaging , 2009, Journal of the American Statistical Association.

[8]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[9]  Tadej Petric,et al.  Robotic assembly solution by human-in-the-loop teaching method based on real-time stiffness modulation , 2018, Auton. Robots.

[10]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[11]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[12]  Aude Billard,et al.  Learning from Humans , 2016, Springer Handbook of Robotics, 2nd Ed..

[13]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[14]  Carme Torras,et al.  Learning Collaborative Impedance-Based Robot Behaviors , 2013, AAAI.

[15]  Hongdong Li,et al.  Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernels , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jimmy A. Jørgensen,et al.  Adaptation of manipulation skills in physical contact with the environment to reference force profiles , 2015, Auton. Robots.

[17]  N. Higham.  COMPUTING A NEAREST SYMMETRIC POSITIVE SEMIDEFINITE MATRIX , 1988 .

[18]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[19]  Aude Billard,et al.  Learning Compliant Manipulation through Kinesthetic and Tactile Human-Robot Interaction , 2014, IEEE Transactions on Haptics.

[20]  Neville Hogan,et al.  Impedance control - An approach to manipulation. I - Theory. II - Implementation. III - Applications , 1985 .

[21]  Toru Tsumugiwa,et al.  Variable impedance control based on estimation of human arm stiffness for human-robot cooperative calligraphic task , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Sylvain Calinon,et al.  Gaussian mixture regression on symmetric positive definite matrices manifolds: Application to wrist motion estimation with sEMG , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Aude Billard,et al.  Learning object-level impedance control for robust grasping and dexterous manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[25]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).