Learning in-contact control strategies from demonstration

Learning to perform tasks like pulling a door handle or pushing a button, inherently easy for a human, can be surprisingly difficult for a robot. A crucial problem in these kinds of in-contact tasks is the context specificity of pose and force requirements. In this paper, a robot learns in-contact tasks from human kinesthetic demonstrations. To address the need to balance between the position and force constraints, we propose a model based on the hidden semi-Markov model (HSMM) and Cartesian impedance control. The model captures uncertainty over time and space and allows the robot to smoothly satisfy a task's position and force constraints by online modulation of impedance controller stiffness according to the HSMM state belief. In experiments, a KUKA LWR 4+ robotic arm equipped with a force/torque sensor at the wrist successfully learns from human demonstrations how to pull a door handle and push a button.

[1]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[2]  Aude Billard,et al.  Imitation learning of globally stable non-linear point-to-point robot motions using nonlinear programming , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[4]  Carme Torras,et al.  Learning Collaborative Impedance-Based Robot Behaviors , 2013, AAAI.

[5]  Alberto Montebelli,et al.  Simultaneous kinesthetic teaching of positional and force requirements for sequential in-contact tasks , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[6]  H. Sung.  Gaussian Mixture Regression and Classification , 2004 .

[7]  VelosoManuela,et al.  A survey of robot learning from demonstration , 2009 .

[8]  Sergey Levine,et al.  Learning force-based manipulation of deformable objects from multiple demonstrations , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[10]  Jan F. Broenink,et al.  on Innovative Robot Control Architectures for Demanding ( Research ) Applications – How to Modify and Enhance Commercial Controllers – , 2010 .

[11]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[12]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[13]  Alberto Montebelli,et al.  On handing down our tools to robots: Single-phase kinesthetic teaching for dynamic in-contact tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Jochen J. Steil,et al.  Task-level imitation learning using variance-based movement optimization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  José M. N. Leitão,et al.  On Fitting Mixture Models , 1999, EMMCVPR.

[16]  Stefan Schaal,et al.  Dynamics systems vs. optimal control--a unifying view. , 2007, Progress in brain research.

[17]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[18]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[19]  Jan Peters,et al.  Model-free Probabilistic Movement Primitives for physical interaction , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[21]  Darwin G. Caldwell,et al.  Encoding the time and space constraints of a task in explicit-duration Hidden Markov Model , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[23]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.