On handing down our tools to robots: Single-phase kinesthetic teaching for dynamic in-contact tasks

We present a (generalizable) method aimed to simultaneously transfer positional and force requirements encoded in a physical human skill (wood planing) from a human instructor to a robotic arm through kinesthetic teaching. We achieve our goal through a novel use of a common sensory configuration, constituted by a force/torque sensor mounted between the tool and the flange of a robotic arm. The robotic arm is endowed with integrated torque sensors at each joint. The mathematical model used to capture the general dynamic of the interaction between the human user and the wood surface is based on Dynamic Movement Primitives. During reenactment of the task, the system can imitate and generalize the demonstrated spatial requirements, as well as their associated force profiles. Therefore, the robotic arm acquires the capacity to reproduce the dynamic profile for in-contact tasks requiring an articulated coordination in the distribution of forces. For example, the capacity to effectively operate the plane on a wood plank over multiple strokes, according to the demonstration of the human instructor.

[1]  Alberto Montebelli,et al.  Simultaneous kinesthetic teaching of positional and force requirements for sequential in-contact tasks , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[2]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[3]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[4]  Avinash C. Kak,et al.  Automatic learning of assembly tasks using a DataGlove system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[5]  Ville Kyrki,et al.  Usability of force-based controllers in physical human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Stefan Schaal,et al.  Dynamics systems vs. optimal control--a unifying view. , 2007, Progress in brain research.

[7]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[8]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[9]  Jochen J. Steil,et al.  Task-level imitation learning using variance-based movement optimization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Stefan Schaal,et al.  From dynamic movement primitives to associative skill memories , 2013, Robotics Auton. Syst..

[11]  Wolff‐Michael Roth,et al.  Situated Cognition , 2021 .

[12]  Jun Tani,et al.  Dynamic and interactive generation of object handling behaviors by a small humanoid robot using a dynamic neural network model , 2006, Neural Networks.

[13]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[14]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[15]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[16]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[17]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.

[18]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[19]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[21]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .