Teaching Assembly by Demonstration Using Advanced Human Robot Interaction and a Knowledge Integration Framework

Conventional industrial robots are heavily dependent on hard automation that requires pre-specified fixtures and time-consuming (re)programming performed by experienced operators. In this work, teaching by human-only demonstration is used for reducing required time and expertise to setup a robotized assembly station. This is achieved by the proposed framework enhancing the robotic system with advanced perception and cognitive abilities, accessed through a user-friendly Human Robot Interaction interface. The approach is evaluated on a small parts’ assembly use case deployed onto a collaborative industrial robot testbed. Experiments indicate that the proposed approach allows inexperienced users to efficiently teach robots new assembly tasks.

[1]  Thomas B. Sheridan,et al.  Human–Robot Interaction , 2016, Hum. Factors.

[2]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[3]  Jacek Malec,et al.  Knowledge-based instruction of manipulation tasks for industrial robotics , 2015 .

[4]  Daniel H. Grollman,et al.  Remote Robotic Laboratories for Learning from Demonstration , 2012, Int. J. Soc. Robotics.

[5]  Nicholas Roy,et al.  An Object-Based Approach to Map Human Hand Synergies onto Robotic Hands with Dissimilar Kinematics , 2013 .

[6]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[7]  Ales Ude,et al.  Programming full-body movements for humanoid robots by observation , 2004, Robotics Auton. Syst..

[8]  Peng Sun,et al.  Computation of Minimum Volume Covering Ellipsoids , 2002, Oper. Res..

[9]  Aude Billard,et al.  What is the Teacher"s Role in Robot Programming by Demonstration? - Toward Benchmarks for Improved Learning , 2007 .

[10]  Ken Perlin,et al.  Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks , 2014, ACM Trans. Graph..

[11]  Stephen P. Boyd,et al.  Efficient distance computation using best ellipsoid fit , 1992, Proceedings of the 1992 IEEE International Symposium on Intelligent Control.

[12]  Eren Erdal Aksoy,et al.  Learning the semantics of object–action relations by observation , 2011, Int. J. Robotics Res..

[13]  Kun Qian,et al.  Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect , 2013 .

[14]  Alfred Theorin,et al.  A Sequential Control Language for Industrial Automation , 2014 .

[15]  Tae-Kyun Kim,et al.  Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Aude Billard,et al.  Iterative learning of grasp adaptation through human corrections , 2012, Robotics Auton. Syst..

[17]  ChangHwan Kim,et al.  Stable whole-body motion generation for humanoid robots to imitate human motions , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Luka Peternel,et al.  Humanoid robot posture-control learning in real-time based on human sensorimotor learning ability , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Angelo Cangelosi,et al.  A web based Multi-Modal Interface for elderly users of the Robot-Era multi-robot services , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Maxim Likhachev,et al.  A web-based infrastructure for recording user demonstrations of mobile manipulation tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).