Human-inspired robot task learning from human teaching

The ability of a service or personal robot to learn new tasks from human teaching is important if it is to be multi- functioning and serve users a lifetime. Considering the vast variation of tasks, work environments, and nature of potential teachers or users who may not have knowledge in robotics, the problem of task teaching and learning can be difficult to achieve. Current methods of robot teaching and learning do not yet enable the robot to learn different types of tasks from the teaching by a general user. This paper presents a human- inspired method of robot task learning from human instructive hand-to-hand teaching. The method is novel in including an introduction of the complete task to the robot before task demonstration, a voting algorithm for segmenting the demonstrated task trajectory, and a Bayesian approach to assign partitioned trajectory segments to subtasks. Also, the proposed trajectory blending scheme can generate actual task paths in real-time to adapt learned tasks to new task setups.

[1]  Richard Volpe,et al.  Task space velocity blending for real-time trajectory generation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[2]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[3]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human variation in identifying obstacle free trajectories , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[4]  Shin-yo Muto,et al.  Teaching and control of robot contour-tracking using contact point detection , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[5]  Ulrich Nehmzow,et al.  "Programming" by Teaching: Neural Network Control in the Manchester Mobile Robot , 1995 .

[6]  Shiu Kit Tso,et al.  Automatic generation of robot program codes from perception of human demonstration , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[7]  Pradeep K. Khosla,et al.  Towards gesture-based programming: shape from motion primordial learning of sensorimotor primitives , 1997, Robotics Auton. Syst..

[8]  Y. Kunii,et al.  Tele-teaching by human demonstration in virtual environment for robotic network system , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  S. Chaudhuri,et al.  Automatic robot programming by visual demonstration of task execution , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[10]  Hiroyuki Ogata,et al.  A component architecture for customizing robot-teaching systems , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[11]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[12]  Donald R. Myers,et al.  Automated programming of an industrial robot through teach-by showing , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Richard Alan Peters,et al.  Robonaut task learning through teleoperation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[14]  Myoung Hwan Choi,et al.  Quantitative Evaluation of an Intuitive Teaching Method for Industrial Robot Using a Force / Moment Direction Sensor , 2003 .

[15]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[16]  Andrea Lockerd Thomaz,et al.  Tutelage and Collaboration for Humanoid Robots , 2004, Int. J. Humanoid Robotics.

[17]  Rüdiger Dillmann,et al.  Teaching and learning of robot tasks via observation of human performance , 2004, Robotics Auton. Syst..

[18]  Jeff I. Lieberman,et al.  Teaching a robot manipulation skills through demonstration , 2004 .

[19]  F. Hoffmann,et al.  Fuzzy behavior coordination for robot learning from demonstration , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[20]  Andrea Lockerd Thomaz,et al.  Tutelage and socially guided robot learning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[21]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[22]  Andrea Lockerd Thomaz,et al.  Using perspective taking to learn from ambiguous demonstrations , 2006, Robotics Auton. Syst..

[23]  Stefano Caselli,et al.  Robust trajectory learning and approximation for robot programming by demonstration , 2006, Robotics Auton. Syst..

[24]  Aude Billard,et al.  Active Teaching in Robot Programming by Demonstration , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[25]  Jonathan Kofman,et al.  Robot-Manipulator Teleoperation by Markerless Vision-Based Hand-Arm Tracking , 2007 .

[26]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Geoffrey Biggs,et al.  A Survey of Robot Programming Systems , 2010 .