Programming service tasks in household environments by human demonstration

Robot assistants will only reach a mass consumer market when they are easy to use. This applies especially to the way a user programs his robot system. The only approach that enables a non-expert robot user to teach a system complex tasks is programming by demonstration. This paper explains the basic concepts for mapping typical human actions performed in a household to a robot system: the recognition of the particular user actions, the task representation and the mapping strategy itself. The execution of a mapped program can then be performed on a real robot. An experiment is presented that was carried out concerning a table laying task and proving the feasibility of this approach.

[1]  Rosanna Heise.  Programming robots by example , 1993, Int. J. Intell. Syst..

[2]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[3]  A. Steinhage,et al.  Learning by Doing : A Dynamic Architecture for Generating Adaptive Behavioral Sequences , 2000 .

[4]  Holger Friedrich,et al.  Interaktive Programmierung von Manipulationssequenzen , 1998 .

[5]  R. Zollner,et al.  Dynamic grasp recognition within the framework of programming by demonstration , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[6]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[7]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator-generating control program , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[8]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[9]  Jianwei Zhang,et al.  Interactive assembly by a two-arm robot agent , 1999, Robotics Auton. Syst..

[10]  Rüdiger Dillmann,et al.  A general approach for modeling robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[11]  Rüdiger Dillmann,et al.  A sensor fusion approach for PbD , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[12]  R. Dillmann,et al.  TEACHING SERVICE ROBOTS COMPLEX TASKS : PROGRAMMING BY DEMONSTRATION FOR WORKSHOP AND HOUSEHOLD ENVIRONMENTS , 2001 .

[13]  Avinash C. Kak,et al.  Automatic learning of assembly tasks using a DataGlove system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[14]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps , 1997, IEEE Trans. Robotics Autom..

[15]  R. Dillmann,et al.  Sensor fusion approaches for observation of user actions in programming by demonstration , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[16]  Alberta Maria Segre,et al.  Machine Learning of Robot Assembly Plans , 1988 .

[17]  M. Arbib.  Coordinated control programs for movements of the hand , 1985 .

[18]  Rüdiger Dillmann,et al.  A comparison of four fast vision based object recognition methods for programming by demonstration applications , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Rüdiger Dillmann,et al.  Robot Programming by Demonstration (RPD): Supporting the Induction by Human Interaction , 1996, Machine Learning.

[20]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[21]  Tomoichi Takahashi.  Time normalization and analysis method in robot programming from human demonstration data , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[22]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-temporal segmentation of tasks from human hand motion , 1993, IEEE Trans. Robotics Autom..

[23]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[24]  Pradeep K. Khosla,et al.  Gesture-based programming: a preliminary demonstration , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).