Interactive Robot Programming Based on Human Demonstration and Advice

Service robots require interactive programming interfaces that allow users without programming experience to easily instruct the robots. Systems following the Programming by Demonstration (PbD) paradigm that were developed within the last years are getting closer to this goal. However, most of these systems lack the possibility for the user to supervise and influence the process of program generation after the initial demonstration was performed. In this paper an approach is presented, that enables the user to supervise the entire program generation process and to annotate, and edit system hypotheses. Moreover, the knowledge representation and algorithms presented enable the user to generalise the generated program by annotating conditions and object selection criteria via a 3D simulation and graphical user interface. The resulting PbD-system widens the PbD approach in robotics to programming based on human demonstrations and user annotations.

[1]  Katsushi Ikeuchi,et al.  Towards an assembly plan from observation. I. Assembly task recognition using face-contact relations (polyhedral objects) , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[2]  Katsushi Ikeuchi,et al.  Modelling planar assembly tasks: representation and recognition , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[3]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[4]  Rüdiger Dillmann,et al.  3D-icon based user interaction for robot programming by demonstration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[5]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[6]  Sing Bing Kang,et al.  Robot instruction by human demonstration , 1995 .

[7]  Tomoichi Takahashi.  Time normalization and analysis method in robot programming from human demonstration data , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[8]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps , 1997, IEEE Trans. Robotics Autom..

[9]  J. Napier.  The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[10]  Rüdiger Dillmann,et al.  Robot Programming by Demonstration (RPD): Supporting the Induction by Human Interaction , 1996, Machine Learning.

[11]  Thomas Knieriemen.  Autonome mobile Roboter - Sensordateninterpretation und Weltmodellierung zur Navigation in unbekannter Umgebung , 1991 .

[12]  Rüdiger Dillmann,et al.  Integrating skills into multi-agent systems , 1998, J. Intell. Manuf..

[13]  Katsushi Ikeuchi,et al.  A grasp abstraction hierarchy for recognition of grasping tasks from observation , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).