Teaching by demonstration of assembly motion in VR - non-deterministic search-type motion in the teaching stage

"Teaching by Demonstration" is a method of generating a robot program that makes a robot do the same task as the task that a human operator demonstrates. We have developed a "teaching by demonstration in VR" system that automatically generates a robot program to work in the red world after a task is demonstrated by an operator in the virtual world. This system generates a program that detects each contact state extracted from demonstration in VR and produces it by skillful motion primitives. We find that some types of motion that are included in the recorded motion given by a human operator in the VR in teaching stage cannot be realized in the execution stage if the robot tries to do the same task by using the human demonstration data even on a contact state level. In this paper, based an our observation that a human has the skill wherein contact state transitions are made non-deterministically, we propose a method of dealing with one of the important non-deterministic motions, "non-deterministic search type motion" Experimental results show the feasibility of the method.

[1]  Kosei Kitagaki,et al.  A telerobotics system for maintenance tasks integrating planning functions based on manipulation skills , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[2]  Takashi Suehiro,et al.  New method for integration of multi-sensor and multi-actuator robot system , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[3]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator-generating control program , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[4]  Sheng Liu,et al.  Transfer of Human Skills to Robots: Learning from Human Demonstrations for Building an Adaptive Control System , 1992, 1992 American Control Conference.

[5]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[6]  Takashi Suehiro,et al.  Monitoring of a pseudo contact point for fine manipulation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[7]  Katsushi Ikeuchi,et al.  Task-Oriented Generation of Visual Sensing Strategies in Assembly Tasks , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  H. Harry Asada,et al.  Teaching Human Motion/Force Skills to Robots , 1995 .

[9]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator - extracting a sequence of contact state transition , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[10]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human variation in identifying obstacle free trajectories , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[11]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.