Visualization and simulation of sensory events as a representation of states for state-based teaching by demonstration in VR

"Teaching by demonstration" is a method to generate a robot program that makes a robot do the same task as the task that a human operator demonstrates. We have developed a "teaching by demonstration in VR" system (TbDinVR) which automatically generates a robot program to work in the real world after a task is demonstrated by an operator in the virtual world. In this paper, we have explained necessary and sufficient condition for states in a task description, advantages of using state-based TbDinVR system, and a simulator for determining parameters of skill primitives by using sensor simulation in VR and a random search technique in detail. We have shown an experimental result and visualization of that result.

[1]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator - extracting a sequence of contact state transition , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[2]  Kosei Kitagaki,et al.  A telerobotics system for maintenance tasks integrating planning functions based on manipulation skills , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[3]  Takashi Suehiro,et al.  New method for integration of multi-sensor and multi-actuator robot system , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[4]  Takashi Suehiro,et al.  Monitoring of a pseudo contact point for fine manipulation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[5]  Rüdiger Dillmann,et al.  Building elementary robot skills from human demonstration , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Richard P. Paul,et al.  Teleprogramming: Toward Delay-Invariant Remote Manipulation , 1992, Presence: Teleoperators & Virtual Environments.

[7]  T. Suehiro,et al.  A model-based manipulation system with skill-based execution in unstructured environment , 1991 .

[8]  Craig Peter Sayers,et al.  Operator control of telerobotic systems for real world intervention , 1995 .

[9]  Rubin H. Landau,et al.  Computational Physics: Problem Solving with Computers , 1997 .

[10]  Dominik Henrich,et al.  Virtual Robot Programming for Deformable Linear Objects: System concept and Prototype Implementation , 2002 .

[11]  H. Harry Asada,et al.  Direct teaching and automatic program generation for the hybrid control of robot manipulators , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[12]  R. Paul,et al.  Teleprogramming: overcoming communication delays in remote manipulation , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[13]  Tomoichi Takahashi,et al.  Robotic assembly operation teaching in a virtual environment , 1994, IEEE Trans. Robotics Autom..

[14]  J. A. Schouten.  Tensor analysis for physicists , 1955 .

[15]  Mikhail J. Atallah,et al.  Algorithms and Theory of Computation Handbook , 2009, Chapman & Hall/CRC Applied Algorithms and Data Structures series.

[16]  Takashi Suehiro,et al.  Teaching by demonstration of assembly motion in VR-detection of nondeterministic search-type motion and developing of its skillful motion primitive , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[17]  Ralf Koeppe,et al.  Skill representation and acquisition of compliant motions using a teach device , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[18]  Masayuki Inaba,et al.  EusLisp: an object-based implementation of Lisp , 1991 .

[19]  Richard A. Volz,et al.  Learning force-based assembly skills from human demonstration for execution in unstructured environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[20]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human variation in identifying obstacle free trajectories , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[21]  Masayuki Inaba,et al.  Design and implementation of a system that generates assembly programs from visual recognition of human action sequences , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[22]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[23]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator-generating control program , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[24]  Katsushi Ikeuchi,et al.  Toward an assembly plan from observation. I. Task recognition with polyhedral objects , 1994, IEEE Trans. Robotics Autom..

[25]  T. Fukuda,et al.  Acquisition of human skills for robotic systems , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.