VR-Based Teleoperation for Robot Compliance Control

Robots governed by remote human operators are excellent candidates for work in hazardous or uncertain environments such as nuclear plants or outer space. For successful teleoperation, it is important to let the operator feel physically present at the remote site. When the telerobotic system is used to execute compliance tasks in which simultaneous control of both position and force may be demanded and inevitable contact with environments is encountered, information about the interactions between the robot manipulator and the environment are especially crucial for the operator to make proper decisions. This paper proposes a VR-based telerobotic system for such compliance tasks. The proposed system provides both visual and haptic information. A local intelligence controller, capable of surface tracking and force regulation, is equipped on the robot manipulator to tackle the time-delay problem usually present in teleoperation and to share control load with the operator. The proposed telerobotic system is developed in a virtual environment due to recent gains in the capabilities and popularity of virtual reality to generate realistic telepresence. Experiments based on the surface-tracking and peg-in-hole compliance tasks demonstrate the effectiveness of the proposed system.

[1]  Mamoru Mitsuishi,et al.  Predictive information display for tele-handling/machining system , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[2]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Kuu-young Young,et al.  Reinforcement Learning and Robust Control for Robot Compliance Tasks , 1998, J. Intell. Robotic Syst..

[4]  Dinesh K. Pai,et al.  Programming contact tasks using a reality-based virtual environment integrated with vision , 1999, IEEE Trans. Robotics Autom..

[5]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[6]  Rajiv Dubey,et al.  Variable damping impedance control of a bilateral telerobotic system , 1997 .

[7]  H. Seraji,et al.  New results in adaptive impedance control of manipulators , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[8]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[9]  Gerd Hirzinger,et al.  Sensor-based space robotics-ROTEX and its telerobotic features , 1993, IEEE Trans. Robotics Autom..

[10]  Homayoon Kazerooni,et al.  The dynamics and control of a haptic interface device , 1994, IEEE Trans. Robotics Autom..

[11]  Akio Sudou,et al.  Dynamic hybrid position/force control of robot manipulators: online estimation of unknown constraint , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[12]  Vladimir J. Lumelsky,et al.  On human performance in telerobotics , 1991, IEEE Trans. Syst. Man Cybern..

[13]  Michitaka Hirose,et al.  Providing force feedback in virtual environments , 1995, IEEE Computer Graphics and Applications.

[14]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[15]  Lorenzo Sciavicco,et al.  The parallel approach to force/position control of robotic manipulators , 1993, IEEE Trans. Robotics Autom..

[16]  P. Rocco,et al.  Modular dynamic virtual-reality modeling of robotic systems , 1999, IEEE Robotics Autom. Mag..

[17]  Kuu-Young Young,et al.  Force reflection and manipulation for a VR-based telerobotic system , 2000 .

[18]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[19]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[20]  Blake Hannaford,et al.  Force-reflection and shared compliant control in operating telemanipulators with time delay , 1992, IEEE Trans. Robotics Autom..

[21]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[22]  Takeo Kanade,et al.  What you can see is what you can feel-development of a visual/haptic interface to virtual environment , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[23]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[24]  Tetsuo Kotoku A Predictive Display With Force Feedback And Its Application To Remote Manipulation System With Transmission Time Delay , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Claude Andriot,et al.  Imposing motion constraints to a force reflecting telerobot through real-time simulation of a virtual mechanism , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[26]  Tsuneo Yoshikawa,et al.  Dynamic hybrid position/force control of robot manipulators-on-line estimation of unknown constraint , 1993, IEEE Trans. Robotics Autom..

[27]  S. Lee,et al.  Intelligent control of manipulators interacting with an uncertain environment based on generalized impedance , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.

[28]  Duane K. Boman,et al.  International Survey: Virtual-Environment Research , 1995, Computer.

[29]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[30]  Mark W. Spong,et al.  Hybrid impedance control of robotic manipulators , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[31]  N. Hogan,et al.  Impedance Control:An Approach to Manipulation,Parts I,II,III , 1985 .

[32]  Hidekazu Yoshikawa,et al.  A research on tele-operation using virtual reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[33]  Martin Göbel,et al.  Industrial Applications of VEs , 1996 .

[34]  Tsuneo Yoshikawa,et al.  Display of Feel for the Manipulation of Dynamic Virtual Objects , 1995 .

[35]  Rajiv V. Dubey,et al.  Variable damping impedance control of a bilateral telerobotic system , 1996, Proceedings of IEEE International Conference on Robotics and Automation.