Teleoperation of collaborative mobile robots with force feedback over internet

A teleoperation system has been developed that enables two human operators to safely control two collaborative mobile robots in unknown and dynamic environments from any two PCs connected to the Internet by installing developed client program on them and by using simple force feedback joysticks. On the graphical user interfaces, the operators receive images forwarded by the cameras mounted on the robots, and on the the joysticks they feel forces forwarded by developed obstacle prevention algorithm based on the dynamic window approach. The amount and direction of the forces they feel on their hands depend on the distance and direction to the robot’ s closest obstacle, which can also be the collaborating robot. To overcome the instability caused by the unknown and varying time delay an event-based teleoperation method is employed to synchronize actions of each robot with commands from its operator. Through experimental investigation it is confirmed that developed teleoperation system enables the operators to successfully accomplish collaborative tasks in complex environments.

[1]  Meng Wang,et al.  Interactive control for Internet-based mobile robot teleoperation , 2005, Robotics Auton. Syst..

[2]  Gaurav S. Sukhatme,et al.  Haptic control of a mobile robot: a user study , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Yoram Koren,et al.  Teleautonomous guidance for mobile robots , 1990, IEEE Trans. Syst. Man Cybern..

[4]  Tzyh Jong Tarn,et al.  Internet-based teleoperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Ning Xi,et al.  Cooperative teleoperation of a multirobot system with force reflection via Internet , 2004, IEEE/ASME Transactions on Mechatronics.

[6]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[7]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[8]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[9]  Dongjun Lee,et al.  Bilateral teleoperation of a wheeled mobile robot over delayed communication network , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Ren C. Luo,et al.  Networked intelligent robots through the Internet: issues and opportunities , 2003, Proc. IEEE.

[11]  Robin R. Murphy,et al.  Cooperative Assistance for Remote Robot Supervision , 1996, Presence: Teleoperators & Virtual Environments.

[12]  Günter Dieter Niemeyer,et al.  Using wave variables in time delayed force reflecting teleoperation , 1996 .

[13]  Tzyh Jong Tarn,et al.  Stability analysis of non-time referenced Internet-based telerobotic systems , 2000, Robotics Auton. Syst..