Use of coordinated online graphics simulator in collaborative multi-robot teleoperation with time delay

Coordinated control technologies have been developed for multi-robot collaboration in a common environment remotely controlled from multiple operators physically at a distance from each other. To verify the validity of the proposed approaches, we built a test bed and conducted a series of experiments, where we learned the effect of communication delay over the network on the performance of telerobots. This paper discusses the use of an online predictive simulator in the multi-operator-multi-robot (MOMR) tele-collaborative system to cope with the operator's delay visual perception over the network with time delay. In the test bed, each operator controls his/her master device to control two slave robots to cooperate in a task and detect a priori the possibility of collision in the graphics simulator that runs in near real-time. We demonstrate various tasks performed by two slave robots and two operators through LAN subjected to the simulated delays, and evaluate the use of the predictive simulator in MOMR tele-collaboration.

[1]  Philippe Even,et al.  Using structural knowledge for interactive 3D modeling of piping environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[2]  Kazuhiro Kosuge,et al.  Scaled telemanipulation with communication time delay , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[3]  Nobuto Matsuhira,et al.  Remote coordinated controls in multiple telerobot cooperation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[4]  Luis F. Peñín,et al.  Force reflection for time-delayed teleoperation of Space robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Nobuto Matsuhira,et al.  Development of a multi-telerobot system for remote collaboration , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[6]  Abderrahmane Kheddar,et al.  Parallel multi-robots long distance teleoperation , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[7]  Tzyh Jong Tarn,et al.  Internet-based remote teleoperation , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Kenneth Y. Goldberg,et al.  Desktop teleoperation via the World Wide Web , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[9]  Nak Young Chong,et al.  Audio-visual guided predictive simulator in multi-telerobot coordination , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[10]  Kenneth Y. Goldberg,et al.  Collaborative teleoperation via the Internet , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Won S. Kim,et al.  Demonstration of a high-fidelity predictive/preview display technique for telerobotic servicing in space , 1993, IEEE Trans. Robotics Autom..

[12]  Hajime Asama,et al.  Teleoperation of multiple robots through the Internet , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.