Cooperative teleoperation of a multirobot system with force reflection via Internet

With the rapid development of information technology, the Internet has evolved from a simple data-sharing media to an amazing information world where people can enjoy various services. Recently, the use of the Internet has been expanded to the field of automation, i.e., using the Internet as a tool to control equipment located at remote sites. This work presents a system that enables multiple operators at different sites to cooperatively control multiple robots with real-time force reflecting via the Internet. To overcome instability and reliability problems caused by random time delay of the Internet communication, we adopt an event as the reference for the controller design. To improve real-time efficiency and reduce the complexity of the controller, a distributed approach is proposed for the control of remote robots, so that the time delay in one control loop does not affect performance of the others. A vision-based method is developed to monitor and render interactions between the robots. The usefulness and effectiveness of the developed method and system have been verified by teleoperation experiments on a two-robots cooperative system among Hong Kong, mainland China, and the U.S.

[1]  Abderrahmane Kheddar,et al.  Multi-robots teleoperation - analysis and prognosis , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[2]  Ken Taylor,et al.  Internet robots: a new robotics niche , 2000, IEEE Robotics Autom. Mag..

[3]  Peter Xiaoping Liu,et al.  e-service robot in home healthcare , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[4]  R. Safaric,et al.  Telerobot control via Internet , 1999, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465).

[5]  Akihito Sano,et al.  Network-based force-reflecting teleoperation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  G. Liu.  Decomposition-based control of mechanical systems , 2000, 2000 Canadian Conference on Electrical and Computer Engineering. Conference Proceedings. Navigating to a New Era (Cat. No.00TH8492).

[7]  Hajime Asama,et al.  Teleoperation of multiple robots through the Internet , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[8]  Nobuto Matsuhira,et al.  Development of a multi-telerobot system for remote collaboration , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[9]  Cheng Chen,et al.  A study on the teleoperation of robot systems via WWW , 2000, 2000 Canadian Conference on Electrical and Computer Engineering. Conference Proceedings. Navigating to a New Era (Cat. No.00TH8492).

[10]  Reid G. Simmons,et al.  Lessons learned from Xavier , 2000, IEEE Robotics Autom. Mag..

[11]  Tzyh Jong Tarn,et al.  Stability analysis of non-time referenced Internet-based telerobotic systems , 2000, Robotics Auton. Syst..

[12]  Kenneth Y. Goldberg,et al.  The Mercury Project: a feasibility study for Internet robots , 2000, IEEE Robotics Autom. Mag..

[13]  Dinesh K. Pai,et al.  Model-based telerobotics with vision , 1997, Proceedings of International Conference on Robotics and Automation.

[14]  Tzyh Jong Tarn,et al.  Internet-based teleoperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[15]  Jean-Jacques E. Slotine,et al.  Towards force-reflecting teleoperation over the Internet , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[16]  William R. Hamel,et al.  Observations concerning Internet-based teleoperations for hazardous environments , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  Kenneth Y. Goldberg,et al.  Collaborative teleoperation via the Internet , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[18]  Ning Xi,et al.  Real-time control of Internet based teleoperation with force reflection , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Imad H. Elhajj,et al.  Modeling and control of Internet based cooperative teleoperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[20]  Matthew R. Stein,et al.  Interactive Internet artistry , 2000, IEEE Robotics Autom. Mag..

[21]  Ren C. Luo,et al.  Intelligent autonomous mobile robot control through the Internet , 2000, ISIE'2000. Proceedings of the 2000 IEEE International Symposium on Industrial Electronics (Cat. No.00TH8543).

[22]  Wolfram Burgard,et al.  Web interfaces for mobile robots in public places , 2000, IEEE Robotics Autom. Mag..

[23]  Isao Endo,et al.  Cooperative formation among multiple mobile robot teleoperation in inspection task , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).