Internet-Based Bilateral Teleoperation: A Review and Future Directions with UDP and Event-Based Control

A survey is done of various results in the control of bilateral teleoperation systems in order to determine the best control scheme for telesurgery over the Internet. Telesurgery is a particularly demanding application where the challenges imposed by the Internet, including time-varying delay, lost packets and out-of-order packets, must be addressed to try to maximize performance. The nature of delay on IP networks and the merits of UDP as a transport protocol are investigated and out-of-order packets are shown to have the same effect as lost packets. Stochastic models can be used to characterize packet delay. Passivity-based, predictive, robust & optimal and event-based control are discussed with respect to teleoperation. When time-varying delays are introduced, the system becomes a hybrid event-time based system. Future work is proposed that would consider a delay model that incorporates knowledge of lost and out-of-order packets to be incorporated into a hybrid event-time predictive control scheme.

[1]  Xiufen Ye,et al.  Statistical analysis and prediction of round trip delay for Internet-based teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Peter Xiaoping Liu,et al.  Data Communications for Internet Robots , 2003, Auton. Robots.

[3]  Andrew S. Tanenbaum,et al.  Computer networks (3rd ed.) , 1996 .

[4]  G. Niemeyer,et al.  High-frequency acceleration feedback in wave variable telerobotics , 2006, IEEE/ASME Transactions on Mechatronics.

[5]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[6]  K. Khorasani,et al.  Comparison of linear and nonlinear H/sub /spl infin// control for a flexible-link manipulator , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[7]  Joseph A. Paradiso,et al.  Applying electric field sensing to human-computer interfaces , 1995, CHI '95.

[8]  Yunhui Liu,et al.  Improving efficiency of Internet based teleoperation using network QoS , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  O Smith,et al.  CLOSER CONTROL OF LOOPS WITH DEAD TIME , 1957 .

[10]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[11]  Lei-Ming Liu,et al.  Analysis and design of networked control systems with long delays based on Markovian jump model , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[12]  Günter Dieter Niemeyer,et al.  Using wave variables in time delayed force reflecting teleoperation , 1996 .

[13]  George C. Polyzos,et al.  Measurement Considerations for Assessing Unidirectional Latencies � , 1993 .

[14]  P. Fiorini,et al.  A Design Environment for Internet-Based Telerobotics , 1998 .

[15]  Vern Paxson,et al.  End-to-end routing behavior in the Internet , 1996, TNET.

[16]  C. Canudas-de-Wit,et al.  Predictive controller design for bilateral teleoperation systems with time varying delays , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[17]  Bruce A. Francis,et al.  Bilateral controller for teleoperators with time delay via μ-synthesis , 1995, IEEE Trans. Robotics Autom..

[18]  Tzyh Jong Tarn,et al.  Action synchronization and control of Internet based telerobotic systems , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  Stefano Stramigioli,et al.  Contact impedance estimation for robotic systems , 2005, IEEE Trans. Robotics.

[20]  David L. Mills,et al.  Internet time synchronization: the network time protocol , 1991, IEEE Trans. Commun..

[21]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[22]  S. G. Tzafestas,et al.  Towards variable-time-delays-robust telemanipulation through master state prediction , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[23]  R.V. Patel,et al.  Robotic suturing forces in the presence of haptic feedback and sensory substitution , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[24]  Jahng-Hyon Park,et al.  Real time bilateral control for Internet based telerobotic system , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[25]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[26]  Roberto Oboe.  Force-reflecting teleoperation over the Internet: the JBIT project , 2003 .

[27]  Ying Chen,et al.  Hybrid event based control architecture for tele-robotic systems controlled through Internet. , 2004, Journal of Zhejiang University. Science.

[28]  Romeo Ortega,et al.  On tracking performance in bilateral teleoperation , 2006, IEEE Transactions on Robotics.

[29]  Alberto Bemporad,et al.  Predictive control of teleoperated constrained systems with unbounded communication delays , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[30]  S. Munir,et al.  Internet based teleoperation using wave variables with prediction , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[31]  Song Aiguo,et al.  Robust control of teleoperation systems with time delay , 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904).

[32]  D. Georges,et al.  Optimal control design for the stabilization of network controlled systems , 2006, 2006 American Control Conference.

[33]  Tianmiao Wang,et al.  A low-cost internet-based telerobotic system for access to remote laboratories , 2001, Artif. Intell. Eng..

[34]  P.X. Liu,et al.  An end-to-end transmission architecture for the remote control of robots over IP networks , 2005, IEEE/ASME Transactions on Mechatronics.

[35]  Imad H. Elhajj,et al.  Transparency and synchronization in supermedia enhanced Internet-based teleoperation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).